Inside this project
01 / Project Overview
Project Overview
I dusted off the old HoloLens for this personal project exploring a fun embodied AI.
This Mixed Reality Clippy leveraged the multimodal capabilities of GPT-4 to see and understand the world around me and Clippy gets his voice from a modified speech synthesis from Azure AI Speech.
Next steps are to implement live web search so Clippy can display relevant links via Unity Webview components when prompted and add more intelligent movement mechanics for Clippy.
02 / Demos
Demos
Mixed Reality Clippy Demo
Open video ↗Clippy sees the surrounding world and responds through synthesized speech.