Create Your First Project
Start adding your projects to your portfolio. Click on "Manage Projects" to get started
MR Clippy
Project type
Mixed Reality AI Experiment
Role
Unity Prototyper
I dusted off the old HoloLens for this personal project exploring a fun embodied AI. This MixedReality Clippy leveraged the multimodal capabilities of GPT-4o to see and understand the world around me and Clippy gets his voice from a modified speech synthesis from Azure AI Speech.
Next steps are to implement live web search so Clippy can display relevant links via Unity Webview components when prompted and add more intelligent movement mechanics for Clippy.
Through creating this project I’ve learned that embodiment can often add unnecessary complexity for AI interactions and that relying on AI vibecoding too much can complicate development process and make it more difficult to track down the source of nuanced problems in code.