Multilingual LLM AI VR/AR/MR Chatbot Avatar
A multilingual LLM AI chatbot avatar NPC for Meta Quest 3 with expressive behaviours, speech recognition, and text-to-speech powered by Wit.ai and ConvAI/ChatGPT.
Overview
A demonstrator project for a fully conversational multilingual AI avatar NPC running on Meta Quest 3 in mixed reality. The character uses Wit.ai for speech recognition, ConvAI’s ChatGPT wrapper for conversation, and text-to-speech for voice output — combined with expressive blend shape animations and reactive behaviors.
Key Features
- Real-time multilingual speech recognition via Wit.ai
- LLM-driven conversation using ConvAI / ChatGPT
- Expressive facial animation synced to speech output
- Meta Quest 3 MR passthrough — character appears in your real space
- Open-source template for building AI NPC characters in XR