Extended Reality
Spatial computing, mixed reality, immersive simulations, and XR applications bridging physical and digital space.
Drawn to Life
An AI-powered interactive art installation for Olin College's presidential inauguration — community hand-drawn sketches are transformed by AI image regeneration into an animated, motion-tracked living visualization that evolves as people move through the space.
TEI Prototype
A Unity maze prototype for the ACM TEI (Tangible, Embedded and Embodied Interaction) conference, featuring microphone-driven fish movement, Kinect body tracking, collaborative ability mechanics, and a procedurally generated maze. Built at CMU School of Design with Haeyoung Kim.
Voices of Olin
An interactive RFID + spatial audio installation for Olin College's presidential inauguration — unfinished community prototypes speak their stories through smart listening pedestals, transforming the everyday objects of making into a living, collective portrait of Olin.
ETC CAVERN
A 270-degree circular projection system with a 20-foot-wide play area, designed for local multiplayer interactions within virtual spaces.
Immersive Multilingual Storytelling
Multi-wall projected touchscreen exhibit featuring 3D virtual human avatars trained with multilingual chatbot personalities from cultures around the world.
Participatory Multicultural Storytelling
Enhanced interactive installation with directional ultrasonic haptics and physical embodied humanoid robot avatars, expanding the Immersive Multilingual Storytelling exhibit.
ARENAXR Digital Twins & 3D Scanning
Collection of 3D LiDAR photogrammetry scans, digital twin environments, and interactive ARENA scenes built at WiSELab @ CMU ECE.
Dynamic Projector Mapper
Real-time 3D dynamic projection mapping system that tracks multiple rigid objects via Optitrack motion capture and maps media onto them from a fixed 4K projector.
HTC Vive Network Streamer
Customized HTC Vive tracker network streamer for real-time motion tracking over LAN.
IoT Digital Twins in XR
Hybrid online AR/VR/XR experiences and interfaces for IoT Digital Twins, developed at WiSELab @ Carnegie Mellon ECE.
Multilingual LLM AI VR/AR/MR Chatbot Avatar
A multilingual LLM AI chatbot avatar NPC for Meta Quest 3, built as a mixed reality experience for the Askwith Kenner Immersive Technology Room for Language and Culture. Features an elf wizard character ("Faelyn Cardithas") who speaks English, French, German, and Japanese — powered by Wit.ai speech recognition, ConvAI/ChatGPT, and expressive blend shape animations in a fantasy VR/MR environment.
Projection-Mapped Pinball Game V2
AR pinball combining projection-mapped interactive digital media with a real, super-size physical pinball machine. Version 2 with bigger and better hardware.
ARENAXR WebXR IoT Bosch Car Digital Twin
A WebXR digital twin of a Bosch IoT-connected car, built in ARENAXR for real-time visualization of vehicle sensor data in a collaborative web-based XR environment.
ARENAXR IoT Bosch Pendulum Calibrator
A WebXR IoT interface for calibrating a Bosch pendulum sensor device, visualizing real-time pendulum motion data in the ARENAXR collaborative web platform.
ARENAXR WebXR NPC Chatbot
An AI-powered NPC chatbot agent integrated into the ARENAXR WebXR collaborative platform, enabling natural language conversation with virtual characters in shared XR spaces.
Nextovation AR Digital Twin
An augmented reality digital twin developed for Nextovation, overlaying real-time IoT data and spatial visualizations onto physical environments through an AR interface.
ARENAXR ETC WebXR Digital Twin
A WebXR digital twin of the CMU Entertainment Technology Center built in ARENAXR, enabling remote and in-person visitors to explore and interact with a virtual replica of the ETC space.
ARENAXR Hybrid Collaborative Remote Virtual Rube Goldberg Machine
A hybrid physical-virtual Rube Goldberg machine built in ARENAXR for Remake Learning, combining real-world IoT triggers with collaborative WebXR interactions across remote participants.
ARENAXR WebXR Chess
A fully playable multiplayer chess game built inside the ARENAXR collaborative WebXR platform, playable from any browser in shared virtual space.
BLENDi — AR Museum Guide
An Augmented Reality museum guide and navigator running on HoloLens 2, built for Equmenopolis Inc.'s SXSW Edu showcase.
ETC ARCADE
Augmented Reality Creative Annotation Drawing Environment — a multiplayer AR iOS app for drawing and creating objects in a physics-enabled virtual sandbox.
ARENAXR Virtual ETC Festival 2020
A virtual festival experience built in ARENAXR for the CMU Entertainment Technology Center's 2020 festival, enabling remote attendees to explore and interact in a shared WebXR space.
Algorithmic Hiring Center
HoloLens AR experience exploring a futuristic algorithmic workplace, created with CMU ETC, KnowledgeWorks, and Remake Learning. Exhibited at Thrival 2019 and ISTE 2019.
HARP — Holographic Archive of Research Projects
A digital library of research projects displayed on an open-source Pepper's Ghost hologram pyramid projector. Includes 6 free laser-cut templates to build your own low-cost holographic display from a smartphone, tablet, or monitor. Supported by the Frank-Ratchye STUDIO for Creative Inquiry and CMU ProSeed.
Project Codetta
Experimental Google Cardboard VR RPG — enter the digital world inside your smartphone. Built by John Choi and Daniel Hua. Scored 3rd Place at the Global Archiact Jam.
SMART: Some Mobile Augmented Reality Thing
An AR tower defense game built with Unity and Qualcomm Vuforia for Android. Place 4 physical marker cards on any flat surface and defend headquarters from robotic spider monsters in full 3D augmented reality.
WorldBuilder
Kinect + voice-controlled planet colonization game built in 24 hours at HackCMU 2014. Won Microsoft's Choice Award. Build civilizations using hand gestures and speech, like in sci-fi movies.