Cinematic Mocap
XR Lab, 2024
Motion Capture - Unreal Engine - Cinematic Direction - Camera Work - Sound Design - Storytelling
Details
I designed an interactive installation concept during a 6-month internship at MST Hospital’s Innovation Lab. The installation showcases healthcare innovation using physical exhibits and models animated inside a Voxon VX2 holographic display. It serves as a modular and accessible concept for use in public hospital space.
Problem
XR Lab was actively using motion capture tools but lacked a compelling way to demonstrate their full capabilities to clients, collaborators, and audiences. They needed a clear showcase that could present the range and realism of their motion capture technology.
Requirements
The team must use live-recorded motion capture data (body, hands, face) provided by the client and present cinematic in a polished form.
My Contributions
As a designer on the team, I led the narrative and cinematic production.
My contributions included:
Developing the storyline and pacing for the cinematic
Creating the storyboard, with a focus on actions suitable for capture
Directing the motion capture recording sessions with a live actor
Using Unreal’s Sequencer to build the cinematic:
Designing camera angles
Adding lights, timing, and VFX elements
Researching and selecting sound and music references to support audio design by artists
Results
The cinematic was handed to XR Lab and based on feedback demonstrated full motion capture pipeline in a cohesive, visually engaging format. It helped them better communicate the creative and technical potential to future clients and partners. The project also established a repeatable process for future showcases using real captured data and Unreal Engine workflows.
Gallery
