Sensory Immersion

In this first of a kind Mixed Reality experience, we used a Kinect to recognize the skeleton, and an in-engine rig with two bone inverse kinematics to translate human gesture across anatomies into a bat flapping its wings. To let party goers see even more of themselves in the bat, a point cloud mirrored the bat’s face to their own.

The apparition was accompanied by a bloodcurdling screech and the sound generated by the flapping wings was Framestore’s first foray into real time audio. Sensory elements like falling snow and mist deepened the experience.