Signing avatars on stage
In this project the Lab’s Mocap/3D team collaborated with Riksteatern Crea to create a signing avatar to act on stage with living actors in real-time. This project combined three different mocap systems capturing different parts of the body: (i) the optical mocap system capturing the main body (torso, head, legs and arms), (ii) stretchsense gloves capturing the movement of the hands and fingers, and (iii) a mobile phone system capturing the face (where many grammatical features are signaled in sign language). The data from the three systems were synchronously mapped onto a 3D avatar, creating a live 3D rendering of the signer producing fully comprehensible sign language.
Crea (Sweden’s National Touring Theatre and their group for dramatic art in Swedish Sign Language)
The Canterville ghost: from motion capture to real-time virtual reality