The European Union Marie Curie project GOLEM - Realistic Virtual Humans, is a researcher’s exchange program between companies and academia in Europe. In this case, the exchange program covers the Microsoft and Face in Motion, as companies, and the Universities of Porto, in Portugal and, of Zaragoza and Barcelona, in Spain.
Silent Speech Experiments in GOLEM with Surface Electromyography Sensors (sEMG)
The ability of socially and emotionally impaired individuals to recognize and respond to emotions conveyed by the face is critical to improve their communication skills.
The GOLEM project will show how it is possible to apply a pioneer serious game approach to teach children with Autism Spectrum Disorder (ASD) to recognize facial emotions, using real time photo-realistic image synthesis and automatic facial expression analysis, in order to elicit emotional reactions from those children.
Microsoft is developing visual speech animation for those virtual characters as well as silent speech interaction for kids.
The main scientific and technological outcome of GOLEM will be a comprehensive system that animates spoken characters and enables avatars to respond in real-time in a variety of (virtual) environments. The system will on the one hand speed up the animation and rendering processes and on the other hand help study social behaviors, like social phobia, in order to develop appropriate therapies.