Audio and acoustics
Tool
Microsoft Hands-Free Sound Machine
Microsoft Hands-Free Sound Machine is a WPF XAML application that works with a number of Tobii eye tracking devices and leverages the audio and MIDI APIs in Windows 10 to play both sampled audio and…
Video
Microsoft Hands-Free Sound Machine Demo
Microsoft Hands-Free Sound Machine is an eye-controlled, 16-step sound sequencer that provides users the ability to generate musical compositions via a combination of .wav and midi samples, and supports output to physical instruments as well…
Video
Microsoft Hands-Free Sound Jam Intro – Clip Launcher
Microsoft Hands-Free Sound Jam is an eye-controlled music environment for electronic loop-based performance and composition. It is designed using familiar design paradigms found in commercial music production software, which have been adapted to work well…
Video
Microsoft Hands-Free Sound Jam Intro – Clip Editor
Microsoft Hands-Free Sound Jam is an eye-controlled music environment for electronic loop-based performance and composition. It is designed using familiar design paradigms found in commercial music production software, which have been adapted to work well…
Video
Microsoft Hands-Free Sound Jam Demo
Microsoft Hands-Free Sound Jam is an eye-controlled music environment for electronic loop-based performance and composition. It is designed using familiar design paradigms found in commercial music production software, which have been adapted to work well…
Video
Microsoft Expressive Pixels Intro
Microsoft Expressive Pixels is a platform that enables the authoring and rendering of static and animated visualizations on NeoPixel and other addressable LED displays, for Makers and Professionals alike. The Expressive Pixels suite consists of…
Project
Pose Tracking with Wearable and Ambient Devices
Summary Analyzing human motion with high autonomy requires advanced capabilities in sensing, communication, energy management and AI. Wearable systems help us go beyond external cameras enabling motion analysis in the wild. However, such systems are still…
Video
Articulated Human Pose Tracking with Inertial Sensors
Thus far, capturing human body motion has only been possible with precisely-positioned sensors and cameras in well-calibrated studio environments. This constraint has fundamentally restricted the application of motion-capture technology to low-no mobility scenarios. To precisely…
Video
High-Accuracy Neural-Network Models for Speech Enhancement
In this talk we will discuss our recent work on AI techniques that improve the quality of audio signals for both machine understanding and sensory perception. Our best models utilize convolutional-recurrent neural networks. They improve…
