a person standing in front of a flat screen television

Fully Articulated Hand Tracking

Established: October 2, 2014

We present a new real-time articulated hand tracker which can enable new possibilities for human-computer interaction (HCI). Our system accurately reconstructs complex hand poses across a variety of subjects using only a single depth camera. It also allows for a high-degree of robustness, continually recovering from tracking failures. However, the most unique aspect of our tracker is its flexibility in terms of camera placement and operating range.

 

Screenshots

handpose_hand1

handpose_hand2

Please note, we are using a standard Xbox One Kinect without any hardware modifications. The sunglasses are optional and were originally used for anonymity, and partly tongue-in-cheek.

People

People

Portrait of Andrew Fitzgibbon

Andrew Fitzgibbon

Partner Researcher

Portrait of Eyal Krupka

Eyal Krupka

Partner Research Manager

Portrait of Tom Cashman

Tom Cashman

Principal Scientist

Portrait of Toby Sharp

Toby Sharp

Principal Software Scientist Microsoft AI / HoloLens

Portrait of David Sweeney

David Sweeney

Senior Designer