The Power of PixelSense

 
 
Microsoft PixelSense allows a display to recognize fingers, hands, and objects placed on the screen, enabling vision-based interaction without the use of cameras. The individual pixels in the display see what's touching the screen and that information is immediately processed and interpreted.
 
Think of it like the connection between the eye and the brain. You need both, working together, to see. In this case, the eye is the sensor in the panel, it picks up the image and it feeds that to the brain which is our vision input processor that recognizes the image and does something with it. Taken in whole…this is PixelSense technology.

How Does PixelSense Work?

What is Surface?
 
A step-by-step look at how PixelSense works:
 
  1. A contact (finger/blob/tag/object) is placed on the display
  2. IR back light unit provides light (though the optical sheets, LCD and protection glass) that hits the contact.
  3. Light reflected back from the contact is seen by the integrated sensors
  4. Sensors convert the light signal into an electrical signal/value
  5. Values reported from all of the sensors are used to create a picture of what is on the display
  6. The picture is analyzed using image processing techniques
  7. The output is sent to the PC. It includes the corrected sensor image and various contact types (fingers/blobs/tags)