Graphics and multimedia

Addressing challenges in geometric compression and multiresolution representations

What's on the page

  1. Microsoft Research Blog
  2. Next at Microsoft Blog
  3. Projects
  4. Publications
  5. Products & Downloads
  6. Videos
  7. People
  8. Groups
  9. Career Opportunities

Microsoft Research Blog

See the Microsoft Research blog
Project Vermont

Project Vermont: Improving camera performance through curved image sensors

By Richard Stoakley, Microsoft Research It’s hard to remember when our world wasn’t full of cameras. They’re in our phones and tablets, posted on street corners and in our buildings and cars. We rely on them not just to capture moments and memories, but for security, navigation, 3D spatial mapping and processing medical data. While significant advances have been made to camera sensors and the algorithms that process images, optical systems have not seen the…

May 2017

Microsoft Research Blog

Holograms: The future of near-eye display?

Holograms: The future of near-eye display?

By Andrew Maimone, Researcher; Andreas Georgiou, Researcher; Joel Kollin, Principal Research Hardware Development Engineer Last week at the SCIEN Workshop on Augmented and Mixed Reality, a group of industry and academic researchers met to discuss the future of virtual and mixed reality (VR/MR). One goal was clear: we’d all like to put on devices that look and feel like ordinary eyeglasses but can bring us to new places. We also want to maintain the full fidelity of human…

May 2017

Microsoft Research Blog

MSR Swiss Joint Research Center

From improving a golf swing to reducing energy in datacenters

2017 Swiss Joint Research Center kick off By Scarlet Schwiderski-Grosche, Senior Research Program Manager Attendees of the 2017 Swiss Joint Research Center Workshop in Cambridge, UK. (left to right) Aurelien Lucchi and Sebastian Stich, Postdoctoral Researchers at ETH Zurich and EPFL, and Martin Jaggi, Assistant Professor at EPFL, at the workshop. Recently, we celebrated an important milestone for our Swiss Joint Research Center (Swiss JRC). We welcomed top researchers from all partners to a workshop…

February 2017

Microsoft Research Blog

Next at Microsoft Blog

See the Next at Microsoft blog

AI’s big leap to tiny devices opens world of possibilities

Sometimes the best place to showcase the potential of a bold, world-changing technology is a flower garden. Take the case of Ofer Dekel, for example. He manages the Machine Learning and Optimization group at Microsoft’s research lab in Redmond, Washington. Squirrels often devoured flower bulbs in his garden and seeds from his bird feeder, depriving…

June 2017

Next at Microsoft Blog

How Microsoft used AI to help crack down on tech support scams worldwide

The scam works like this: There you are, using your computer just like any other day, when suddenly a pop-up appears, warning you that your computer has been infected by a virus and you need to call tech support immediately. If you try to get rid of the pop-up, it just keeps coming back. If…

June 2017

Next at Microsoft Blog

Microsoft Pix provides iPhones stylistic flair

Microsoft has released new features for Microsoft’s AI-powered camera app for iPhones and iPads that automatically give snapshots stylistic flair reminiscent of masterpiece paintings and artsy photos hanging in the famed galleries of Amsterdam, Paris and New York. The features, which were developed in collaboration with Microsoft’s Asia research lab and Skype, are part of…

June 2017

Next at Microsoft Blog

Projects

See all 79 results

Project Vermont

Established: May 1, 2012

While significant advances have been made to camera sensors and the algorithms that process images, optical systems have not seen the same radical improvements. The Project Vermont Team set out to solve one of the most well-known optical issues in conventional photography: field curvature. Field curvature exists because lenses don’t want to focus on a plane. A lens delivers sharpest focus along a curved path, rather than on a flat sensor. The result: objects appear out…

Audio Signal Processing

Established: September 1, 2000

Audio signal processing is a key component of real-time, computer communication systems. In this project, we are exploring new adaptive signal processing methods for improving audio. Primary focuses including acoustic echo cancellation, acoustic echo suppression, and speaker identification.

Fine-grained Image Recognition

Established: July 1, 2016

Recognizing fine-grained categories (e.g., bird species) is difficult due to the challenges of discriminative region localization and fine-grained feature learning. In this project, we are aiming at recognizing the fine-grained image categories at a very high accuracy. For example, now we can recognize more 1,000 flower species, 200 birds, 200 dogs, 800+ car models with the accuracy higher than 88% in several large-scale real-world datasets. In our work accepted to CVPR 2017, we propose a…

Publications

See all 969 results

Products & Downloads

See all 27 results

VideoCube

January 2017

VideoCube allows one to load an AVI movie file as a volume, and play back the movie sampling space and time in different ways. It also provides a single cutting plane for interactively viewing single spacetime slices of the video.

    Click the icon to access this download

  • Website

Recovering Shape and Spatially-Varying Surface Reflectance Under Unknown Illumination

December 2016

We present a novel integrated approach for estimating both spatially-varying surface reflectance and detailed geometry from a video of a rotating object under unknown static illumination. Key to our method is the decoupling of the recovery of normal and surface reflectance from the estimation of surface geometry. We define an apparent normal field with corresponding…

    Click the icon to access this download

  • Website

Microsoft Hyperlapse Mobile

November 2016

Microsoft Hyperlapse Mobile creates smooth and stabilized time lapses from first-person videos using a Windows Phone or Android device.

    Click the icon to access this download

  • Website

Videos

See all 198 results

New Year: New VREality – Community Workshop and Meet Up 2017

January 12, 2017

Speakers

Jerry Carleton, Matt Hooper, Yan Perng, Brian Sommer, Craig Parietti, Don Alvarez, Tom Doyle, Scilla Andreen, Alex Abuan, Sandis Kondrats, Ander Bergstrum, Morgan Sinko, Paolo Tosolini, Brian Stading, Erick Scheel, Ryan White

Affiliation

Immix Law Group, IME Law, Foster Pepper PLLC, IME Law, Parietti and Partners, Accelerated Pictures, Endevour One, IndiFlix, Chronos Academy, Anatomy Next, Mocap Now, NullspaceVR, Tosolini Productions, CenturyLink, Top360.com, Element 7 Productions

People

See all 27 results

Groups

See all 10 results

Multimedia Search and Mining

Multimedia Search and Mining (MSM) group focuses on a wide variety of multimedia-related research and projects, e.g., understanding, analysis, search, data mining, and applications. We are working on research problems in image understanding, video analytics, large scale visual (image and video) indexing and search, 3D reconstruction, and so on.

Multimedia, Interaction, and Communication (MIC)

The Multimedia, Interaction, and Communication (MIC) group extends the state of the art of multimedia technologies involving audio, visual, haptic, and other natural signals, comprising acquisition, representation, analysis, compression, transmission, synthesis, and rendering. We apply our expertise in computer vision, acoustics, multimedia signal processing, and information coding to improve people’s experience in interacting with each other and with machines. Applications are immersive human-human telecommunications, human-robot interaction, augmented reality, multimedia retrieval, etc.

Audio and Acoustics Research Group

The Audio and Acoustics group conducts research in audio processing and speech enhancement, 3D audio perception and technologies, devices for audio capture and rendering, array processing, information extraction from audio signals. Overview The mission of the Audio and Acoustics Group is to develop state of the art algorithms and designs for audio processing, speech enhancement, 3D audio capture and rendering. We also work on the better acoustical design of audio devices, such as microphones and loudspeakers. The group conducts…

Career Opportunities

See all 1 results

Audio Processing Research Post-Doc and Researcher

Type: Post-doc researcher
Lab/Location: Microsoft Research Lab - Redmond
Research Area: Artificial intelligence, Graphics and multimedia, Human language technologies

The Audio and Acoustics Research group in the Microsoft Research Redmond Lab (Redmond, WA, USA) is looking for a few post-docs and researchers who seek positions in audio research and who want to help the innovation of future break-through products. Experience Statistical audio signal processing using machine learning approaches Sound capture and rendering Speech enhancement Processing for arrays of transducers Psychoacoustics Human perception of sounds and images Qualifications Applicants must have a PhD in CS,…

​