{"id":431,"date":"2013-12-23T17:10:00","date_gmt":"2013-12-23T17:10:00","guid":{"rendered":"https:\/\/blogs.technet.microsoft.com\/inside_microsoft_research\/2013\/12\/23\/two-from-microsoft-research-win-helmholtz-recognition\/"},"modified":"2016-07-20T07:30:41","modified_gmt":"2016-07-20T14:30:41","slug":"two-from-microsoft-research-win-helmholtz-recognition","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/two-from-microsoft-research-win-helmholtz-recognition\/","title":{"rendered":"Two from Microsoft Research Win Helmholtz Recognition"},"content":{"rendered":"<div id=\"share-icons-top-of-post\">\n<ul class=\"post-social\">\n<li class=\"post-facebook\"><iframe src=\"http:\/\/www.facebook.com\/plugins\/like.php?href=http%3A%2F%2Fblogs.technet.com%2Fb%2Finside_microsoft_research%2Farchive%2F2013%2F12%2F23%2Ftwo-from-microsoft-research-win-helmholtz-recognition.aspx&width=100&layout=button_count&action=like&show_faces=true&share=false&height=21&appId=502558646482372\" scrolling=\"no\" frameborder=\"0\" style=\"border:none;overflow:hidden;width:100px;height:21px;\"><\/iframe><\/li>\n<li class=\"post-twitter\"><a class=\"twitter-share-button\" href=\"https:\/\/x.com\/share\">Tweet<\/a><br \/>\n<script type=\"text\/javascript\" src=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/js\/6811.tweet-this.js\" original-url=\"http:\/\/blogs.technet.com\/cfs-file.ashx\/__key\/communityserver-blogs-components-weblogfiles\/00-00-00-90-35-js\/6811.tweet_2D00_this.js\"><\/script>\n<\/li>\n<\/ul>\n<\/div>\n<p><!--    END SOCIAL SHARING CONTENT and ENTER AUTHOR AND BLOG CONTENT BELOW --><\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/ComputerSocietyLogo.jpg\" original-url=\"http:\/\/blogs.technet.com\/cfs-file.ashx\/__key\/communityserver-blogs-components-weblogfiles\/00-00-00-90-35\/ComputerSocietyLogo.jpg\"><img decoding=\"async\" width=\"300\" title=\"IEEE Computer Society logo\" style=\"margin:10px;border:0px currentColor;float:left;\" alt=\"IEEE Computer Society logo\" src=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/ComputerSocietyLogo.jpg\" original-url=\"http:\/\/blogs.technet.com\/resized-image.ashx\/__size\/300x0\/__key\/communityserver-blogs-components-weblogfiles\/00-00-00-90-35\/ComputerSocietyLogo.jpg\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>This year, the IEEE Technical Committee on Pattern Analysis and Machine Intelligence, the organizer of the International Conference on Computer Vision (ICCV), inaugurated the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Helmholtz Prize\" href=\"http:\/\/www.computer.org\/portal\/web\/tcpami\/Helmholtz-Prize\" target=\"_blank\">Helmholtz Prize<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, a test-of-time award presented for papers published at least 10 years ago that continue to influence the field of computer vision.<\/p>\n<p>Given the huge strides the field has achieved, identifying papers with the greatest impact loomed as a daunting challenge, but for the authors of the papers, the results were gratifying&mdash;particularly for a couple of scientists from Microsoft Research.<\/p>\n<p>During <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"ICCV 2013\" href=\"http:\/\/www.iccv2013.org\/\" target=\"_blank\">ICCV 2013<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, held in Sydney from Dec. 3-6, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"P. Anandan\" href=\"http:\/\/research.microsoft.com\/en-us\/press\/anandan.aspx\" target=\"_blank\">P. Anandan<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" title=\"Zhengyou Zhang\" href=\"http:\/\/research.microsoft.com\/en-us\/um\/people\/zhang\/\">Zhengyou Zhang<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> had seminal papers recognized in the first set of Helmholtz Prize honorees.<\/p>\n<p>Anandan, a Microsoft distinguished scientist and managing director of <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Microsoft Research India\" href=\"http:\/\/research.microsoft.com\/en-us\/labs\/india\/\" target=\"_blank\">Microsoft Research India<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, shared the award with colleague <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Michael Black\" href=\"http:\/\/cs.brown.edu\/~black\/\" target=\"_blank\">Michael Black<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> for <em><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"<em>A framework for the robust estimation of optical flow<\/em>\" href=\"http:\/\/cs.brown.edu\/research\/pubs\/pdfs\/1993\/Black-1993-FRE.pdf\" target=\"_blank\">A framework for the robust estimation of optical flow<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/em>, presented during ICCV 1993.<\/p>\n<p>Zhang&rsquo;s paper, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Flexible Camera Calibration by Viewing a Plane from Unknown Orientations\" href=\"http:\/\/research.microsoft.com\/en-us\/um\/people\/zhang\/Papers\/TR98-71.pdf\" target=\"_blank\"><em>Flexible Camera Calibration by Viewing a Plane from Unknown Orientations<\/em><span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, for which he was the sole author, was accepted for the conference six years later.<\/p>\n<p>While both researchers have undertaken many projects over the ensuing years, their memories of their Helmholtz Prize-winning work remain fresh.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/1854.P._Anandan.jpg\" original-url=\"http:\/\/blogs.technet.com\/cfs-file.ashx\/__key\/communityserver-blogs-components-weblogfiles\/00-00-00-90-35\/1854.P._5F00_Anandan.jpg\"><img decoding=\"async\" title=\"P. Anandan\" style=\"margin:10px;border:0px currentColor;float:right;\" alt=\"P. Anandan\" src=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/1854.P._Anandan.jpg\" original-url=\"http:\/\/blogs.technet.com\/resized-image.ashx\/__size\/300x0\/__key\/communityserver-blogs-components-weblogfiles\/00-00-00-90-35\/1854.P._5F00_Anandan.jpg\" border=\"0\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a>&ldquo;This paper was a culmination of 10 years of research, starting with my Ph.D. thesis work,&rdquo; recalls Anandan, a research manager at the David Sarnoff Research Center when the paper was written. &ldquo;I published the first version of the algorithm in 1987, at the first ICCV conference, in London. The work continued after I joined Yale as a faculty member in computer science, when Michael Black joined as a student and worked under my supervision. He extended and expanded the algorithm, making it more robust, efficient, and general. This was the algorithm that was published in 1993 at ICCV in Berlin&mdash;and that won the award.&rdquo;&nbsp;<\/p>\n<p>Zhang&rsquo;s recollections are similarly precise.<\/p>\n<p>&ldquo;This was done 15 years ago at Microsoft Research,&rdquo; says Zhang, a principal researcher and manager of the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Multimedia, Interaction, and Communication\" href=\"http:\/\/research.microsoft.com\/en-us\/groups\/mic\/\" target=\"_blank\">Multimedia, Interaction, and Communication<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> group at <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Microsoft Research Redmond\" href=\"http:\/\/research.microsoft.com\/en-us\/labs\/redmond\/\" target=\"_blank\">Microsoft Research Redmond<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. &ldquo;After I joined Microsoft Research, I wrote a memo entitled Desktop Vision for my research plan. I was envisioning that, one day, every desktop computer would come equipped with a camera that was capable of perceiving the surrounding 3-D environment and understanding the emotion of its user. The first step was to know the camera parameters, such as the focal length, the pixel-aspect ratio, the center of the image sensor, and the camera&rsquo;s position and orientation. This is the process of camera calibration.&rdquo;<\/p>\n<p>His paper detailed a flexible technique for making that easy, requiring the camera only to observe a planar pattern shown at a small number of different orientations.<\/p>\n<p>&ldquo;The classical approach was to use a precisely fabricated 3-D apparatus, which is expensive and inconvenient,&rdquo; Zhang says. &ldquo;I wanted to devise a flexible calibration technique. With my knowledge of projective geometry I gained through my previous research career at INRIA [the French Institute for Research in Computer Science and Control], I discovered that we could calibrate a camera by just showing a planar pattern at a few different orientations. Either the camera or the planar pattern can be freely moved, and the pattern can be printed on paper, then attached to a planar surface such as cardboard. It is really easy to use and flexible.&rdquo;<\/p>\n<p>Anandan and Black saw their algorithm gain rapid acceptance. Given a pair of images, optical flow tracks every pixel in one frame to the next, generating a series of vectors for every pixel in the shot. With analysis, advanced image processing can identify shapes and objects in the images. The technique quickly gained high-profile adherents.<\/p>\n<p>&ldquo;We knew that the algorithm was popular even at that time,&rdquo; Anandan says. &ldquo;Michael had made it available as a free download on his webpage, and it was downloaded by a number of organizations, including those in the movie industry, where it was widely used.&rdquo;<\/p>\n<p>Millions of filmgoers have reaped the benefits while viewing such blockbusters as <em>Mission: Impossible<\/em> and the <em>Matrix<\/em> series.<\/p>\n<p>&ldquo;Since then, the work on optical flow has continued,&rdquo; Anandan adds, &ldquo;but it appears, after two decades, that the algorithm we published in 1993 is still one of the best, and many other algorithms include some of the key features of ours.&rdquo;<\/p>\n<p>It&rsquo;s been about a decade since Anandan has been involved in optical-flow projects, but Black continues to advance the work and is considered the world&rsquo;s leading expert on the topic, now as director of the Max Planck Institute of Intelligent Systems, located in T&uuml;bingen, Germany.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/Zhengyou_Zhang.jpg\" original-url=\"http:\/\/blogs.technet.com\/cfs-file.ashx\/__key\/communityserver-blogs-components-weblogfiles\/00-00-00-90-35\/Zhengyou_5F00_Zhang.jpg\"><img decoding=\"async\" width=\"300\" title=\"Zhengyou Zhang\" style=\"margin:10px;border:0px currentColor;float:left;\" alt=\"Zhengyou Zhang\" src=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/Zhengyou_Zhang.jpg\" original-url=\"http:\/\/blogs.technet.com\/resized-image.ashx\/__size\/300x0\/__key\/communityserver-blogs-components-weblogfiles\/00-00-00-90-35\/Zhengyou_5F00_Zhang.jpg\" border=\"10\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a>Zhang, too, sees continued, robust interest in his work that, 14 years later, resulted in a Helmholtz Prize. His ICCV paper, and its successor published in <em>IEEE Transactions on Pattern Analysis and Machine Intelligence<\/em>, have been cited more than 7,400 times.<\/p>\n<p>In fact, it could well be the most widely used camera-calibration algorithm extant. The technique outlined in Zhang&rsquo;s paper is employed in computer-vision research labs the world over, as well as by many companies. A version calibrated the vision system in NASA&rsquo;s Mars Rover, and another version is used to recalibrate <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Kinect\" href=\"http:\/\/www.xbox.com\/en-US\/kinect\" target=\"_blank\">Kinect<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> sensors.<\/p>\n<p>&ldquo;I developed the technology for my own need,&rdquo; he says. &ldquo;It is useful for me, and it should be useful for others, too.<\/p>\n<p>&ldquo;Did I have any idea that the paper would have this sort of lasting impact? No, but I did say in my paper that &lsquo;it advances 3-D computer vision one step, from laboratory environments to real-world use.&rdquo;<\/p>\n<p class=\"posted-by\"><span class=\"author\">&nbsp;<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Tweet This year, the IEEE Technical Committee on Pattern Analysis and Machine Intelligence, the organizer of the International Conference on Computer Vision (ICCV), inaugurated the Helmholtz Prize, a test-of-time award presented for papers published at least 10 years ago that continue to influence the field of computer vision. Given the huge strides the field has [&hellip;]<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[],"msr_hide_image_in_river":0,"footnotes":""},"categories":[1],"tags":[200805,200811,186897,201251,201597,201603,201813,201905,201907,201929,201933,186931,193671,195953,187348,202575,202603,202625,202663,193526,196463,202849,203159,196766,203295,204185,204717,197889],"research-area":[],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-431","post","type-post","status-publish","format-standard","hentry","category-research-blog","tag-calibration","tag-camera","tag-computer-vision","tag-david-sarnoff-research-center","tag-flexible-camera-calibration-by-viewing-a-plane-from-unknown-orientations","tag-focal-length","tag-helmholtz-prize","tag-iccv","tag-iccv-2013","tag-ieee-technical-committee-on-pattern-analysis-and-machine-intelligence","tag-ieee-transactions-on-pattern-analysis-and-machine-intelligence","tag-image-sensor","tag-inria","tag-international-conference-on-computer-vision","tag-kinect","tag-mars-rover","tag-matrix","tag-max-planck-institute-of-intelligent-systems","tag-michael-black-a-framework-for-the-robust-estimation-of-optical-flow","tag-microsoft-research-india","tag-microsoft-research-redmond","tag-mission-impossible","tag-optical-flow","tag-p-anandan","tag-pixel-aspect-ratio","tag-test-of-time","tag-yale","tag-zhengyou-zhang","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[],"related-projects":[],"related-events":[],"related-researchers":[],"msr_type":"Post","byline":"","formattedDate":"December 23, 2013","formattedExcerpt":"Tweet This year, the IEEE Technical Committee on Pattern Analysis and Machine Intelligence, the organizer of the International Conference on Computer Vision (ICCV), inaugurated the Helmholtz Prize, a test-of-time award presented for papers published at least 10 years ago that continue to influence the field&hellip;","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/431","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=431"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/431\/revisions"}],"predecessor-version":[{"id":261252,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/431\/revisions\/261252"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=431"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=431"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=431"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=431"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=431"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=431"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=431"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=431"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=431"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=431"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=431"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}