{"id":349,"date":"2013-07-22T09:00:00","date_gmt":"2013-07-22T09:00:00","guid":{"rendered":"https:\/\/blogs.technet.microsoft.com\/inside_microsoft_research\/2013\/07\/22\/providing-short-videos-with-dynamic-loopingautomatically\/"},"modified":"2016-07-20T07:31:23","modified_gmt":"2016-07-20T14:31:23","slug":"providing-short-videos-with-dynamic-loopingautomatically","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/providing-short-videos-with-dynamic-loopingautomatically\/","title":{"rendered":"Providing Short Videos with Dynamic Looping\u2014Automatically"},"content":{"rendered":"<div id=\"share-icons-top-of-post\">\n<ul class=\"post-social\"><!--          FACEBOOK LIKE   CODE           --><\/p>\n<li class=\"post-facebook\"><iframe style=\"border: none; overflow: hidden; width: 100px; height: 21px;\" src=\"http:\/\/www.facebook.com\/plugins\/like.php?href=http%3A%2F%2Fblogs.technet.com%2Fb%2Finside_microsoft_research%2Farchive%2F2013%2F07%2F22%2Fproviding-short-videos-with-dynamic-looping-automatically.aspx&send=false&layout=button_count&width=100&show_faces=true&font=segoe+ui&colorscheme=light&action=like&height=21\" frameborder=\"0\" scrolling=\"no\"><\/iframe><\/li>\n<p><!--          TWITTER SHARING CODE           --><\/p>\n<li class=\"post-twitter\"><a class=\"twitter-share-button\" href=\"https:\/\/x.com\/share\" data-count=\"horizontal\" data-via=\"msftresearch\">Tweet<\/a><br \/>\n<script type=\"text\/javascript\" language=\"JavaScript\" src=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/js\/6811.tweet-this.js\" original-url=\"http:\/\/blogs.technet.com\/cfs-file.ashx\/__key\/communityserver-blogs-components-weblogfiles\/00-00-00-90-35-js\/6811.tweet_2D00_this.js\"><\/script>\n<\/li>\n<\/ul>\n<\/div>\n<p><!--    END SOCIAL SHARING CONTENT    --> <!-- ENTER AUTHOR AND BLOG CONTENT BELOW --><\/p>\n<p class=\"posted-by\">Posted by <span class=\"author\">Rob Knies<\/span><\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/4431.videoloops.jpg\" original-url=\"http:\/\/blogs.technet.com\/cfs-file.ashx\/__key\/communityserver-blogs-components-weblogfiles\/00-00-00-90-35\/4431.videoloops.jpg\"><img decoding=\"async\" style=\"margin: 10px; border: 0px currentColor; float: left;\" title=\"Video-looping parameters\" src=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/4431.videoloops.jpg\" original-url=\"http:\/\/blogs.technet.com\/resized-image.ashx\/__size\/550x0\/__key\/communityserver-blogs-components-weblogfiles\/00-00-00-90-35\/4431.videoloops.jpg\" alt=\"Video-looping parameters\" width=\"400\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>With today&rsquo;s mobile devices, users can find shooting high-definition video as easy as snapping a photograph. That should mean, before long, that preserving and sharing bursts of video might become as commonplace as the current practice of exchanging still images.<\/p>\n<p>That&rsquo;s the backdrop for a research project from the University of Illinois at Urbana-Champaign and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Microsoft Research Redmond\" href=\"http:\/\/research.microsoft.com\/en-us\/labs\/redmond\/default.aspx\" target=\"_blank\">Microsoft Research Redmond<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> that captures a spectrum of looping videos with varying levels of dynamism, ranging from a static image to a highly animated loop.<\/p>\n<p>The research is detailed in a technical paper, written by Zicheng Liao of the University of Illinois at Urbana-Champaign and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Neel Joshi\" href=\"http:\/\/research.microsoft.com\/en-us\/um\/people\/neel\/\" target=\"_blank\">Neel Joshi<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Hugues Hoppe\" href=\"http:\/\/research.microsoft.com\/en-us\/um\/people\/hoppe\/\" target=\"_blank\">Hugues Hoppe<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> of Microsoft Research Redmond, titled <em><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"<em>Automated Video Looping with Progressive Dynamism<\/em>&#8221; href=&#8221;http:\/\/research.microsoft.com\/en-us\/um\/people\/hoppe\/videoloops.pdf&#8221; target=&#8221;_blank&#8221;>Automated Video Looping with Progressive Dynamism<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/em>. The paper is among the 19 authored all or in part by Microsoft Research that have been accepted for presentation during the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"40th International Conference and Exhibition on Computer Graphics and Interactive Techniques\" href=\"http:\/\/s2013.siggraph.org\/\" target=\"_blank\">40th International Conference and Exhibition on Computer Graphics and Interactive Techniques<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (SIGGRAPH 2013), being held July 21 to 25 in Anaheim, Calif.<\/p>\n<p>&ldquo;We have developed a technique to automatically create an infinitely looping video from a short input video sequence of five to 10 seconds,&rdquo; explains Hoppe, a principal researcher and manager of the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Computer Graphics Group\" href=\"http:\/\/research.microsoft.com\/en-us\/groups\/graphics\/\" target=\"_blank\">Computer Graphics Group<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. &ldquo;One can shoot a five-second video of a pretty landscape and generate an animated version of the scene to play on a PC desktop or in a slide show.&rdquo;<\/p>\n<p>This is the latest manifestation of an effort envisioned in 2006 by Microsoft Research Redmond&rsquo;s <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Michael Cohen\" href=\"http:\/\/research.microsoft.com\/en-us\/um\/people\/cohen\/\" target=\"_blank\">Michael Cohen<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Richard Szeliski\" href=\"http:\/\/research.microsoft.com\/en-us\/um\/people\/szeliski\/\" target=\"_blank\">Richard Szeliski<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> to do a better job of &ldquo;<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"capturing the moment\" href=\"http:\/\/research.microsoft.com\/pubs\/75560\/Cohen-Szeliski_C06.pdf\" target=\"_blank\">capturing the moment<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.&rdquo; It comes on the heels of related work on <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Cliplets\" href=\"http:\/\/research.microsoft.com\/apps\/video\/default.aspx?id=160668\" target=\"_blank\">Cliplets<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"BLINK\" href=\"http:\/\/research.microsoft.com\/en-us\/um\/redmond\/projects\/blink\/\" target=\"_blank\">BLINK<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/p>\n<p>&ldquo;The goal,&rdquo; says Hoppe, a fellow of the Association for Computing Machinery (ACM), &ldquo;is to bring static photographs back to life. Last year&rsquo;s work on Cliplets shares this same goal. Cliplets reanimates a portion of a scene based on user-specified regions and time intervals. The emphasis is on creative control&mdash;creating contrasting juxtapositions of frozen and dynamic content.<\/p>\n<p>&ldquo;In contrast, &lsquo;automated video looping&rsquo; requires no user input. It tries to incorporate as much dynamic content as possible, so it is able to capture more scene activity, including subtle motions like water ripples and swaying grass.&rdquo;<\/p>\n<p>The problem is challenging. The automated solution offered by Liao, Joshi, and Hoppe enables each pixel to determine its own looping period.<\/p>\n<p>&ldquo;What is unique over prior work is that in the looping video, regions of pixels can have different looping periods, and these periods are found automatically as part of an optimization algorithm,&rdquo; says Hoppe, a member of the SIGGRAPH 2013 Technical Papers Committee, as is Microsoft Research Redmond colleague <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" title=\"Johannes Kopf\" href=\"http:\/\/research.microsoft.com\/en-us\/people\/kopf\/\">Johannes Kopf<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. &ldquo;It would be very tedious for a user to manually identify all these small regions and their natural loops.&rdquo;<\/p>\n<p>That segmentation gives users the interactive ability to adjust the dynamism of the scene. The level of dynamic activity in the scene can depend on the user&rsquo;s personal taste or mood.<\/p>\n<p>&ldquo;The second contribution of the paper,&rdquo; says Hoppe, recipient of the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"ACM SIGGRAPH Computer Graphics Achievement Award\" href=\"http:\/\/research.microsoft.com\/en-us\/um\/people\/hoppe\/AchievementAward.pdf\" target=\"_blank\">ACM SIGGRAPH Computer Graphics Achievement Award<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> in 2004, &ldquo;is to show that once we have created the &lsquo;most dynamic video loop,&rsquo; we can use information from the optimization to provide the user with simple controls over dynamism in the resulting scene.<\/p>\n<p>&ldquo;One such control is a slider that lets the user adjust the overall level of dynamism. In essence, we are traversing a sequence of video loops, from completely static to most dynamic. The clever part is that we don&rsquo;t actually have to store all these various loops. We just store the most dynamic loop, together with an &lsquo;activation&rsquo; value per pixel that indicates when that pixel should &lsquo;turn on&rsquo;&mdash;become dynamic&mdash;as the slider moves.&rdquo;<\/p>\n<p>The researchers also have ensured that all regions of a scene loop well together.<\/p>\n<p>&ldquo;As dynamism, varies, it is necessary that small regions of pixels start or stop looping together,&rdquo; Hoppe says. &ldquo;For example, if only half of a branch was moving, we would see an obvious spatial discontinuity. We identify these &lsquo;independent looping regions,&rsquo; again automatically, and let the user spatially adjust dynamism at the granularity of these regions.&rdquo;<\/p>\n<p>The resulting nested segmentation of static and dynamic regions are extremely compact. Such work could be applied to subtly animated desktop backgrounds and replacements for still images in slide shows or webpages. Understandably, Hoppe and his colleagues are proud of what they have achieved.<\/p>\n<p>&ldquo;It was an ambitious goal to find the most natural looping period of each pixel in a video using a global optimization,&rdquo; Hoppe smiles. &ldquo;This resulted in a new formulation that initially looked daunting, but we were able to make the problem tractable using some clever simplifications. We&rsquo;re looking forward to sharing the work during SIGGRAPH to see what the community has to say.&rdquo;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Tweet Posted by Rob Knies With today&rsquo;s mobile devices, users can find shooting high-definition video as easy as snapping a photograph. That should mean, before long, that preserving and sharing bursts of video might become as commonplace as the current practice of exchanging still images. That&rsquo;s the backdrop for a research project from the University [&hellip;]<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[],"msr_hide_image_in_river":0,"footnotes":""},"categories":[1],"tags":[200183,200571,200713,195043,201051,201385,201389,201879,202217,202473,202669,196463,202869,203009,203549,203827,204155,204207,197597,186688,204797],"research-area":[],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-349","post","type-post","status-publish","format-standard","hentry","category-research-blog","tag-40th-international-conference-and-exhibition-on-computer-graphics-and-interactive-techniques","tag-automated-video-looping-with-progressive-dynamism","tag-blink","tag-cliplets","tag-computer-graphics-group","tag-dynamic","tag-dynamism","tag-hugues-hoppe","tag-johannes-kopf","tag-looping","tag-michael-cohen","tag-microsoft-research-redmond","tag-mobile-device","tag-neel-joshi","tag-richard-szeliski","tag-siggraph-2013","tag-technical-papers-committee","tag-the-moment-camera","tag-university-of-illinois-at-urbana-champaign","tag-video","tag-zicheng-liao","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[],"related-projects":[],"related-events":[],"related-researchers":[],"msr_type":"Post","byline":"","formattedDate":"July 22, 2013","formattedExcerpt":"Tweet Posted by Rob Knies With today&rsquo;s mobile devices, users can find shooting high-definition video as easy as snapping a photograph. That should mean, before long, that preserving and sharing bursts of video might become as commonplace as the current practice of exchanging still images.That&rsquo;s&hellip;","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/349","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=349"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/349\/revisions"}],"predecessor-version":[{"id":261465,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/349\/revisions\/261465"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=349"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=349"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=349"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=349"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=349"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=349"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=349"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=349"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=349"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=349"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=349"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}