{"id":170924,"date":"2012-03-06T14:42:58","date_gmt":"2012-03-06T14:42:58","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/project\/cliplets-juxtaposing-still-and-dynamic-imagery\/"},"modified":"2017-06-05T15:04:14","modified_gmt":"2017-06-05T22:04:14","slug":"cliplets-juxtaposing-still-and-dynamic-imagery","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/cliplets-juxtaposing-still-and-dynamic-imagery\/","title":{"rendered":"Cliplets: Juxtaposing Still and Dynamic Imagery"},"content":{"rendered":"<h2>What Are Cliplets?<\/h2>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-355835\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2012\/03\/fountain-300x225.gif\" alt=\"\" width=\"300\" height=\"225\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2012\/03\/fountain-300x225.gif 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2012\/03\/fountain-80x60.gif 80w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\u00a0\u00a0\u00a0\u00a0 <img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-355838\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2012\/03\/Candles4-300x225.gif\" alt=\"\" width=\"300\" height=\"225\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2012\/03\/Candles4-300x225.gif 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2012\/03\/Candles4-80x60.gif 80w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>Microsoft Research Cliplets is an interactive app that uses semi-automated methods to give users the power to create &#8220;Cliplets&#8221; &#8211; a type of imagery that sits between stills and video from handheld videos. The app provides a creative lens one can use to focus on important aspects of a moment by mixing static and dynamic elements from a video clip.<\/p>\n<p>Please see the\u00a0<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"\" href=\"http:\/\/www.windowsphone.com\/en-us\/store\/app\/blink\/3e185ac7-2d21-4a74-9cad-3d4729509446\" target=\"_blank\">BLINK and BLINK Cliplets<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>\u00a0page for more information about the latest version of the Cliplets app.<\/p>\n\t<div data-wp-context='{\"items\":[]}' data-wp-interactive=\"msr\/accordion\">\n\t\t\t\t\t<div class=\"clearfix\">\n\t\t\t\t<div\n\t\t\t\t\tclass=\"btn-group align-items-center mb-g float-sm-right\"\n\t\t\t\t\tdata-bi-aN=\"accordion-collapse-controls\"\n\t\t\t\t>\n\t\t\t\t\t<button\n\t\t\t\t\t\tclass=\"btn btn-link m-0\"\n\t\t\t\t\t\tdata-bi-cN=\"Expand all\"\n\t\t\t\t\t\tdata-wp-bind--aria-controls=\"state.ariaControls\"\n\t\t\t\t\t\tdata-wp-bind--aria-expanded=\"state.ariaExpanded\"\n\t\t\t\t\t\tdata-wp-bind--disabled=\"state.isAllExpanded\"\n\t\t\t\t\t\tdata-wp-class--inactive=\"state.isAllExpanded\"\n\t\t\t\t\t\tdata-wp-on--click=\"actions.onExpandAll\"\n\t\t\t\t\t\ttype=\"button\"\n\t\t\t\t\t>\n\t\t\t\t\t\tExpand all\t\t\t\t\t<\/button>\n\t\t\t\t\t<span aria-hidden=\"true\"> | <\/span>\n\t\t\t\t\t<button\n\t\t\t\t\t\tclass=\"btn btn-link m-0\"\n\t\t\t\t\t\tdata-bi-cN=\"Collapse all\"\n\t\t\t\t\t\tdata-wp-bind--aria-controls=\"state.ariaControls\"\n\t\t\t\t\t\tdata-wp-bind--aria-expanded=\"state.ariaExpanded\"\n\t\t\t\t\t\tdata-wp-bind--disabled=\"state.isAllCollapsed\"\n\t\t\t\t\t\tdata-wp-class--inactive=\"state.isAllCollapsed\"\n\t\t\t\t\t\tdata-wp-on--click=\"actions.onCollapseAll\"\n\t\t\t\t\t\ttype=\"button\"\n\t\t\t\t\t>\n\t\t\t\t\t\tCollapse all\t\t\t\t\t<\/button>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t\t\t<ul class=\"msr-accordion\">\n\t\t\t\t\t\t\t\t<li class=\"m-0\" data-wp-context='{\"id\":\"accordion-content-2\"}' data-wp-init=\"callbacks.init\">\n\t\t<div class=\"accordion-header\">\n\t\t\t<button\n\t\t\t\taria-controls=\"accordion-content-2\"\n\t\t\t\tclass=\"btn btn-collapse\"\n\t\t\t\tdata-wp-bind--aria-expanded=\"state.isExpanded\"\n\t\t\t\tdata-wp-on--click=\"actions.onClick\"\n\t\t\t\tid=\"accordion-button-1\"\n\t\t\t\ttype=\"button\"\n\t\t\t>\n\t\t\t\tAbout\t\t\t<\/button>\n\t\t<\/div>\n\t\t<div\n\t\t\taria-labelledby=\"accordion-button-1\"\n\t\t\tclass=\"msr-accordion__content\"\n\t\t\tdata-wp-bind--inert=\"!state.isExpanded\"\n\t\t\tdata-wp-run=\"callbacks.run\"\n\t\t\tid=\"accordion-content-2\"\n\t\t>\n\t\t\t<div class=\"msr-accordion__body\">\n\t\t\t\t<p>Cliplets is a research project from Microsoft Research. This project explores a form of visual media that juxtaposes still image and video segments, both spatially and temporally, to expressively abstract a moment. The tension between static and dynamic elements in a cliplet reinforces both aspects, strongly focusing the viewer&#8217;s attention or conveying a narrative. We develop a set of idioms, essentially spatiotemporal mappings, that characterize these cliplet elements, and use these idioms in an interactive system to quickly compose a cliplet from ordinary handheld video. A key challenge is to avoid seam artifacts by maintaining spatiotemporal continuity in the cliplet composition. We address this using several algorithms from computer graphics and vision.<\/p>\n<p>The publically available app is a result of this research project. Here is a Techinical Report describing the underlying research:<\/p>\n<p>Neel Joshi, Sisil Mehta, Steven Drucker, Eric Stollnitz, Hugues Hoppe, Matt Uyttendaele, and Michael Cohen. <em><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/cliplets-juxtaposing-still-and-dynamic-imagery\/\">Cliplets: Juxtaposing Still and Dynamic Imagery<\/a><\/em>. No. MSR-TR-2012-52. 15 May 2012.<\/p>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/li>\n\t\t<li class=\"m-0\" data-wp-context='{\"id\":\"accordion-content-4\"}' data-wp-init=\"callbacks.init\">\n\t\t<div class=\"accordion-header\">\n\t\t\t<button\n\t\t\t\taria-controls=\"accordion-content-4\"\n\t\t\t\tclass=\"btn btn-collapse\"\n\t\t\t\tdata-wp-bind--aria-expanded=\"state.isExpanded\"\n\t\t\t\tdata-wp-on--click=\"actions.onClick\"\n\t\t\t\tid=\"accordion-button-3\"\n\t\t\t\ttype=\"button\"\n\t\t\t>\n\t\t\t\tCompatibility\t\t\t<\/button>\n\t\t<\/div>\n\t\t<div\n\t\t\taria-labelledby=\"accordion-button-3\"\n\t\t\tclass=\"msr-accordion__content\"\n\t\t\tdata-wp-bind--inert=\"!state.isExpanded\"\n\t\t\tdata-wp-run=\"callbacks.run\"\n\t\t\tid=\"accordion-content-4\"\n\t\t>\n\t\t\t<div class=\"msr-accordion__body\">\n\t\t\t\t<p>Cliplets works with 32-bit and 64-bit versions of Windows 7 and later.<\/p>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/li>\n\t\t<li class=\"m-0\" data-wp-context='{\"id\":\"accordion-content-6\"}' data-wp-init=\"callbacks.init\">\n\t\t<div class=\"accordion-header\">\n\t\t\t<button\n\t\t\t\taria-controls=\"accordion-content-6\"\n\t\t\t\tclass=\"btn btn-collapse\"\n\t\t\t\tdata-wp-bind--aria-expanded=\"state.isExpanded\"\n\t\t\t\tdata-wp-on--click=\"actions.onClick\"\n\t\t\t\tid=\"accordion-button-5\"\n\t\t\t\ttype=\"button\"\n\t\t\t>\n\t\t\t\tTutorials\t\t\t<\/button>\n\t\t<\/div>\n\t\t<div\n\t\t\taria-labelledby=\"accordion-button-5\"\n\t\t\tclass=\"msr-accordion__content\"\n\t\t\tdata-wp-bind--inert=\"!state.isExpanded\"\n\t\t\tdata-wp-run=\"callbacks.run\"\n\t\t\tid=\"accordion-content-6\"\n\t\t>\n\t\t\t<div class=\"msr-accordion__body\">\n\t\t\t\t<ul>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.youtube.com\/embed\/bKH368UlM5w\">Tutorial One<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> shows how to make a simple Cliplet with a still background and one repeating &#8220;loop&#8221; layer.<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.youtube.com\/embed\/5CGEki2JWMc\">Tutorial Two<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> continues Tutorial One by adding one repeating &#8220;mirror&#8221; layer.<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.youtube.com\/embed\/kb8OCYib2GM\">Tutorial Three<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> shows how to make a Cliplet with a still background, one repeating &#8220;loop,&#8221; and a &#8220;play&#8221; layer that begins in the middle of the Cliplet.<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.youtube.com\/embed\/Yv7ySKLBbIs\">Tutorial Four<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> shows how to make a Cliplet with temporally juxstaposed layers.<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.youtube.com\/embed\/ZJMETkRn2UU\">Tutorial Five<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> shows a bit more complex Cliplet with a &#8220;play&#8221; layer that holds, then plays, then holds. This is overlaid with a &#8220;loop&#8221; layer during the first hold, and a &#8220;mirror&#8221; layer during the final hold. The result depicts a classic blowing-out-candles moment.<\/li>\n<\/ul>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/li>\n\t\t<li class=\"m-0\" data-wp-context='{\"id\":\"accordion-content-8\"}' data-wp-init=\"callbacks.init\">\n\t\t<div class=\"accordion-header\">\n\t\t\t<button\n\t\t\t\taria-controls=\"accordion-content-8\"\n\t\t\t\tclass=\"btn btn-collapse\"\n\t\t\t\tdata-wp-bind--aria-expanded=\"state.isExpanded\"\n\t\t\t\tdata-wp-on--click=\"actions.onClick\"\n\t\t\t\tid=\"accordion-button-7\"\n\t\t\t\ttype=\"button\"\n\t\t\t>\n\t\t\t\tSupport\t\t\t<\/button>\n\t\t<\/div>\n\t\t<div\n\t\t\taria-labelledby=\"accordion-button-7\"\n\t\t\tclass=\"msr-accordion__content\"\n\t\t\tdata-wp-bind--inert=\"!state.isExpanded\"\n\t\t\tdata-wp-run=\"callbacks.run\"\n\t\t\tid=\"accordion-content-8\"\n\t\t>\n\t\t\t<div class=\"msr-accordion__body\">\n\t\t\t\t<p>Microsoft Research Cliplets is provided free of charge and without official support. However, if you have questions or issues, you may find help at the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/social.microsoft.com\/Forums\/en-US\/cliplets\">Cliplets Forum<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, which is monitored by the developers and provides community-based support. You may also want to view our Tutorials.<\/p>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/li>\n\t\t\t\t\t\t<\/ul>\n\t<\/div>\n\t\n","protected":false},"excerpt":{"rendered":"<p>What Are Cliplets? \u00a0\u00a0\u00a0\u00a0 Microsoft Research Cliplets is an interactive app that uses semi-automated methods to give users the power to create &#8220;Cliplets&#8221; &#8211; a type of imagery that sits between stills and video from handheld videos. The app provides a creative lens one can use to focus on important aspects of a moment by [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13562,13551],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-170924","msr-project","type-msr-project","status-publish","hentry","msr-research-area-computer-vision","msr-research-area-graphics-and-multimedia","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2012-03-06","related-publications":[162770,165148],"related-downloads":[],"related-videos":[343874],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","value":"neel","display_name":"Neel Joshi","author_link":"<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/neel\/\" aria-label=\"Visit the profile page for Neel Joshi\">Neel Joshi<\/a>","is_active":false,"user_id":33073,"last_first":"Joshi, Neel","people_section":0,"alias":"neel"}],"msr_research_lab":[199565],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/170924","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/170924\/revisions"}],"predecessor-version":[{"id":355817,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/170924\/revisions\/355817"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=170924"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=170924"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=170924"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=170924"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=170924"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}