{"id":236277,"date":"2016-06-03T13:39:06","date_gmt":"2016-06-03T20:39:06","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=236277"},"modified":"2018-07-16T17:32:51","modified_gmt":"2018-07-17T00:32:51","slug":"cloud-powered-vr","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/cloud-powered-vr\/","title":{"rendered":"Cloud and Edge Mobile Mixed Reality"},"content":{"rendered":"<p>Our goal is to enable mobile devices to deliver fully immersive and untethered mixed reality experiences. We investigate how to enable this experiences in battery-powered devices through leveraging resources available in either nearby edge devices or the cloud. Some of the challenges we study include latency hiding and bandwidth reduction on cloud streaming, pre-rendering and caching virtual worlds, HMD display power efficiency, render and ML offload as well as edge node scheduling of VR\/AR\/MR workloads. We have produced several prototypes and published our results in top conferences. Our work has been featured in the press several times.<\/p>\n<p><strong>In The News<\/strong><\/p>\n<p>Check out what the press has to say about our work.<\/p>\n<ul>\n<li>ProxyIBR: \u00a0<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/www.neowin.net\/news\/microsoft-research-wants-to-bring-high-quality-mobile-vr-to-all-of-our-devices\">Neowin\u00a0<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> , <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/www.vrroom.buzz\/vr-news\/trends\/microsoft-cracks-high-quality-vr-mobile-devices\">VROOM<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li>FlashBack: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"https:\/\/www.yahoo.com\/tech\/microsoft-research-project-could-bring-154204427.html\" target=\"_blank\">Yahoo<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.networkworld.com\/article\/3079789\/consumer-electronics\/microsoft-research-comes-up-with-a-workable-low-end-vr-system.html\">Network World<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>,\u00a0<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/www.neowin.net\/news\/microsofts-flashback-can-bring-high-quality-vr-to-every-low-end-phone-and-laptop\" target=\"_blank\">Neowin<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"\" href=\"http:\/\/www.phonearena.com\/news\/Microsoft-FlashBack-system-looks-to-bring-high-quality-VR-to-lower-end-phones_id81689\" target=\"_blank\">Phone Arena<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/www.winbeta.org\/news\/microsoft-researchs-flashback-brings-high-quality-vr-low-end-phones-pcs\" target=\"_blank\">WinBeta<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/mspoweruser.com\/microsofts-flashback-capable-bringing-high-quality-vr-low-end-phones\/\" target=\"_blank\">MS Power User<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/www.slashgear.com\/microsoft-research-flashback-can-bring-vr-even-to-low-end-devices-31442190\/\" target=\"_blank\">SlashGear<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li>Kahawai: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/www.zdnet.com\/article\/project-cuts-broadband-use-to-a-fraction-with-gpu-offload-combined-with-the-cloud\/\" target=\"_blank\">ZDNET<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/www.neowin.net\/news\/microsofts-kahawai-is-a-step-forward-for-cloud-based-game-streaming\" target=\"_blank\">Neowin<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/www.extremetech.com\/gaming\/206378-microsofts-new-rendering-research-could-bring-better-visuals-to-xbox-one-mobile-devices\" target=\"_blank\">ExtremeTech<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/www.geek.com\/games\/microsoft-cuts-cloud-game-streaming-bandwidth-by-over-80-1623534\/?origref\" target=\"_blank\">Geek<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li>Irides: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/www.neowin.net\/news\/irides-microsofts-project-to-create-a-better-virtual-reality-headset\" target=\"_blank\">Neowin<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/www.vg247.com\/2015\/05\/15\/project-irides-microsoft-researches-a-cloud-based-vr-headset\/\" target=\"_blank\">VG24\/7<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/www.bawakayi.com\/davidchu\/wp-content\/plugins\/download-monitor\/download.php?id=30\" target=\"_blank\">ct magazine<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li>Outatime: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/techcrunch.com\/2014\/08\/22\/microsoft-research-shows-off-delorean-its-tech-for-building-a-lag-free-cloud-gaming-service\/\">Tech Crunch<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.theverge.com\/2014\/8\/23\/6060033\/microsoft-research-delorean-lag-free-cloud-gaming-system-revealed\">The Verge<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.engadget.com\/2014\/08\/23\/microsoft-delorean\/\">Engadget<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/games.slashdot.org\/story\/14\/08\/26\/027214\/predictive-modeling-to-increase-responsivity-of-streamed-games\">Slashdot<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.pcmag.com\/article2\/0,2817,2464341,00.asp\">PC Magazine<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.gamespot.com\/articles\/microsoft-researching-cloud-gaming-solution-that-h\/1100-6421896\/\">GameSpot<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.theregister.co.uk\/2014\/08\/24\/microsoft_cloud_gaming_delorean_research\/\">The Register<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.pcworld.com\/article\/2597437\/delorean-tries-to-predict-your-next-move-could-reduce-lag-in-online-gaming.html\">PCWorld<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/gizmodo.com\/microsoft-delorean-kills-streaming-game-lag-by-predicti-1626006366?trending_test_two_e&utm_expid=66866090-68.hhyw_lmCRuCTCg0I2RHHtw.4&utm_referrer=http%3A%2F%2Fwww.bawakayi.com%2Fdavidchu%2F\">Gizmodo<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.slashgear.com\/microsofts-delorean-enables-cloud-gamings-alternate-timelines-23342512\/\">SlashGear<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/arstechnica.com\/gaming\/2014\/08\/how-microsofts-predictive-modeling-could-make-streaming-gaming-tolerable\/\" target=\"_blank\">Ars Technia<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" href=\"http:\/\/www.fool.com\/investing\/general\/2014\/08\/27\/should-sony-be-scared-of-microsofts-next-generatio.aspx\" target=\"_blank\">The Motley Fool<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Our goal is to enable mobile devices to deliver fully immersive and untethered mixed reality experiences. We investigate how to enable this experiences in battery-powered devices through leveraging resources available in either nearby edge devices or the cloud. Some of the challenges we study include latency hiding and bandwidth reduction on cloud streaming, pre-rendering and [&hellip;]<\/p>\n","protected":false},"featured_media":311936,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13547],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-236277","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-systems-and-networking","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2016-06-03","related-publications":[495011,466272,454794,311303,395840,238355,168447,168349],"related-downloads":[],"related-videos":[192326,273924,311147,366350,468180,495281],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[577674],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Eric Horvitz","user_id":32033,"people_section":"Group 1","alias":"horvitz"},{"type":"user_nicename","display_name":"Krishna Chintalapudi","user_id":32577,"people_section":"Group 1","alias":"krchinta"}],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/236277","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":7,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/236277\/revisions"}],"predecessor-version":[{"id":480441,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/236277\/revisions\/480441"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/311936"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=236277"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=236277"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=236277"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=236277"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=236277"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}