Design Expo 2016

Design Expo 2016

Challenge

2016 Design Challenge:
Achieving Symbiosis and the Conversational User Interface (CUI)

 

Watch the Full video of Design Expo 2016 or view individual videos per school in the Participating Schools and Liaisons section.

The hope is that, in not too many years, human brains and computing machines will be coupled together very tightly, and that the resulting partnership will think as no human brain has ever thought and process data in a way not approached by the information-handling machines we know today.
— J.C.R. Licklider, Man-Computing Symbiosis, 1960

Move ahead an astonishing 55 years. Licklider’s prerequisites (and more) exist for Symbiosis. A plethora of chatty bots are offering to do things for us in our messaging experiences. A series of personal agent services have emerged that leverage machines, humans or both to complete tasks for us (x.ai, Clara Labs, Fancy Hands, Task Rabbit, Facebook “M” to name a few) — the commanding interface is email, text or a voice call. WeChat is perhaps the most stunning example of the power of chat-driven UI to date, providing indispensable value to users through millions of verified services in an all-in-one system that allows you to do everything from grabbing a taxi, to paying the electric bill or sending money to a friend. Offerings such as Siri, Google Now and Cortana are also demonstrating value to millions of people, particularly on mobile form factors, where the conversational user interface (CUI) is often superior to the GUI. Clearly, the value of the CUI is not found simply in ‘speech’.

The CUI is more than just synthesized speech; it is an intelligent interface. It’s intelligent because it combines these voice technologies with natural-language understanding of the intention behind those spoken words, not just recognizing the words as a text transcription. The rest of the intelligence comes from contextual awareness (who said what, when and where), perceptive listening (automatically waking up when you speak) and artificial intelligence reasoning.
— Ron Kaplan, Beyond the GUI: it’s Time for a Conversational User Interface, Wired Magazine, March 2013

While in complete agreement with Kaplan’s statement — made a mere two years ago — it is the combination of the CUI, adaptive/learning sensor technologies, a rich personal profile, increasingly pervasive user agents and service bots (powered by machines, humans or both), as well as the ability to fluidly transact, that will enable the most fluid, powerful, and human computing experiences spanning digital and physical environments and form factors that we have ever before been able to design, and build, and from which we will all benefit. 2015 seems poised to be “The Year of the Conversational Bot” but we are still just scratching the surface of the Symbiosis Promise.

 


The Goal

Design a product, service or solution that demonstrates the value and differentiation of the CUI. Your creation should demonstrate the best qualities of a symbiotic human-computer experience which features an interface designed to interpret human language and intent. Of course, language takes many forms – from speech, to text, to gesture, body language, and even thought. Your creation should clearly demonstrate foundational elements the CUI calls upon in order to delight people. It should meet a clear need and be extensible to wider applications. It may be near-term practical or blue sky, but the idea must be innovative, technically feasible, and have a realistic chance of adoption if instantiated. Of course, to deliver an optimal experience, much is implied – from data and identity permissions to cross-app agent and/or bot cooperation and coordination (first and third party); your design should minimally show awareness of these barriers or explore solutions to them.

Participating Schools and Liaisons

ArtCenter College of Design, Graduate Media Design Practices; Los Angeles, USA
Project: Trans-Actor: A UX for AI
Professors: Philip van Allen, Anne Burdick
Students: Lee Cody, Xing Lu, Sche-I Wang
Microsoft Liaisons: Colleen Estrada, Shane Landry
Course website: http://mediadesignpractices.net
View presentation

Carnegie Mellon University, School of Design; Pittsburgh, USA
Project: Opus: Connecting Parents and Children with the Power of Story
Professors: Bruce Hanington, Peter Scupelli
Students: Sarah Foley, Jiyoung Ko, Dixon Lo
Microsoft Liaisons: Kevin Korpi, Irina Smolyanskaya
Course website: https://graduatedesignstudio2.wordpress.com
View presentation

New York University, ITP; New York, USA
Project: Warren: A Friendly Guide and Manager for Freelancers
Professors: Michael Dory, Dan O’Sullivan
Students: Lirong Liu, Peiyu Luo, Jiashan Wu, Fengyuan Zhu
Microsoft Liaison: Lili Cheng, Cindy Wong
View presentation

Savannah College of Art and Design; Savannah, USA
Project: Co: The Story Building Companion
Professors: Cyril Guichard, Mauricio Manhaes
Students: Scott Brown, Maya Chatila, Ashley Gilliam, Andrew Lee
Microsoft Liaison: Michael Gough
View presentation

Umea University; Umea, Sweden
Project: Personalized Nutrition
Professors: Monica Lindh-Karlsson, Stoffel Kuenen
Students: Andre Kennedy, Yuanrui Li, Joanna Pruchnicka, Lene Rydningen
Microsoft Liaisons: Soramist Chintanamanus, Don Coyner, Annika Ushio
View presentation

University of California Los Angeles, Design Media Arts; Los Angeles, USA
Project: Murmur: Generative Drawing with Speech
Professors: Christian Moeller
Students: Adam Ferriss
Microsoft Liaisons: Jiwon Choi, Sara Siritaratiwat, Moni Wolf
View presentation

University of Dundee; Dundee, UK
Project: Otto: Communication Aid for Autistic Children
Professors: Andrea Alessandrini, Graham Pullin, Martin Skelly
Students: Jena Affleck, Sean Gooravin, Cameron Malcolm, Sarah Mchutchison, Andrew Shearer, Cameron Watt
Microsoft Liaisons: Richard Banks, Helene Steiner
View presentation

University of Southern California, School of Cinematic Arts; Los Angeles, USA
Project: B.U.D.D.Y.: Best Unique Device Dedicated to You
Professors: Scott Fischer, Jennifer Stein
Students: Roseli de Jesus, Anya Kolesnikoff, Max Kreminski
Microsoft Liaisons: Vikram Bapat, Greg Melander
Course website: Design Fiction and Speculative Futures
View presentation

University of Washington, Interaction Design Program; Seattle, USA
Project: Polly
Professor: Axel Roesler
Students: Rishi Agarwal, Stephen Coyner, Angelica Cupat, Naoki Hisamoto, Chloe Lee
Microsoft Liaisons: Nathan Auer, March Rogers, Gino Scarpino
View presentation

Photos

Presentations

 


Awards and Wrap-up Party

Videos

Link description

Microsoft Design Expo 2016: New York University

Date

July 13, 2016

Speakers

Rob Girling, Cliff Kuang, Lisa Strausfeld, Bill Buxton, Fengyuan Zhu, Jiashan Wu, Lirong Liu, Peiyu Luo

Affiliation

Artefact, Fast Company, Information Art, Microsoft, New York University

Link description

Microsoft Design Expo 2016: Carnegie Mellon University

Date

July 13, 2016

Speakers

Rob Girling, Cliff Kuang, Lisa Strausfeld, Bill Buxton, Dixon Lo, Jiyoung Ko, Sarah Foley

Affiliation

Artefact, Fast Company, Information Art, Microsoft, Carnegie Mellon University

Link description

Microsoft Design Expo 2016: ArtCenter College of Design

Date

July 13, 2016

Speakers

Rob Girling, Cliff Kuang, Lisa Strausfeld, Bill Buxton, Lee Cody, Sche-I Wang, Xing Lu

Affiliation

Artefact, Fast Company, Information Art, Microsoft, ArtCenter College of Design

Link description

Microsoft Design Expo 2016

Date

July 13, 2016

Speakers

Rob Girling, Cliff Kuang, Lisa Strausfeld, Bill Buxton, Lee Cody, Sche-I Wang, Xing Lu, Dixon Lo, Jiyoung Ko, Sarah Foley, Fengyuan Zhu, Jiashan Wu, Lirong Liu, Peiyu Luo, Andrew Lee, Ashley Gilliam, Maya Chatila, Scott Brown, Andre Kennedy, Joanna Pruchnicka, Lene Rydningen , Yuanrui Li, Adam Ferriss, Andrew Shearer, Cameron Watt, Cameron Malcolm, Jena Affleck, Sarah Mchutchison, Sean Gooravin, Anya Kolesnikoff, Max Kreminski, Roseli de Jesus, Angelica Cupat, Chloe Lee, Naoki Hisamoto, Rishi Agarwal, Stephen Coyner

Affiliation

Artefact, Fast Company, Information Art, Microsoft, , ArtCenter College of Design, ArtCenter College of Design, ArtCenter College of Design, Carnegie Mellon University, Carnegie Mellon University, Carnegie Mellon University, New York University, New York University, New York University, New York University, Savannah College of Art and Design, Savannah College of Art and Design, Savannah College of Art and Design, Savannah College of Art and Design, Umea Institute of Design, Umea Institute of Design, Umea Institute of Design, Umea Institute of Design, University of California, Los Angeles, University of Dundee, University of Dundee, University of Dundee, University of Dundee, University of Dundee, University of Dundee, University of Southern California, University of Southern California, University of Southern California, University of Washington, University of Washington, University of Washington, University of Washington, University of Washington

Link description

Microsoft Design Expo 2016: University of Southern California

Date

July 13, 2016

Speakers

Rob Girling, Cliff Kuang, Lisa Strausfeld, Bill Buxton, Anya Kolesnikoff, Max Kreminski, Roseli de Jesus

Affiliation

Artefact, Fast Company, Information Art, Microsoft, University of Southern California

Link description

Microsoft Design Expo 2016: University of Washington

Date

July 13, 2016

Speakers

Rob Girling, Cliff Kuang, Lisa Strausfeld, Bill Buxton, Angelica Cupat, Chloe Lee, Naoki Hisamoto, Rishi Agarwal, Stephen Coyner

Affiliation

Artefact, Fast Company, Information Art, Microsoft, University of Washington

Link description

Microsoft Design Expo 2016: University of Dundee

Date

July 13, 2016

Speakers

Rob Girling, Cliff Kuang, Lisa Strausfeld, Bill Buxton, Andrew Shearer, Cameron Watt, Cameron Malcolm, Jena Affleck, Sarah Mchutchison, Sean Gooravin

Affiliation

Rob Girling, Cliff Kuang, Lisa Strausfeld, Bill Buxton, Andrew Shearer, Cameron Watt, Cameron Malcolm, Jena Affleck, Sarah Mchutchison, Sean Gooravin Artefact, Fast Company, Information Art, Microsoft, University of Dundee

Link description

Microsoft Design Expo 2016: Umea Institute of Design

Date

July 13, 2016

Speakers

Rob Girling, Cliff Kuang, Lisa Strausfeld, Bill Buxton, Andre Kennedy, Joanna Pruchnicka, Lene Rydningen , Yuanrui Li

Affiliation

Artefact, Fast Company, Information Art, Microsoft, Umea Institute of Design

Link description

Microsoft Design Expo 2016: Savannah College of Art and Design

Date

July 13, 2016

Speakers

Rob Girling, Cliff Kuang, Lisa Strausfeld, Bill Buxton, Andrew Lee, Ashley Gilliam, Maya Chatila, Scott Brown

Affiliation

Artefact, Fast Company, Information Art, Microsoft, Savannah College of Art and Design