Design Expo 2016

Design Expo 2016


2016 Design Challenge:
Achieving Symbiosis and the Conversational User Interface (CUI)


Watch the Full video of Design Expo 2016 or view individual videos per school in the Participating Schools and Liaisons section.

The hope is that, in not too many years, human brains and computing machines will be coupled together very tightly, and that the resulting partnership will think as no human brain has ever thought and process data in a way not approached by the information-handling machines we know today.
— J.C.R. Licklider, Man-Computing Symbiosis, 1960

Move ahead an astonishing 55 years. Licklider’s prerequisites (and more) exist for Symbiosis. A plethora of chatty bots are offering to do things for us in our messaging experiences. A series of personal agent services have emerged that leverage machines, humans or both to complete tasks for us (, Clara Labs, Fancy Hands, Task Rabbit, Facebook “M” to name a few) — the commanding interface is email, text or a voice call. WeChat is perhaps the most stunning example of the power of chat-driven UI to date, providing indispensable value to users through millions of verified services in an all-in-one system that allows you to do everything from grabbing a taxi, to paying the electric bill or sending money to a friend. Offerings such as Siri, Google Now and Cortana are also demonstrating value to millions of people, particularly on mobile form factors, where the conversational user interface (CUI) is often superior to the GUI. Clearly, the value of the CUI is not found simply in ‘speech’.

The CUI is more than just synthesized speech; it is an intelligent interface. It’s intelligent because it combines these voice technologies with natural-language understanding of the intention behind those spoken words, not just recognizing the words as a text transcription. The rest of the intelligence comes from contextual awareness (who said what, when and where), perceptive listening (automatically waking up when you speak) and artificial intelligence reasoning.
— Ron Kaplan, Beyond the GUI: it’s Time for a Conversational User Interface, Wired Magazine, March 2013

While in complete agreement with Kaplan’s statement — made a mere two years ago — it is the combination of the CUI, adaptive/learning sensor technologies, a rich personal profile, increasingly pervasive user agents and service bots (powered by machines, humans or both), as well as the ability to fluidly transact, that will enable the most fluid, powerful, and human computing experiences spanning digital and physical environments and form factors that we have ever before been able to design, and build, and from which we will all benefit. 2015 seems poised to be “The Year of the Conversational Bot” but we are still just scratching the surface of the Symbiosis Promise.


The Goal

Design a product, service or solution that demonstrates the value and differentiation of the CUI. Your creation should demonstrate the best qualities of a symbiotic human-computer experience which features an interface designed to interpret human language and intent. Of course, language takes many forms – from speech, to text, to gesture, body language, and even thought. Your creation should clearly demonstrate foundational elements the CUI calls upon in order to delight people. It should meet a clear need and be extensible to wider applications. It may be near-term practical or blue sky, but the idea must be innovative, technically feasible, and have a realistic chance of adoption if instantiated. Of course, to deliver an optimal experience, much is implied – from data and identity permissions to cross-app agent and/or bot cooperation and coordination (first and third party); your design should minimally show awareness of these barriers or explore solutions to them.

Participating Schools and Liaisons

ArtCenter College of Design, Graduate Media Design Practices; Los Angeles, USA
Project: Trans-Actor: A UX for AI
Professors: Philip van Allen, Anne Burdick
Students: Lee Cody, Xing Lu, Sche-I Wang
Microsoft Liaisons: Colleen Estrada, Shane Landry
Course website:
View presentation

Carnegie Mellon University, School of Design; Pittsburgh, USA
Project: Opus: Connecting Parents and Children with the Power of Story
Professors: Bruce Hanington, Peter Scupelli
Students: Sarah Foley, Jiyoung Ko, Dixon Lo
Microsoft Liaisons: Kevin Korpi, Irina Smolyanskaya
Course website:
View presentation

New York University, ITP; New York, USA
Project: Warren: A Friendly Guide and Manager for Freelancers
Professors: Michael Dory, Dan O’Sullivan
Students: Lirong Liu, Peiyu Luo, Jiashan Wu, Fengyuan Zhu
Microsoft Liaison: Lili Cheng, Cindy Wong
View presentation

Savannah College of Art and Design; Savannah, USA
Project: Co: The Story Building Companion
Professors: Cyril Guichard, Mauricio Manhaes
Students: Scott Brown, Maya Chatila, Ashley Gilliam, Andrew Lee
Microsoft Liaison: Michael Gough
View presentation

Umea University; Umea, Sweden
Project: Personalized Nutrition
Professors: Monica Lindh-Karlsson, Stoffel Kuenen
Students: Andre Kennedy, Yuanrui Li, Joanna Pruchnicka, Lene Rydningen
Microsoft Liaisons: Soramist Chintanamanus, Don Coyner, Annika Ushio
View presentation

University of California Los Angeles, Design Media Arts; Los Angeles, USA
Project: Murmur: Generative Drawing with Speech
Professors: Christian Moeller
Students: Adam Ferriss
Microsoft Liaisons: Jiwon Choi, Sara Siritaratiwat, Moni Wolf
View presentation

University of Dundee; Dundee, UK
Project: Otto: Communication Aid for Autistic Children
Professors: Andrea Alessandrini, Graham Pullin, Martin Skelly
Students: Jena Affleck, Sean Gooravin, Cameron Malcolm, Sarah Mchutchison, Andrew Shearer, Cameron Watt
Microsoft Liaisons: Richard Banks, Helene Steiner
View presentation

University of Southern California, School of Cinematic Arts; Los Angeles, USA
Project: B.U.D.D.Y.: Best Unique Device Dedicated to You
Professors: Scott Fischer, Jennifer Stein
Students: Roseli de Jesus, Anya Kolesnikoff, Max Kreminski
Microsoft Liaisons: Vikram Bapat, Greg Melander
Course website: Design Fiction and Speculative Futures
View presentation

University of Washington, Interaction Design Program; Seattle, USA
Project: Polly
Professor: Axel Roesler
Students: Rishi Agarwal, Stephen Coyner, Angelica Cupat, Naoki Hisamoto, Chloe Lee
Microsoft Liaisons: Nathan Auer, March Rogers, Gino Scarpino
View presentation




Awards and Wrap-up Party