illustration of three people avatars connected on top of a computer on a green gradient background

Human-computer interaction

Redefining human experiences through innovations in research, design, and technology.

MicroCode: Portable programming for the BBC micro:bit

Microsoft at CHI 2024: Innovations in human-centered design

Microsoft Research Forum video on the Metacognitive Demands of Generative AI

Embodied AI Workshop at CVPR 2024

Current selections

Sort by: Most recent

Clear selections

Search within these results

Content Types

People

Abigail Sellen (248)

Andrew D. Wilson (177)

Ed Cutrell (171)

Sean Rintel (128)

Michel Pahud (102)

Siân Lindley (92)

Jaime Teevan (91)

Kori Inkpen (89)

Shamsi Iqbal (83)

Ivan Tashev (74)

John Tang (74)

Nathalie Henry Riche (74)

Advait Sarkar (72)

Richard Banks (71)

A.J. Brush (70)

Jacki O'Neill (64)

Cecily Morrison (58)

Eric Horvitz (57)

Ann Paradiso (55)

Anja Thieme (54)

Denae Ford (52)

Darren Edge (50)

Yun Wang (49)

Javier Hernandez (47)

Nicolas Villar (43)

Sasa Junuzovic (43)

Adam Fourney (42)

Lev Tankelevitch (41)

Sean Andrist (40)

Jianfeng Gao (38)

Sumit Gulwani (35)

Jennifer Wortman Vaughan (32)

Ryen W. White (32)

Kevin Larson (30)

Hannes Gamper (29)

Martin Grayson (28)

Scott Counts (27)

Judith Amores (27)

Haidong Zhang (25)

Jonathan "Peli" de Halleux (25)

Payod Panda (25)

Dongmei Zhang (24)

Ece Kamar (24)

Martez Mott (24)

Brian Houck (24)

Jack Williams (23)

Dan Bohus (22)

Swami Manohar (22)

Mihaela Vorvoreanu (22)

Kalika Bali (21)

Scott Saponas (21)

John Helmes (20)

Ken Woodberry (20)

Michael Levit (20)

Hanna Wallach (20)

Mohit Jain (20)

Brent Hecht (19)

Nicolai Marquardt (19)

Weiwei Cui (18)

Jenna Butler (18)

Yifan Gong (17)

Gustavo Soares (17)

Emre Kiciman (16)

Jake Hofman (16)

Antonio Criminisi (16)

Nancy Baym (15)

David Sweeney (15)

Michel Galley (15)

Mary L. Gray (15)

Siddharth Suri (15)

Vu Le (15)

David Johnston (14)

Daniel G. Goldstein (14)

Jinyu Li (14)

Nick Craswell (14)

Sonia Jaffe (14)

Badrish Chandramouli (13)

Chuck Needham (13)

Chris White (13)

Neel Joshi (13)

Sumit Basu (13)

Paul Thomas (13)

Randy Pagulayan (13)

Longqi Yang (13)

Arjun Radhakrishna (13)

Amanda K. Hall (13)

Millicent Ochieng (13)

Greg Smith (12)

Haiyan Zhang (12)

Katja Hofmann (12)

Amit Sharma (11)

Ashley Feniello (11)

Ben Zorn (11)

Dimitra Emmanouilidou (11)

Srihari Hulikal Muralidhar (11)

Anoop Gupta (10)

Chris Quirk (10)

Dave Brown (10)

Jaron Lanier (10)

Manik Varma (10)

Mark Encarnación (10)

Spencer Fowers (10)

Xing Xie (10)

Robert Sim (10)

Pat Sweeney (10)

Najeeb G. Abdulhamid (10)

Serena Hillman (10)

James Devine (10)

Christian Bird (9)

Chin-Yew Lin (9)

Darren Gehring (9)

Camilla Longden (9)

Nathan Evans (9)

Aaron L Halfaker (9)

Weiwei Yang (9)

Chenglong Wang (9)

Daniel Cletheroe (8)

Dan Marshall (8)

Hsiao-Wuen Hon (8)

Jonathan Lester (8)

Jonathan Larson (8)

Venkat Padmanabhan (8)

Pratik Ghosh (8)

Yuqing Yang (8)

Sameer Segal (8)

Chris Parnin (8)

Yasharth Bajpai (8)

Rita Faia Marques (8)

David Rothschild (7)

Gabe Cohn (7)

Lijuan Wang (7)

Henrique S. Malvar (7)

Ray Huang (7)

Bichlien Nguyen (7)

Solon Barocas (7)

Sunayana Sitaram (7)

Yu Shi (7)

Amber Hoak (7)

David Tittsworth (7)

Kate Lytvynets (7)

Sudha Rao (7)

Madeleine Daepp (7)

Hao Cheng (7)

Aditya Nori (6)

Gopal Srinivasa (6)

John Langford (6)

Nebojsa Jojic (6)

Nirupama Chandrasekaran (6)

Rick Rashid (6)

Robert Gruen (6)

Hannah Richardson (nee Murfet) (6)

Tobias Schnabel (6)

Akshay Nambi (6)

Ashish Tiwari (6)

Bahar Sarrafzadeh (6)

Samuel Chege Maina (6)

Andrzej Banburski-Fahey (6)

Haotian Li (6)

Andrew Blake (5)

Cha Zhang (5)

Johannes Gehrke (5)

Jeremiah (Miah) Wander (5)

Milad Shokouhi (5)

Nicole Immorlica (5)

Ran Gal (5)

Shi Han (5)

Sriram Rajamani (5)

ThuVan Pham (5)

Neil Toronto (5)

Shikhar Sharma (5)

Sujay Kumar Jauhar (5)

Hannes Schulz (5)

Sebastian Braun (5)

Nicholas Wilson (5)

Ashley J. Llorens (5)

Jennifer Wang (5)

Kate Nowak (5)

Christian Poelitz (5)

Anne Loomis Thompson (4)

Cormac Herley (4)

Gordon Bell (4)

John Winn (4)

Lars Liden (4)

Lili Cheng (4)

Marcus Peinado (4)

Margus Veanes (4)

Miro Dudík (4)

Thomas Moscibroda (4)

Nikunj Raghuvanshi (4)

Peter Lee (4)

Qiang Huo (4)

Silviu Cucerzan (4)

Stefan Saroiu (4)

Yordan Zaykov (4)

Zhitao Hou (4)

Chris Lovett (4)

Vaishnavi Ranganathan (4)

Stephanie Hyland (4)

Robert Gmyr (4)

Oscar Koller (4)

Joshua Elsdon (4)

Tanuja Ganu (4)

Xiubo Geng (4)

Mengting Wan (4)

Eirini Kalliamvakou (4)

Neha Parikh Shah (4)

Forough Poursabzi (4)

Xufang Luo (4)

Qianhui Wu (4)

Harsha Nori (4)

Thiago V. Spina (4)

Andrea Britto Mattos Lima (4)

Whitney Hudson (4)

Stephen Schneider (4)

Ade Famoti (4)

Emerson Murphy-Hill (4)

Ajay Manchepalli (3)

Anton Schwaighofer (3)

Arjmand Samuel (3)

Aviv Hurvitz (3)

Victor Bahl (3)

Baining Guo (3)

Bin Benjamin Zhu (3)

Chetan Bansal (3)

Arnd Christian König (3)

Daan Leijen (3)

Doug Burger (3)

Manish Gupta (3)

Rui Ding (3)

Karen Easterbrook (3)

Karin Strauss (3)

Madan Musuvathi (3)

Piali Choudhury (3)

Ricardo Gutierrez (3)

Sharad Agarwal (3)

Shuvendu Lahiri (3)

Suresh Parthasarathy (3)

Tony Carbary (3)

Yan Lu (3)

Laura Walker (3)

Chieh-Jan Mike Liang (3)

Budhaditya Deb (3)

Adam Atkinson (3)

Haoyu Dong (3)

Mahmoud Adada (3)

Nipun Kwatra (3)

Swadheen Shukla (3)

Carmen Badea (3)

Jeffrey Delmerico (3)

Yeyun Gong (3)

Shruthi Bannur (3)

Dongsheng Li (3)

Britta Burlin (3)

Daniel Coelho de Castro (3)

Johnny Johnson (3)

Harsh Vijay (3)

Ross Cutler (3)

Jennifer Neville (3)

Alex Lu (3)

Fernando Pérez-García (3)

Harshita Sharma (3)

Morris Sharp (3)

Corby Rosset (3)

Nan Chen (3)

Priyanshu Gupta (3)

Christopher O'Dowd (3)

Ashley Conard (3)

Kenza Bouzid (3)

Shraddha Barke (3)

Agathe Balayn (3)

Baolin Peng (3)

Hugo ROMAT (3)

Emily Tseng (3)

Akash Lal (2)

Andrey Kolobov (2)

Alec Wolman (2)

Butler Lampson (2)

Bodhi Priyantha (2)

Bozidar Radunovic (2)

Jonathan M. Carlson (2)

Christopher Bishop (2)

Christian Paquin (2)

Dany Rouhana (2)

Dinei Florencio (2)

Fan Yang (2)

Furu Wei (2)

Galen Hunt (2)

Jim Gray (2)

Gregory Lee (2)

John (JD) Douceur (2)

Kate Crawford (2)

Kenji Takeda (2)

Lei Fang (2)

Lev Nachmanson (2)

Jay Lorch (2)

Mike Shepperd (2)

Tom Minka (2)

Nikolaj Bjørner (2)

Nikhil Swamy (2)

Pallavi Choudhury (2)

Qiufeng Yin (2)

Qingwei Lin 林庆维 (2)

Ranveer Chandra (2)

Sebastian Burckhardt (2)

Siddhartha Sen (2)

Song Ge (2)

Rick Szeliski (2)

Tarleton Gillespie (2)

Thomas Karagiannis (2)

Vassily Lyutsarev (2)

Xiaodong Liu (2)

Yang Liu (2)

Yao Qian (2)

Yaobo Liang (2)

Jiaolong Yang (2)

Harsha Simhadri (2)

Woosuk Lee (2)

Pavel Myshkov (2)

Raluca Stevenson (2)

Scarlett Li (2)

Vibhav Vineet (2)

Michael Schwarz (2)

Hamed Khanpour (2)

Dave Bignell (2)

P. Anandan (2)

Ran Gilad-Bachrach (2)

Adam D. Troy (2)

Patrick Misteli (2)

Xenofon Foukas (2)

Kenichi Kumatani (2)

Tadas Baltrusaitis (2)

Juan M. Lavista Ferres (2)

Niranjani Prasad (2)

Melanie Fernandez Pradier (2)

Vanessa Rodrigues (2)

Clint Simon (2)

Mohamed Ahmed (2)

Saravan Rajmohan (2)

Yizhong Zhang (2)

Luna K. Qiu (2)

Jeevana Priya Inala (2)

Fangyun Wei (2)

Jiahang Xu (2)

Scott Freitas (2)

Gust Verbruggen (2)

Xin Jin (2)

Mukul Singh (2)

Sarah Fakhoury (2)

Andres Codas (2)

Saikat Chakraborty (2)

Shweti Mahajan (2)

Girmaw Abebe Tadesse (2)

Lohit Petikam (2)

Kavyansh Chourasia (2)

Mansi Khemka (2)

Ananya Singha (2)

Zilong Wang (2)

Rebecca Janssen (2)

Taketomo Isazawa (2)

Renyi Qu (2)

Lorenzo Jaime Flores (2)

Adrian Bonar (1)

Andrew Herbert (1)

Alvin Chen (1)

Ambrosio Blanco (1)

Josh Benaloh (1)

Brendan Lucier (1)

Chong Luo (1)

Cuiling Lan (1)

Dan Ling (1)

Dong Chen (1)

E. Glen Weyl (1)

Hitesh Ballani (1)

Hoifung Poon (1)

Íñigo Goiri (1)

Jianlong Fu (1)

John Snyder (1)

Jordan Dahl (1)

Kendall Martin (1)

Kukjin Lee (1)

Leslie Lamport (1)

Lei Cui (1)

Lidong Zhou (1)

Matthew Johnson (1)

Nan Yang (1)

Bo-June (Paul) Hsu (1)

Paul Koch (1)

Peng Cheng (1)

Patrick Longa (1)

Ray Bittner (1)

Reuben Olinsky (1)

Ricardo Bianchini (1)

Rich Draves (1)

Ron Paulsen (1)

Roy Levin (1)

Rick Rogahn (1)

Rui Gao (1)

Sameh Elnikety (1)

Santiago Zanella-Béguelin (1)

Shujie Liu (1)

Shuo Chen (1)

Sarah Bird (1)

Stephen Lin (1)

Surajit Chaudhuri (1)

Sam Webster (1)

Trevor Eberl (1)

Vivek Narasayya (1)

Weidong Cui (1)

Weizhu Chen (1)

Yan Huang (1)

Yan Xia (1)

Yu Liu (1)

Yongqiang Xiong (1)

Iris Shen (1)

Aseem Rastogi (1)

Lester Mackey (1)

Tahina Ramananandro (1)

Vageesh D C (1)

Yiyong Lin (1)

Matthias Troyer (1)

Darrin Eide (1)

Bryan Tower (1)

Jacob Alber (1)

Chinmay Singh (1)

Qi Chen (1)

Sida Peng (1)

Irene Zhang (1)

Xiao Lv (1)

Xingdi Yuan (1)

Marc-Alexandre Côté (1)

Geoff Cox (1)

Dan R. K. Ports (1)

Karthik Ramachandra (1)

Yang Ou (1)

Andromachi Chatzieleftheriou (1)

Bo Qiao (1)

Boris Köpf (1)

Andrew Paverd (1)

Dr Kiran Muthabatulla (1)

Tal Zaccai (1)

Deanne Adams (1)

JJ Guajardo (1)

Chris LeFeaver (1)

Silvano Galliani (1)

Lukas Wutschitz (1)

David Alvarez-Melis (1)

Denny Sun (1)

Bei Liu (1)

Rangan Majumder (1)

Shruti Tople (1)

Kevin Kaichuang Yang (1)

Kevin Moynihan (1)

Mike Walker (1)

Danny Simmons (1)

Carolyn Buractaon (1)

James Bono (1)

Brian Caswell (1)

Yiwen Zhu (1)

Ben Van Durme (1)

Caleb Robinson (1)

Matej Ciesko (1)

Donald Ngwe (1)

Yoganand Rajasekaran (1)

Linjie Li (1)

Anthony Ortiz (1)

Ida Momennejad (1)

Anna Pavlenko (1)

Joyce Cahoon (1)

Jingwen Lu (1)

Brian Kroth (1)

Ran Jia (1)

Josh Mandel (1)

Dean Carignan (1)

Paulo Salem (1)

Sunit Sivasankaran (1)

Iker Llorens (1)

Jonathan McLean (1)

Luis França (1)

Esha Choukse (1)

Ava P. Amini (1)

Gabriela Martinez Sanchez (1)

Daniel Madrigal (1)

Mirian Hipolito Garcia (1)

Mario Gini (1)

Jason (Zengzhong) Li (1)

James Brand (1)

Tengchao Lv (1)

Prof. Darren Cosker (1)

Shiqi Jiang (1)

Jesús Camacho-Rodríguez (1)

Yifan Xiong (1)

Hope Twede (1)

Sara Malvar (1)

Leonardo Nunes (1)

Xiaoyuan Yi (1)

Shengyu Fu (1)

Yufan Huang (1)

Gaurav Mittal (1)

Jake Smith (1)

Jayashree Mohan (1)

Robert Osazuwa Ness (1)

Victor Ruehle (1)

Harish Doraiswamy (1)

Maximilian Ilse (1)

Chang Xu (1)

Mayukh Das (1)

Tommy Guy (1)

Jue Zhang (1)

Minghua Ma (1)

Srinivasan Iyengar (1)

Arnaud Flutre (1)

A J (HE/HIM) (1)

Michal Sroka (1)

Kali Frost (1)

Alejandro Gutierrez Munoz (1)

Allie Giddings (1)

Darren Tanner (1)

Giovanni Cherubin (1)

Rogerio Bonatti (1)

Fangkai Yang (1)

Liang Wang (1)

Yangyu Huang (1)

Shideh Rezaeifar (1)

Jinu Jang (1)

Xiaoyu Liu (1)

Spandan Garg (1)

Yuge Zhang (1)

Shuo Zhang (1)

Sarah Hanses (1)

Bonnie Kruft (1)

Matheus R. F. Mendonça (1)

Menglin Xia (1)

Michael Xu (1)

Si Qin (1)

Tara Safavi (1)

Xuchao Zhang (1)

Dayenne Souza (1)

Reshma Ramaprasad (1)

Hosein Hasanbeig (1)

Bruno Silva (1)

Zinan Lin (1)

Abhinav Jangda (1)

Sergio Valcarcel Macua (1)

Jonathan Mace (1)

Rujia Wang (1)

Gabriel Ebner (1)

Sarah Smith (1)

Weijia Xu (1)

Chaojie Zhang (1)

Sharon Koubi (1)

Pashmina Cameron (1)

Guido Martínez (1)

Xiaoting Qin (1)

Aashaka Shah (1)

Sicheng Xu (1)

Angelica Moreira (1)

Ha Trinh (1)

Newman Cheng (1)

Jennifer Marsman (1)

Sarah Alamdari (1)

Matthew Vogel (1)

Darya Moldavskaya (1)

Pei Zhou (1)

Ashish Sharma (1)

Carles Domingo-Enrich (1)

Sihao Chen (1)

Kiran Tomlinson (1)

Mohammad Alqudah (1)

Benjamin Steenhoek (1)

Yasuyuki Matsushita (1)

Jessica Young (1)

Ogbemi Ekwejunor-Etchie (1)

Hamna . (1)

Satarupa Guha (1)

Gabriel Ryan (1)

Yu Hu (1)

Gaurav Verma (1)

Cassiano Becker (1)

Simra Shahid (1)

Gordon Broadbent (1)

Emily Bao (1)

Fatemeh Saleh (1)

William Chappell (1)

Travis Lowdermilk (1)

Jianwei Yu (1)

Shiyun Xu (1)

Sheshera Mysore (1)

Avik Dutta (1)

Hannah Cha (1)

Maia Stiber (1)

Agrima Seth (1)

Evgeniy Gabrilovich (1)

Rosa Zhou (1)

Published Date

Publication

VisEval: A Benchmark for Data Visualization in the Era of Large Language Models

Nan Chen, Yuge Zhang, Jiahang Xu, Kan Ren, Yuqing Yang

IEEE Transactions on Visualization and Computer Graphics | July 2024, Vol PP

Best paper

VIS2024

Github

Publication

The CoExplorer Technology Probe: A Generative AI-Powered Adaptive Interface to Support Intentionality in Planning and Running Video Meetings

Gun Woo (Warren) Park, Payod Panda, Lev Tankelevitch, Sean Rintel

DIS 2024 | July 2024

Project Project

Microsoft Research Blog

Research Focus: Week of June 24, 2024

June 26, 2024 | Xenofon Foukas, Bozidar Radunovic, Francis Y. Yan, Lev Tankelevitch, Sean Rintel, Sudha Rao, Chris Brockett, Bill Dolan, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Anton Schwaighofer, Sam Bond-Taylor, Max Ilse, Fernando Pérez-García, Valentina Salvatelli, Harshita Sharma, Julia Gong, Anja Thieme, Matthew Lungren, Javier Alvarez-Valle, Stephanie Hyland, Payod Panda

In this issue: RENC makes 5G vRAN servers more energy efficient; CoExplorer uses AI to keep video meetings on track; Automatic bug detection in LLM-powered text-based games; MAIRA-2: Grounded radiology report generation.

Publication

Evolving Roles and Workflows of Creative Practitioners in the Age of Generative AI

Srishti Palani, Gonzalo Ramos

Creativity and Cognition | June 2024

Project

Microsoft Research Blog

MicroCode: Portable programming for the BBC micro:bit

June 18, 2024 | Eric Anderson, Thomas Ball, Peli de Halleux, James Devine, Michal Moskal

MicroCode offers an affordable way to program the BBC micro:bit without needing an internet connection, fostering exploratory learning.

Event

Embodied AI Workshop at CVPR 2024

June 18, 2024 | Seattle, Washington

The Embodied AI 2024 workshop will be held in conjunction with CVPR 2024 in Seattle, Washington. The overarching theme of this year’s workshop is Open World Embodied AI: Being an embodied agent in a world…

Publication

Explaining CLIP’s performance disparities on data from blind/low vision users

Daniela Massiceti, Camilla Longden, Agnieszka Slowik, Samuel Wills, Martin Grayson, Cecily Morrison

2024 Computer Vision and Pattern Recognition | June 2024

Video Video Project

Publication

Meet MicroCode: a Live and Portable Programming Tool for the BBC micro:bit

Kobi Hartley, Elisa Rubegni, Lorraine Underwood, Joe Finney, Thomas Ball, Steve Hodges, Eric Anderson, Jonathan "Peli" de Halleux, James Devine, Michal Moskal

23rd annual ACM Interaction Design and Children (IDC) Conference | June 2024

Github

Event

Inclusive Digital Maker Futures Workshop

June 16, 2024 | Delft, Netherlands

Host conference: 23rd ACM Interaction Design and Children Conference (opens in new tab) June 17-20, 2024 This workshop will bring together researchers and educators to imagine a future of low-cost, widely available digital making for children,…

Tool

MicroCode

Microsoft MicroCode is an icon-based programming language and editor for young learners to code with the BBC micro:bit V2. MicroCode allows you to program the micro:bit V2 with only an Arcade shield accessory – no…

GitHub Project

Human-computer interaction

Highlights