I am a Principal Researcher at MSR New York City. I also hold an (unpaid) Adjunct Associate Professor position at University of Maryland at College Park. Before joining MSR-NYC in 2013, I was a member of MSR Silicon Valley since 2007. I received my Ph.D. in Computer Science from Cornell University in 2006, advised by Jon Kleinberg.
Full publication list (with abstracts, by year and by topic).
My book, “Introduction multi-armed bandits” (to appear in 2019).
My research interests are in algorithms and theoretical computer science, spanning machine learning theory, algorithmic economics, and networks. Across various domains, I am drawn to algorithmic problems with informational constraints. I am particularly interested in online machine learning and exploration-exploitation tradeoff, and their manifestations in mechanism design and human computation. Much of my earlier research was on the analysis of Internet and social networks, metric embeddings, and distance/routing data structures. My work has been recognized with the best paper award at ACM EC 2010, best paper nomination at WWW 2015, and the best student paper award at ACM PODC 2005.
Relevant project pages at MSR
Real-world Reinforcement Learning
Multiworld Testing: a methodology and a system for contextual bandits.
Explore-exploit learning at MSR-NYC
Multi-armed bandits at MSR-SV (inactive since the closure of MSR-SV)
Former interns: Mahsa Derakhshan (2019), Karthik Abinav Sankararaman (2018), Jieming Mao (2018), Manish Raghavan (2017), Mathias Lecuyer (2017), Steven Wu (2015, 2016), Chien-Ju Ho (2013, 2014), Ashwinkumar Badanidiyuru (2012, 2013), Sigal Oren (2011), Shiri Chechik (2010), Yogeshwer Sharma (2008).