About

I am not maintaining this page. See https://www.johnkrumm.net/ for updated information about me.

John Krumm is a researcher at Microsoft Research in Redmond, WA, USA (Microsoft's headquarters). He works in the Adaptive Systems & Interaction Group on techniques for measuring a person's location and for using location data in a way that benefits the user.

John graduated from Carnegie Mellon University in 1993 with a PhD in robotics and a thesis on texture analysis in images. He worked at the Robotics Center of Sandia National Laboratories in Albuquerque, New Mexico for the next four years. His main projects there were computer vision for object recognition for use in robots and vehicles. He has been at Microsoft Research in Redmond, Washington, USA since 1997, and is currently a principal researcher. His research focuses on understanding peoples' location and how to use that information to benefit the user. He holds 55 U.S. patents. Dr. Krumm was a PC chair for UbiComp 2007, ACM SIGSPATIAL 2013, and ACM SIGSPATIAL 2014, served on the editorial board of IEEE Pervasive Computing Magazine and as a coeditor in chief for the Journal of Location Based Services. He currently serves on the editorial board of the Journal of Location Based Services and as an associate editor for ACM Transactions on Spatial Algorithms and Systems.

Projects

Contextually Intelligent Assistants

A truly intelligent virtual assistant could make many new functions possible. As we envision this agent, it would have the capabilities to: Understand your world, Leverage context to inform its actions, Interact with you naturally and effectively. The Contextually Intelligent Assistants project makes progress toward the type of contextual intelligence needed for next-generation assistants.  It does this by improving the state-of-the-art in understanding task intent from task descriptions; modeling key contextual signals, such as location…

Spatial Crowdsourcing

Established: January 28, 2014

We are studying how we can get regular people to do simple tasks at specific locations. An example task is to take a picture of a sign at a certain location. We are interested in who to ask and how much to pay. This is part of a Microsoft Research study about how we can get regular people to do simple tasks at specific locations. This offer is only valid for people who have received…

PreHeat: Controlling Home Heating With Occupancy Prediction

Established: March 2, 2011

Home heating uses more energy than any other residential energy expenditure, making increasing the efficiency of home heating an important goal for saving money and protecting the environment. We have built a home-heating system, PreHeat, that automatically programs your thermostat based on when you are home. PreHeat’s goal is to reduce the amount of time a household’s thermostat needs to be on without compromising the comfort of household members. PreHeat System PreHeat builds a predictive…

Test Images for Wallflower Paper

Established: September 1, 1999

This page contains the test images that we used for our Wallflower paper. We tested several different background maintenance algorithms on seven different image sequences. For each test image in the sequence, the output of the algorithm was an image segmented into background and foreground pixels. Each of the seven different test sequences represents a different, potentially problematic scenario for background maintenance. In general we used the first 100 images in each sequence for training. We…

Publications

2017

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

1996

1995

1994

1993

1992

1991

1990

Projects

Downloads

MSR GPS Privacy Dataset 2009

March 2017

The table below contains pointers to text files with GPS data taken in the region of Seattle, Washington USA. Each file contains data from one of 21 volunteers who carried a GPS logger with them for approximately eight weeks in the fall of 2009. This set of 21 volunteers is a subset of 37 people…

    Click the icon to access this download

  • Website

Test Images for Wallflower Paper

February 2017

These are test images for developing and evaluating background subtraction for computer vision. There are seven sequences of images, and each sequence comes from a video.

    Click the icon to access this download

  • Website

Other

Professional Activities

Ongoing

  • Associate Editor, ACM Transactions on Spatial Algorithms and Systems (ACM TSAS)
  • Editorial Board, Journal of Location Based Services (JLBS)
  • All seeing, all knowing, master of time, space, and dimension

2017

  • Social Media Chair – 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2017)

2016

  • Senior PC – 24th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL 2015)
  • PC Chair – Workshop on Mobile Entity Localization, Tracking, and Analysis (MELT 2016)

2015

  • Keynote Talk – 1st IEEE GLOBECOM Workshop on Localization for Indoors, Outdoors, and Emerging Networks (LION 2015)
  • Keynote Talk – 6th ACM SIGSPATIAL International Workshop on Geostreaming (IWGS 2015)
  • Keynote Talk – 4th ACM SIGSPATIAL International Workshop on Analytics for Big Geospatial Data (BigSpatial 2015)
  • PhD Committee – Scalable Predictive Query Processing for Moving Objects, Abdeltawab Hendawi, Department of Computer Science and Engineering, University of Minnesota
  • Senior PC – 23rd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL 2015)

2014

  • Co-Editor in Chief – Journal of Location Based Services, 2012 – 2014
  • Program Committee Co-Chair – 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL 2014)
  • PhD Committee – Event Analytics on Social Media: Challenges and Solutions, Yuheng Hu, Department of Computer Science and Engineering, Arizona State Univeristy
  • PhD Committee – Sensing and Navigation of Public Transportation Systems, James Biagioni, Computer Science, University of Illinois at Chicago
  • PhD Committee – Modeling Mobile User Behavior for Anomaly Detection, Senaka Buthpitiya, Department of Electrical and Computer Engineering, Carnegie Mellon University

2013

  • Keynote Talk – IEEE International Conference on Cybernetics (Cybconf 2013)
  • Program Committee Co-Chair – 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL GIS 2013)

2012

  • PhD Committee – A Self-Supervised Machine Learning Framework for Augmenting Cartographic Resources, Young-Woo Seo, Robotics Institute, Carnegie Mellon University
  • Program Committee – 20th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL GIS 2012)
  • Co-Organizer – Programming contest for 2012 ACM SIGSPATIAL GIS Conference (ACM SIGSPATIAL Cup 2012)
  • Program Committee – 10th International Conference on Pervasive Computing (Pervasive 2012)

2011

  • PhD Committee – Planning for Effective Environmental Coverage, Ling Xu, Robotics Institute, Carnegie Mellon University
  • Program Committee – 13th International Conference on Ubiquitous Computing (UbiComp 2011)
  • Program Committee – 9th International Conference on Pervasive Computing (Pervasive 2011)
  • Program Committee – IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS 2011)
  • Program Committee – 3rd International Conference on Automotive User Interfaces and Interactive Vehicular Appliations (AutomotiveUI 2011)
  • Keynote Talk – 8th IEEE International Workshop on Managing Ubiquitous Communications and Services (MUCS 2011)

2010

2009

  • Editorial Board – IEEE Pervasive Computing Magazine (link) (2006-2009)
  • Local Arrangements – 17th International Conference on Advances in Geographic Information Systems (ACM GIS 2009)
  • Program Committee – Eleventh International Conference on Ubiquitous Computing (UbiComp 2009)
  • Program Committee – Fourth International Symposium on Location and Context Awareness (LoCA 2009)
  • Program Committee – First International Forum on the Application and Management of Personal Electronic Information (Engaging Data 2009)
  • Program Committee – First International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2009)

2008

  • ieee_pvc_ugcPhD Examiner – Ontological Reasoning about Location for Indoor Pervasive Computing Environments, William Tse-Yun Niu, School of Information Technologies, University of Sydney
  • Program Committee – Tenth International Conference on Ubiquitous Computing (UbiComp 2008)
  • Program Committee – Sixth International Conference on Pervasive Computing (Pervasive 2008)
  • Tutorials Co-Chair – Sixth International Conference on Pervasive Computing (Pervasive 2008)
  • Lead Guest Editor – “User-Generated Content”, IEEE Pervasive Computing Magazine (link)
  • Program Committee – Second International Workshop on Intelligent Vehicle Control Systems (IVCS 2008)

2007

  • Program Co-Chair – Ninth International Conference on Ubiquitous Computing (UbiComp 2007)
  • Tutorials Co-Chair – Fifth International Conference on Pervasive Computing (Pervasive 2007)
  • Program Committee – Fifth International Conference on Pervasive Computing (Pervasive 2007)
  • Program Committee – International Workshop on Privacy-Aware Location-based Mobile Services (PALMS-07)
  • Program Committee – Third International Symposium on Location- and Context-Awareness (LoCA 2007)
  • Program Committee – Second Workshop on Artificial Intelligence Techniques for Ambient Intelligence (AITAmI 2007)

2006

  • Program Committee – Eighth International Conference on Ubiquitous Computing (UbiComp 2006)
  • Workshops Co-Chair – Eighth International Conference on Ubiquitous Computing (UbiComp 2006)
  • Program Co-Chair – Second International Workshop on Location- and Context-Awareness (LoCA 2006)
  • Program Committee – Fourth International Conference on Pervasive Computing (Pervasive 2006)

2005

  • Program Committee – Third ACM International Workshop on Wireless Mobile Applications and Services on WLAN Hotspots (WMASH 2005)
  • Program Committee – Seventh International Conference on Ubiquitous Computing (UbiComp 2005)
  • Program Committee – First International Workshop on Location- and Context-Awareness (LoCA 2005)
  • Program Committee – Third International Conference on Pervasive Computing (Pervasive 2005)

2004

  • Program Committee – 2004 Workshop on Location-Aware Computing (UbiLoc 2004)
  • Invited Speaker – Fourth Digital Human Research Center Workshop (DHRC 2004)
  • Invited Speaker – Second International Workshop on Man-Machine Symbiotic Systems (IWMMS 2004)
  • Program Committee – Second ACM International Workshop on Wireless Mobile Applications and Services on WLAN Hotspots (WMASH 2004)

2003 and earlier

  • Co-Organizer – 2003 Workshop on Location-Aware Computing (UbiLoc 2003)
  • Co-Organizer – 2003 IEEE Workshop on Multi-Object Tracking (WOMOT 2003)
  • Co-Organizer – 2001 IEEE Workshop on Multi-Object Tracking (WOMOT 2001)

Patents (newest to oldest)

Number Date Title
9,443,326 September 13, 2016 Semantic Place Labels
9,176,485 November 11, 2015 Occupancy Prediction Using Historical Occupancy Patterns
9,163,952 October 20, 2015 Suggestive Mapping
9,134,137 September 15, 2015 Mobile search based on predicted location
9,086,292 July 21, 2015 Routing, alerting, and transportation guidance based on preferences and learned or inferred risks and desirabilities
8,874,361 October 28, 2014 Vehicle Route Representation Creation
8,793,066 July 29, 2014 Route Monetization
8,793,065 July 29, 2014 Route-Based Activity Planner
8,645,061 March 4, 2014 Probabilistic Map Matching From A Plurality Of Observational And Contextual Factors
8,538,686 September 17, 2013 Transport-Dependent Prediction of Destinations
8,428,859 April 23, 2013 Federated Route Production
8,244,240 August 14, 2012 Queries As Data For Revising And Extending A Sensor-Based Location Service
8,237,612 August 7, 2012 Inferring Beacon Positions Based On Spatial Relationships
8,155,877 April 10, 2012 Location-to-landmark
8,024,112 September 20, 2011 Methods For Predicting Destinations From Partial Trajectories Employing Open-And Closed-World Modeling Methods
7,991,718 August 2, 2011 Method And Apparatus For Generating An Inference About A Destination Of A Trip Using A Combination Of Open-World Modeling And Closed World Modeling
7,936,872 May 3, 2011 Client Proximity Detection Method and System
7,933,612 April 26, 2011 Determining physical location based upon received signal strengths
08861546.3 (Europe) July 17, 2010 Additional Content Based on Intended Travel Destination
7,647,171 January 12, 2010 Learning, storing, analyzing and reasoning about the loss of location-identifying signals
7,610,151 October 27, 2009 Collaborative route planning for generating personalized and context-sensitive routing recommendations
7,577,294 July 18, 2009 Background maintenance of an image sequence
7,548,648 June 19, 2009 Background maintenance of an image sequence
7,536,695 May 19, 2009 Architecture and system for location awareness
7,532,113 May 12, 2009 System and methods for determining the location dynamics of a portable computing device
7,526,401 April 28, 2009 Relative range camera calibration
7,515,750 April 7, 2009 Background maintenance of an image sequence
7,509,131 March 24, 2009 Proximity detection using wireless signal strengths
7,411,549 August 12, 2008 Calibration of a device location measurement system that utilizes wireless signal strengths
7,397,357 July 8, 2008 Sensing and analysis of ambient contextual signals for discriminating between indoor and outdoor locations
06802991.7 (Europe) May 7, 2008 Methods for predicting destinations from partial trajectories employing open- and closed-world modeling methods
7,327,245 February 5, 2008 Sensing and analysis of ambient contextual signals for discriminating between indoor and outdoor locations
06759783.1 (Europe) February 2, 2008 Positioning service utilizing existing radio base stations
7,321,838 January 22, 2008 Relative range camera calibration
7,319,877 January 15, 2008 Methods for determining the approximate location of a device from ambient signals
7,293,104 November 6, 2007 Location measurement process for radio-frequency badges
7,233,286 June 19, 2007 Calibration of a device location measurement system that utilizes wireless signal strengths
7,202,816 April 10, 2007 Utilization of the approximate location of a device determined from ambient signals
7,188,122 March 6, 2007 Live image server and client
7,136,525 November 14, 2006 System and method for background maintenance of an image sequence
7,113,885 September 26, 2006 Relative range camera calibration
7,092,566 August 15, 2006 Object recognition system and process for identifying people and objects in an image of a scene
7,053,830 May 30, 2006 System and methods for determining the location dynamics of a portable computing device
7,050,928 May 23, 2006 Relative range camera calibration
7,019,694 March 28, 2006 Location measurement process for radio-frequency badges employing path constraints
7,003,427 February 21, 2006 Relative range camera calibration
6,992,625 January 31, 2006 Calibration of a device location measurement system that utilizes wireless signal strengths
6,993,592 January 31, 2006 Location measurement process for radio-frequency badges
6,952,496 October 4, 2005 Object recognition system and process for identifying people and objects in an image of a scene
6,839,027 January 4, 2005 Location measurement process for radio-frequency badges employing path constraints
6,807,286 October 19, 2004 Object recognition using binary image quantization and hough kernels
6,788,818 September 7, 2004 System and process for optimizing false alarm probability for histogram matching
04016269.5 (Europe) September 1, 2004 Utilization of the approximate location of a device determined from ambient signals
04016227.3 (Europe) September 1, 2004 Systems for determining the approximate location of a device from ambient signals
6,771,818 August 3, 2004 System and process for identifying and locating people or objects in a scene by selectively clustering three-dimensional regions
04011947.1 (Europe) July 7, 2004 System and methods for determining the location dynamics of a portable computing device
04007400.7 (Europe) March 26, 2004 Architecture and system for location awareness
6,708,228 March 16, 2004 Automatic computer input device association
04007258.9 (Europe) March 3, 2004 Calibration of a device location measurement system that utilizes wireless signal strengths
6,611,622 August 26, 2003 Object recognition system and process for identifying people and objects in an image of a scene
6,580,424 June 17, 2003 System and method for interactive room modeling from camera images
03009042.7 (Europe) June 11, 2003 Location measurement process for radio-frequency badges
6,532,301 March 11, 2003 Object recognition with occurrence histograms
6,477,272 November 5, 2002 Object recognition with co-occurrence histograms and false alarm probability analysis for choosing optimal object recognition process parameters
5,983,147 November 9, 1999 Video occupant detection and classification