Microsoft Indoor Localization Competition – IPSN 2015

Summary

seattle_pic

Accurate indoor localization has the potential to transform the way people navigate indoors in a similar way that GPS transformed the way people navigate outdoors. Over the last 15 years, several human-centric approaches to indoor localization have been proposed by both academia and industry, but we have yet to see large scale deployments. This competition aims to bring together real-time or near real-time indoor location technologies and compare their performance.

Organizers

News

Latest Updates

04/17/2015: The detailed results of the 2015 Competition have been posted!

04/02/2015: The detailed schedule of the competition has been posted. Evaluation time slots have been assigned to each officially registered team.

02/23/2015: The competition will take place on Monday April 13th and Tuesday April 14th. More details can be found here.

02/03/2015: Registration for the competition is now open! Contestants should register for the Indoor Localization Competition listed under Workshops. Lower registration fees are available for non-contestants that simply want to observe the competition. Observers should choose the Competition Observer registration that is listed right below the Workshops section in the registration page.

02/03/2015: Details on the evaluation area and the logistics of the competition have been made available here.

01/22/2015: The competition categories and the teams in each category have been announced.

01/19/2015: The competition is on with 48 submissions from 44 teams!

Other Competitions

Check the other competition’s websites above to get a better idea of the evaluation setup, the type of systems expected, and pictures of the different teams in action.

Official Results

28 teams out of the 48 teams that submitted an abstract actually showed up in Seattle for the competition. 5 teams faced technical difficulties that prevented them from getting evaluated. As a result, 23 teams were actually evaluated. The average localization error across all 20 evaluation points for each team can be seen below:

The slide deck with the final results can be found HERE.

The FULL evaluation data can be found HERE.

results

Categories

The top 3 teams in each of the two categories are as follows:

RankInfrastructure-FreeInfrastructure-Based
1STeAM: Sensor Tracking and Mapping European Commission (JRC) Sanchez et al.ALPS: AN Ultrasonic Localization Systems Lazik et al. (CMU)
2SPIRIT Navigation Berkovich et al.Time Domain Dewberry et al.
3Precise Indoor Location Elias et al.Exploring State of the Art Commercial Localization Campbell et al. (University of Michigan)

We are happy to announce that we have received 48 submissions from 44 teams this year!

Overall, 12 submissions are fully authored or co-authored from industry people. From these 12 submissions, 4 come from startups in the indoor location space. The rest 36 submissions come from academia from all over the world.

There are 30 submissions in the infrastructure-based category (systems that need to deploy custom hardware) and 17 submissions in the infrastructure-free category. However, we are considering introducing additional categories for this year’s competition. The categories and the teams within each category will be announced on this website within the next couple of days.

Competition Schedule

The competition will start on Monday April 13th and finish on Tuesday April 14th. The detailed results of the competition will be presented during the Indoor Location Panel that will take place on Wednesday April 15th from 15:30 to 16:30. The detailed schedule is as follows:

Monday April 13th

8:00 – 8:30am Welcome – Evaluation space and rules overview
8:30am – 15:30 Setup Time
15:30pm – 16:00 All teams leave the evaluation area
16:00 – 18:30 Organizers mark down the evaluation points
18:30 – 20:30 First evaluation wave

Tuesday April 14th

8:00am – 12pm Second evaluation wave
12:00pm – 13:00 Lunch
13:00 – 15:00 Third evaluation wave
17:00 – 20:00 Poster Session

Wednesday April 15th

15:30 – 16:30 Official results are announced and the winning teams briefly present their systems during the Indoor Localization Competition Panel

Infrastructure-Free Submissions

All submissions have been assigned to one of two categories depending on the requirement to deploy custom hardware or not. The list of all submissions in each category can be seen below. Additional categories could be created depending on which/how many teams will actually attend the competition.

Teams in green fonts have at least one member that has officially registered for the competition. These teams will be allowed to compete. Teams in red fonts do not have any members officially registered for the competition yet. All teams in red fonts will not be allowed to compete unless at least one team member officially registers for the competition. The data below will be updated periodically. Latest update: April 12th 2015.

AuthorsAffiliationTitle
Wen et al.UK/Australia/China – Univ. of Oxford/Queensland/New South Wales/Tongji UniversityAgile Indoor Positioning with Smart Glasses
Clark et al.UK – University of OxfordMonoVision Indoor Positioning
Simon et al.Hungary – University of PannoniaMultimodal Indoor Localization System
Smirnov et al. Russia – Navigine Indoor Navigation Platform Based on Signals Fingerprinting and Aided IMU
Wu et al.Canada – University of WindsorParticle Filter and Extreme Learning Machine Based Indoor Localization System
Zou et al.Singapore/USA – Nanyang Technological University/UC BerkeleyAn Accurate and Reliable WiFi-based Indoor Localization and Navigation System
Elias et al.Portugal – Fraunhofer Portugal Research CenterPrecise Indoor Location
Jin et al. China – Dalian University of Technology Indoor Localization via Multiple Sensor Fusion
MacLachlan et al. USA – Carnegie Mellon University Applied Indoor Localization: Map-based, Infrastructure-free, with Divergence Mitigatino and Smoothing
Marinis et al.Italy – DUNE srlContextual Processing for Pedestrian Tracking in GPS-denied environments
Kolchanov et al.Russia/USA – Skoltech/MITA Wifi-based Localization System for Mobile Devices
Jun et al.India/USA/Singapore – IIT Ropar/Univ. of Cincinnati/Singapore Univ. of Technology and Design/IBM ResearchRobust and Undemanding WiFi-fingerprint based Indoor Localization with Independent Access Points
Herrera et al.Germany/Mexico – Navix Indoor NavigationNavix: Smartphone Multi-sensor, Radio and Probability Map Based Indoor Positioning.
Yeung et al.Switzerland/Spain – ETH/IMDEA Networks Institute/ArmasuisseTracking with WiFi Time-of-Flight and Smartphone Inertial Sensors
Sarkar et al.India – Tata Consulting ServicesAn Indoor Positioning System using Step Detection and WiFi Trilateration
Aquila et al.Italy – GIPStech Srl/University of CalabriaA Novel Hybrid/Geomagnetic Field-based Technology for Indoor Navigation
Berkovich et al.Russia – SPIRIT NavigationSPIRIT Navigation: Multi-Technology Indoor Localization

Infrastructure-Based Submissions

Authors

Affiliation

Title

Evaluation Time Slot

Kuo et al.USA – Univ. of MichiganIndoor Positioning with Mobile Phones and Visible LightTuesday9:30am
Nasser et al.Israel – Univ. of HaifaHome-made Tracking System using Core-sets and the Internet of (Tracking) Things
Simon et al.Hungary – Univ. of PannoniaLED-light based Indoor Localization SystemMonday18:45
Schiller et al.USA – Stony Brook UniversityDevice Free Indoor Localization Using InfraredMonday19:00
Klipp et al.Germany – Fraunhofer FOKUSLow Cost High Precision Indoor Localization System Using Inertial and Magnetic Field Sensor Data with Radio BeaconsMonday19:15
Zhao et al.China – Microsoft Research AsiaIndoor Localization Using BLE MIMO
Biehl et al.USA – FX Palo Alto LaboratoryLoCo – A Framework for Supporting Highly Accurate Room-level Location Sensing
Qiu et al.Taiwan – National Chiao-Tung UniversityCollaborative Localization Using Inter Particle Filter Data FusionMonday19:30
Inderst et al.Italy – Universita degli Studi Roma/Universita Campus Bio-Medic di RomaInertial-based Smart Indoor Localization System
Chen et al.Singapore/USA – Nanyang Technological University/UC BerkeleyAn iBeacon Assisted Indoor Localization and Tracking SystemTuesday9:00am
Campbell et al.USA – Univ. of MichiganDecaWave: Exploring State of the Art Commercial LocalizationTuesday9:15am
Kempke et al.USA – Univ. of MichiganPulse Harmonia: Decimeter-Scale Tracking of Small Indoor Objects
Dewberry et al.USA – TimeDomainUltra Wideband Two Way Ranging Localization SystemTuesday9:45am
Dewberry et al.USA – TimeDomainUltra Wideband Radar Tagless Indoor Tracking System
Selavo et al.Latvia – Institute of Electronics and Computer ScienceDiStAL: Digitally Steerable Antennas for LocalizationTuesday10am
Shenoy et al.India – BITS-PilaniIndoor Localization using TDOA Techniques
Symington et al.USA/UK – UCLA/Univ. College LondonReal-time Indoor Localization using Magnetic, Time of Flight, and Signal Strength Inference MapsTuesday10:15am
Zengen et al.Germany – TU BraunschweigInPhase: A Low Cost Indoor Localization System for IoT DevicesTuesday10:30am
Pirkl et al.Germany – DFKIIndoor Localization based on Oscillating Magnetic FieldsTuesday10:45am
Mirshekari et al.USA – Carnegie Mellon UniversityStep-Level Person Localization Through Sparse Sensing of Structural VibrationTuesday11:00am
Lazik et al.USA – Carnegie Mellon UniversityALPS: An Ultrasonic Localization SystemTuesday 11:15am
Liu et al.USA – University of FloridaTowards Fine-grained Smartphone Localization via Low-complexity Anchors
Deora et al.USA – Univ. of Southern CaliforniaNUSBL: Non-Uniform Sequence Based LocalizationTuesday11:30am
Abrudan et al.UK – University of OxfordAn Indoor Localization System using Low-frequency Magnetic Fields
Arumugam et al.USA – Jet Propulsion Lab/CaltechTwo-Dimensional Magnetoquasistatic Positioning for Non-Line-of-Sight Tracking Applications
Kotaru et al.USA – StanfordIndoor Localization using Commercial off-the-shelf WiFi NICs.
Bata et al.Hungary – University of SzegedIndoor Radio Interferometric Localization and TrackingTuesday13:15
Nikodem et al.Poland – Wroclaw Univ. of Technology/ MT-Silesia Sp.Time of Flight and Geometrical Lateration Algorithms for Accurate Indoor PositioningTuesday13:30
Pourhomayoun et al.USA – UCLALow Cost Localization based on Spatial Diversity
Sanchez et al.Italy – European Commission, Joint Research Center (JRC)STeAM: Sensor Tracking and MappingTuesday13:45
Gunes et al.Germany – Quantitec GmbHIntraNavTuesday14:00

Call for Contesters

Eligibility

Both academia and industry submissions are encouraged. All location techniques, such as ranging, fingerprinting, infrastructure, or device free, are welcome, except those that require end users’ manual measurements. Contesters can deploy their own infrastructure of up to 10 devices. Normal RF interference is expected, but no jammers for other deployments are allowed. The results must be shown on a portable device, such as a phone or a tablet/laptop that a person can easily carry around.

Demo submissions that do not meet one or more of the guidelines above will be included in the poster session and will be evaluated as a regular submission, but they will not be considered for prizes.

The competition will take place if at least 5 teams respond to this preliminary call for competition.

Competition Categories

Depending on the nature and number of submissions multiple categories might be defined based on the accuracy (i.e., point-based vs. area based), the size, the cost, or the type (i.e., software vs. hardware) of the proposed solution. The final set of categories will be announced after the registration deadline.

Poster Session

A poster session dedicated to all competition participants will be organized during the conference. Participants will have the opportunity to explain their system to conference attendees.

Evaluation and Prize

Results are judged based on both room/zone level accuracy and absolute accuracy, and an award will be given for the top 3 teams in each category. When accuracy ties, infrastructure requirements will be used for tie breaking. The winning team in each category will be invited to present their approach at the conference, and receive a cash award.

Submission Guidelines

Contesters must submit an abstract describing their approach and deployment requirements by the contest registration deadline. Submissions are treated as confidential until the competition. Submissions must be at most two (2) single-spaced 8.5″ x 11″ pages, including figures, tables, and references. Submission should follow the exact same format as regular, full IPSN 2015 papers. Abstracts should include the names and affiliations of authors. Templates can be found here.