Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

PerfLoc: Performance Evaluation of Smartphone Indoor Localization Apps

The PerfLoc Prize Competition was developed by NIST during 2015-2017 and ran during 2017-2018. The Competition concluded with a single winner on May 16, 2018. However, NIST believes the data collected for the PerfLoc Competition is still of value to the R&D community, because there is still room to develop better signal processing and data fusion algorithms that would fuse various types of smartphone data collected in this project to develop indoor localization apps with higher localization accuracy. For that reason, NIST continues to make the PerfLoc data available to the R&D community.

Uses

 It is no longer possible for app developers to upload the location estimates generated by their apps at the PerfLoc website for performance evaluation purposes and to get statistics of localization accuracy. However, the PerfLoc data is still useful, because there is training data with ground-truth location annotation that would be useful to anyone wishing to develop indoor localization apps and getting an idea of the performance of their apps.

The data is composed of:

  1. RF signal strengths measured from Wi-Fi access points in range
  2. RF signal strengths measured from cellular towers (base stations) in range
  3. Built-in environmental, position and motion sensors
  4. Detected geophysical position using the Global Positioning System (GPS)
  5. Timestamps at certain test points (dots) in the buildings with known x,y,z coordinates
  6. Metadata involving the features of the device that was used to collect a data set corresponding to a particular Test & Evaluation (T&E) Scenario and the air pressure value at the beginning of the scenario, whenever applicable.
  7. Building-specific information comprising the coordinates of the corners of each building, the coordinates of Wi-Fi access points (APs) deployed in the building, and the coordinates of the training dots in that building
  8. Definitions of protocol buffers; see the end of this section for more information on this item.

The data was collected using four different smartphones, in four buildings with different characteristics. The total space covered by these buildings was about 30,000 m2. One was an office building, two were industrial shop and warehouse types of buildings, and the fourth was a subterranean structure. More than 900 dots were used to mark locations of interest that covered all the spaces in all four buildings. A total of 34 T&E scenarios were used for data collection in the four buildings. Time instances were recorded in each scenario when certain dots were visited. The dots visited in each scenario were a subset of the dots deployed in the given building, and the subsets varied from one scenario to another within the same building. The T&E scenarios are defined in the ISO/IEC 18305 standard.

Contact

Created January 2, 2025