Performance Metrics for Intelligent Systems Workshop

The Performance Metrics for Intelligent Systems workshop is the only one of its kind dedicated to defining measures and methodologies of evaluting performance of intelligent systems. Started in 2000, the PerMIS series focuses on applications of performance measures to practical problems in commercial, industrial, homelandsecurity, and military applications. It has proved to be an excellent forum for discussions and partnerships, dissemination of ideas, and future collaborations between researchers, graduatestudents, and practitioners from industry, academia, and government agencies. The main theme of the ninth iteration of the workshop, PerMIS'09, seeks to address the question: Does performance measurement accelerate the pace of advancement for intelligent systems? In addition to the main theme, as in previous years, the workshop will focus on applications of performance measures to practical problems in commercial, industrial, homeland security, and military applications. Topic areas include, but are not limited to:

• Defining and measuring aspects of a system:
• • Human-robot interaction
  • Collaboration & coordination
  • Taxonomies
  • Biologically inspired models
• Evaluating components within intelligent systems:>
• • Sensing and perception
  • Knowledge representation, world models, ontologies
  • Planning and control
  • Learning and adapting
  • Reasoning
• Infrastructural support for performance evaluation:
• • Sensing and perception
  • Testbeds and competitions for intercomparisons
  • Instrumentation and other measurement tools
  • Simulation and modeling support
• Technology readiness measures for intelligent systems
• Benchmarks and applied performance measures in various domains, e.g.,
• • Industrial and manufacturing systems
  • Intelligent transportation systems
  • Emergency response robots (e.g., search and rescue, bomb disposal)
  • Homeland security systems
  • Defense robotics
  • Intelligent systems for hazardous environments (e.g., nuclear remediation)
  • Smart Grid
  • Space robotics
  • Medical robotics & assistive devices

The Proceedings of PerMIS are indexed by INSPEC, Compendex, ACM Digital Library, and are released as a NIST Special Publication. Selected papers from past workshops have been published as special issues with the Journal of Integrated Computer-Aided Engineering (PerMIS'04) and the Journal of Field Robotics (PerMIS'06 and as a SpringerEdited Book Volume (PerMIS'08).