Brian Weiss

Dr. Weiss is currently focused on the development and implementation of performance metrics and test methods to quantify technical performance and assess end-user utility of emergent intelligent systems through various stages of maturity. His current projects include assessments of applications running on hand-held devices to support tactical operations and the development of verification and validation tests to assess the performance of manufacturing technologies. Additionally, he has previously worked in assessing the performance of soldier-worn sensor systems; two-way, free form, spoken language translation devices; developing metrics and test methods for both bomb disposal and urban search and rescue robots. He has also contributed to ground-breaking efforts in testing and evaluating unmanned ground vehicles for the military. He is one of the principle creators of the System, Component, and Operationally-Relevant Evaluation (SCORE) framework which he has applied to several of his prior efforts. From 2007 to 2012, Dr. Weiss collaborated with the University of Maryland to develop Multi-Relationship Evaluation Design (MRED) as the focus of his PhD research. MRED is an interactive test plan blueprint generator that will allow evaluation designers to speed the pace of the test-plan development process. MRED collects multiple inputs from various sources and automatically outputs evaluation blueprints that specify key test-plan characteristics.

Dr. Weiss has been honored with numerous awards during his tenure at NIST including:

• Silver Medal for Meritorious Service – Evaluation of Middle Eastern Speech Translations Systems, 2011

• International Test and Evaluation Association Annual Symposium Best Paper – Performance Assessments of Two-Way, Free Form, Speech-to-Speech Translation Systems for Tactical Use, 2010

• International Test and Evaluation Association Annual Symposium Best Presentation 3rd Place –  The Multi-Relationship Evaluation Design Framework: Producing Evaluation Blueprints to Test Emerging, Advanced, and Intelligent Technologies, 2010

• International Test and Evaluation Association Annual Symposium Best Paper Award – Development of Domain-Specific Scenarios for Training and Evaluation of Two-Way, Free Form, Spoken Language Translation Devices, 2009
  

• International Test and Evaluation Association Annual Symposium Best Presentations Award – Development of Domain-Specific Scenarios for Training and Evaluation of Two-Way, Free Form, Spoken Language Translation Devices, 2009

• Bronze Award for Superior Federal Service – For development and implementation of the SCORE framework, 2008

• Jacob Rabinow Applied Research Award – For technical achievement in applying robotic crane research to improve the productivity and safety of large aircraft maintenance operations, 2006

• Bronze Award for Superior Federal Service – For exceptional accomplishment in developing and implementing the first comprehensive Technology Readiness Level assessment of unmanned ground vehicles, 2004.