Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
NIST and its partners, the U.S. Department of Transportation, Intel, Intel Mobileye, Lyft, Ricardo, SAE International, and the Virginia Tech Transportation Institute, invite you to attend a workshop on Consensus Safety Measurement Methodologies for ADS-Equipped Vehicles on June 25-26, 2019, at the NIST Gaithersburg, MD campus. The workshop will feature presentations and breakouts about current perspectives on safety for Automated Driving Systems (ADS).”
The automotive industry is planning to deploy automated vehicles (AV), at least at the level of NHTSA AV Level 3 (conditional automation), in the very near term with most major manufacturers (OEMs) targeting the early 2020s. Community consensus around reliable, broadly-acceptable performance measurement methods for assessing the safety of automated vehicles can facilitate the successful achievement of these deployment goals. This workshop will explore emerging concepts and possible paths toward consensus around effective safety measurement methodologies.
Automated vehicles are cyber-physical systems (CPS) or Internet of Things (IoT) systems that can be defined as systems of interacting logical, physical, and human components engineered for function through integrated logic and physics. Performance measurement and assurance in such systems requires new evaluation strategies and approaches that accommodate the complex, hybrid nature of these systems. This workshop will examine concepts for metrics, formal models, testing protocols, taxonomies, and other approaches for measuring AV safety.
This workshop’s objectives are to identify and develop criteria that should be satisfied for any approach to automated vehicle decision-making safety, to review existing or proposed methodologies for the establishing safety requirements and safety measurement approaches, to identify gaps and key challenges, and to explore opportunities for progress, including identifying alternative methodologies that should be considered.
- Explore consensus around priorities for enabling progress on the gaps and key challenges that are identified.
- Publish a review of the identified criteria, gaps and challenges, possible methodologies to address these gaps and articulate a preferred path to developing AV safety requirements and testing.
- Explore opportunities for the workshop attendees to continue to collaborate, on the identified gaps, to progress towards consensus safety metrics across the community.
Presentations
Day 1 Part 1
Edward Griffor and David Wollman (National Institute of Standards and Technology - NIST)
Chris Greer (NIST)
[Loren Smith (U.S. Department of Transportation - USDOT) – NO PDF (just verbal comments)]
[Jack Weast (Intel Corporation) - NO PDF (just verbal comments)]
[John Maddox (Lyft) – NO PDF (just verbal comments)]
Gummada Murthy (American Association of State Highway and Transportation Officials - AASHTO)
Kevin Biesty (Arizona Department of Transportation) (one joint presentation with below)
Marisa Walker (Arizona Commerce Authority) (one joint presentation with above)
Jessica Cicchino (Insurance Institute for Highway Safety - IIHS)
Day 1 Part 2
Jack Weast (Intel Mobileye)
[John Maddox (Lyft)
[Ron Medford (Waymo) – NO PDF (just verbal comments)]
Colm Boran (Ford Motor Company)
Steve Kenner (Uber)
Padma Sundaram (GM)
Nick Royal (Ricardo Innovation)
Edward Straub (Automated Vehicles Safety Consortium - SAE)
Myra Blanco (Virginia Tech Transportation Institute - VTTI)
Aviral Srivastava (Arizona State University)
Brian Williams (Massachusetts Institute of Technology - MIT)
Day 1 Part 3
Frank Barickman (USDOT)
Jack Weast (Intel Mobileye)
Michelle Chaka (VTTI)
Day 1 Part 4
Day 2 Part 1
Finch Fulton (USDOT)
Dee Williams (USDOT)
[Debbie Hersman (Waymo) - NO PDF (just verbal comments)]
Day 2 Part 2
First Breakout Group presentation “Day2_Part2_Blanco-Weast Breakout Report”
Second Breakout Group presentation “Day2_Part2_Maddox-Straub Breakout Group B feedback”
[Chris Greer (NIST) and Ken Leonard (USDOT) – NO PDF (just verbal comments)]
Related Information
For more information, please view our detailed overview and background document. (PDF)
Agenda
Tuesday, June 25, 2019
9:00 AM Welcome, Introductions, and Safety – Green Auditorium
- Edward Griffor and David Wollman (National Institute of Standards and Technology - NIST)
9:15 AM Workshop Overview, Goals, and Opening Statements [Chris Greer, moderator]
- Chris Greer (NIST)
- Loren Smith (U.S. Department of Transportation - USDOT)
- Jack Weast (Intel Corporation)
- John Maddox (Lyft)
10:15 AM State and Users Perspectives [Greg Leeming, moderator]
- Gummada Murthy (American Association of State Highway and Transportation Officials - AASHTO)
- Kevin Biesty (Arizona Department of Transportation)
- Marisa Walker (Arizona Commerce Authority)
- Jessica Cicchino (Insurance Institute for Highway Safety - IIHS)
11:00 AM Break
11:15 AM Developers Perspectives: Manufacturers and Technology Companies [Ed Griffor, moderator]
- Jack Weast (Intel Mobileye)
- John Maddox (Lyft)
- Ron Medford (Waymo)
- Colm Boran (Ford Motor Company)
- Steve Kenner (Uber)
- Padma Sundaram (GM)
- Nick Royal (Ricardo Innovation)
12:20 PM Current Standards and Testing Methods (US and International) [Myra Blanco, moderator]
- Edward Straub (Automated Vehicles Safety Consortium - SAE)
- Myra Blanco (Virginia Tech Transportation Institute - VTTI)
- Aviral Srivistava (Arizona State University)
- Brian Williams (Massachusetts Institute of Technology - MIT)
1:00 PM Lunch (on your own, NIST cafeteria)
1:50 PM Evolving Methods and Frameworks – Green Auditorium [Jack Weast, moderator]
- Frank Barickman (USDOT)
- Jack Weast (Intel Mobileye)
- Michelle Chaka (VTTI)
2:50 PM Instructions for Breakouts and Short Break
- Dave Wollman (NIST)
3:00 PM Day 1 Breakout Sessions
- Lecture Room A, Portrait Room, Dining Room A&B, Green Auditorium
See handout for room assignments, map, and discussion questions
4:15 PM Break to Reconvene Plenary – Green Auditorium
4:30 PM Interim Breakout Group Reports – 5 mins per breakout group
4:45 PM Day 1 Wrap-up, Day 2 Plan, Adjourn
- Chris Greer (NIST)
Wednesday, June 26, 2019
9:00 AM Day Two Opening Remarks – Green Auditorium [Ed Griffor, NIST]
9:15 AM Collaboration for Innovation [Ken Leonard, moderator]
- Finch Fulton (USDOT)
- Dee Williams (USDOT)
- Debbie Hersman (Waymo)
10:15 AM Instructions for Breakouts and Short Break
10:30 AM Day 2 Breakout Sessions
- Lecture Room C, Green Auditorium, Red Auditorium, Room B-111
See handout for room assignments, map, and discussion questions
12:30 PM Lunch (on your own, NIST cafeteria)
1:45 PM Breakout Group Reports – Green Auditorium 15 mins per breakout group
2:45 PM Next Steps and Workshop Conclusion
- Chris Greer (NIST) and Ken Leonard (USDOT)
3:00 PM Adjourn
Courtyard Gaithersburg Washingtonian Center
204 Boardwalk Place , Gaithersburg MD 20878
From $266/per night
Rate available 06/24/19 to 06/26/19
Book by 06/07/19
The hotel provides a complimentary shuttle to/from NIST.
NON U.S. CITIZENS PLEASE NOTE: All foreign national visitors who do not have permanent resident status and who wish to register for the above meeting must supply additional information. Failure to provide this information prior to arrival will result, at a minimum, in significant delays in entering the facility. Authority to gather this information is derived from United States Department of Commerce Department Administrative Order (DAO) number 207-12.
*New Visitor Access Requirement: Effective July 21, 2014, Under the REAL ID Act of 2005, agencies, including NIST, can only accept a state-issued driver’s license or identification card for access to federal facilities if issued by states that are REAL ID compliant or have an extension. As of Monday, January 30, 2017, Federal agencies will be prohibited from accepting driver’s licenses and identification cards from the following states for accessing federal facilities: Maine, Minnesota, Missouri, Montana and Washington. For further details, please visit our Campus Access and Security page.
Acceptable Photo Identification:
For Non-US Citizens: Valid passport for photo identification
For US Permanent Residents: Permanent Resident/Green card for photo identification