Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

ARIA Workshop Visual

The National Institute of Standards and Technology (NIST) will convene an in-person workshop on November 12, 2024, in Washington, D.C., to provide more detail about NIST's new ARIA program. Participants will learn about ARIA’s experimentation environment and NIST’s approach to evaluation-driven research.

ARIA (Assessing Risks and Impacts of AI) is a NIST AI Innovation Lab program to gather evidence about AI’s risks to people and society as part of advancing the science and practice of AI risk measurement. 

The one day in-person workshop will take place at The American Geophysical Union in Washington, D.C. 

This is the first in a series of ARIA workshops to facilitate discussion about aspects of this unique program. The series will begin with a deep-dive into the role of annotation in the ARIA program. Stay tuned for future series.

The target audience for this workshop is any organization currently participating (or interested in participating) in the ARIA pilot efforts, those working in the field of socio-technical evaluations, and organizations engaged in the annotation of human-AI interactions.

Tuesday, November 12, 2024

Start Time 

End 
Time 

Speaker(s)  

Session Name/Information 

10:00am 

10:30am 

Reva Schwartz 

Welcome and Program Overview 

10:30am 

10:50am 

Craig Greenberg 

How to Participate in ARIA and Expected Reporting 

10:50am 

11:10am 

ARIA Team 

Open Q&A 

11:10am 

11:30am 

Razvan Amironesei 

The Role of Annotation in ARIA 

11:30am 

11:45am 

Gabriella Waters 

Introduction to Workshop Exercise 

11:45am 

Noon 

ARIA Team 

Open Q&A 

Noon 

1:00pm 

 

LUNCH 

1:00pm 

2:30pm 

ARIA Team 

Workshop Exercise: Attendees break into small groups

2:30pm 

2:45pm 

 

BREAK 

2:45pm 

3:00pm 

 

Groups prepare exercise report-outs 

3:00pm 

3:30pm 

Jon Fiscus 

Building the ARIA community 

3:30pm 

4:00pm 

ARIA Team 

Open Discussion 

4:00pm 

4:30pm 

Reva Schwartz, Jon Fiscus 

Next Steps and Close Out 

Please see below for a list of nearby hotels:

Washington Hilton
1919 Connecticut Ave, NW
Washington, DC 20009

The Generator Washington DC (formerly Courtyard Marriott) 
1900 Connecticut Ave, NW
Washington, DC 20009

Churchill Hotel
1914 Connecticut Ave, NW
Washington, DC 20009

Royal Sonesta Washington DC Dupont Circle (formerly Hotel Palomar)
2121 P Street NW
Washington, DC 20037

Residence Inn by Marriott Dupont Circle
2120 P Street NW
Washington, DC 200037

“The Normandy Hotel”
Managed by:  Modus by PM Hotel Group
2118 Wyoming Ave NW
Washington DC 20008

 


 

 

Created October 9, 2024, Updated November 7, 2024