The National Institute of Standards and Technology (NIST) will convene an in-person workshop on November 12, 2024, in Washington, D.C., to provide more detail about NIST's new ARIA program. Participants will learn about ARIA’s experimentation environment and NIST’s approach to evaluation-driven research.
ARIA (Assessing Risks and Impacts of AI) is a NIST AI Innovation Lab program to gather evidence about AI’s risks to people and society as part of advancing the science and practice of AI risk measurement.
The one day in-person workshop will take place at The American Geophysical Union in Washington, D.C.
This is the first in a series of ARIA workshops to facilitate discussion about aspects of this unique program. The series will begin with a deep-dive into the role of annotation in the ARIA program. Stay tuned for future series.
The target audience for this workshop is any organization currently participating (or interested in participating) in the ARIA pilot efforts, those working in the field of socio-technical evaluations, and organizations engaged in the annotation of human-AI interactions.
Start Time | End | Speaker(s) | Session Name/Information |
10:00am | 10:30am | Reva Schwartz | Welcome and Program Overview |
10:30am | 10:50am | Craig Greenberg | How to Participate in ARIA and Expected Reporting |
10:50am | 11:10am | ARIA Team | Open Q&A |
11:10am | 11:30am | Razvan Amironesei | The Role of Annotation in ARIA |
11:30am | 11:45am | Gabriella Waters | Introduction to Workshop Exercise |
11:45am | Noon | ARIA Team | Open Q&A |
Noon | 1:00pm |
| LUNCH |
1:00pm | 2:30pm | ARIA Team | Workshop Exercise: Attendees break into small groups |
2:30pm | 2:45pm |
| BREAK |
2:45pm | 3:00pm |
| Groups prepare exercise report-outs |
3:00pm | 3:30pm | Jon Fiscus | Building the ARIA community |
3:30pm | 4:00pm | ARIA Team | Open Discussion |
4:00pm | 4:30pm | Reva Schwartz, Jon Fiscus | Next Steps and Close Out |
Please see below for a list of nearby hotels:
Washington Hilton
1919 Connecticut Ave, NW
Washington, DC 20009
The Generator Washington DC (formerly Courtyard Marriott)
1900 Connecticut Ave, NW
Washington, DC 20009
Churchill Hotel
1914 Connecticut Ave, NW
Washington, DC 20009
Royal Sonesta Washington DC Dupont Circle (formerly Hotel Palomar)
2121 P Street NW
Washington, DC 20037
Residence Inn by Marriott Dupont Circle
2120 P Street NW
Washington, DC 200037
“The Normandy Hotel”
Managed by: Modus by PM Hotel Group
2118 Wyoming Ave NW
Washington DC 20008