CRT Subcommittee Teleconference*
Thursday, February 15, 2007, 11:00 a.m. EDT


1) Administrative updates (Eustis)
2) Letters to NASS and NASED re: benchmarks (Flater/Wack)
3) Discussion of QA/CM research paper (Goldfine)
4) Discussion of EMC Draft with outline (Goldfine)
5) Revised discussion draft (Flater)
6) Any other items.

Attendees: Alan Goldfine, Allan Eustis, Brit Williams, Commissioner Davidson (EAC), David Flater, John Cugini, John Wack, Lynne Rosenthal, Matt Masterson (EAC), Nelson Hastings, Paul Miller, Philip Pearce, Steve Berger

Administrative Updates (Allan Eustis):

  • Welcome to Matt Masterson from EAC. Mat will be working with Commissioner Davidson and Brian Hancock and TGDC to serve as a liaison in the development of the VVSG.
  • David Alderman's (NIST) testimony to the EAC on conformity assessment activities and review of the laboratories has been posted on the web. See:

Letters to NASS and NASED Regarding Benchmarks (David Flater):

It was determined at the end of the last TGDC meeting that we needed election community buy-in of the benchmarks in terms of accuracy and reliability. Letters were sent to NASS and NASED asking for comments/consensus on these issues. NASS has declined to take a position, we have not heard back from NASED. (It was noted that due diligence was taken to get feedback.) Comm. Davidson suggested contacting State Election Directors to find out what they are doing. CRT had been advised by NIST General Counsel not to do this, but it was suggested that EAC might be able to. Comm. Davidson will check with EAC General Counsel.

ACTION: TGDC members present were asked to provide any information that had on this subject to CRT.

Discussion of Quality Assurance (QA)/Configuration Management (CM) Research Paper:

This paper was written after consensus at the December meeting that the ISO 9000 and 9001 standards should provide the framework for the VVSG 07 requirements dealing with QA/CM. This is a first draft of a set of requirements that attempted to do that. ISO 9000 is a general set of requirements - the real key is to design specific requirements that work for voting systems - that is what this paper tries to do. Alan asked for comments/feedback - did we address key issues, is it outside our scope, did we address everything within our scope? Steve Berger commented that this was going in the direction he had in mind. Steve also wanted to know if a vendor changed hardware/software, did it show up as a version change? Alan noted this specific issue was probably covered in configuration management. It is a valid concern and he will look into it.

ACTION: Specific technical comments should be discussed with Alan offline via email or phone.

Re, Philip Pearce asked about the critical parts list of what constitutes a failure of a part or a component - should there be something added regarding diminished accessibility or usability. Alan agreed and asked if Philip would draft up some appropriate bullets.

ACTION: Does group agree with list of critical items, please let Alan know if not.

[NOTE: In 2005, TGDC requested process model - CRT's working draft contains informative process model.]

EMC Draft with Outline:

Discussion was held at a previous meeting about revisions of electrical requirements within environmental requirements section of the VVSG. It was suggested CRT reach beyond the voting team to experts in the field of electrical equipment testing. We've talked to experts (at NIST) regarding radiated interference and conducted electromagnetic interference. Based on these discussions, we have outlined work and some draft requirements for this area. Alan inquired if there were any general opinions or concerns regarding this outline.

Technical questions should be sent via email to Alan Goldfine. Steve Berger questioned if there was any field data about problems currently with these issues? The answer was no, but that should not stop the group from looking into it. Steve also mentioned that there were a lot of "to be determined" specs; including requirements question marks. Alan pointed out that this represented discussion about whether certain topics need to be developed within volume 5 of the VVSG. Are these testing standards or are they specifically testing scenarios. This is a work in progress - all the TBDs will be determined. Comm. Davidson suggested getting comments from the vendors about costs after Alan receives Steve's questions via email. John Wack, Allan Eustis, and Alan Goldfine will discuss offline about bringing this up at the next vendor's meeting.

Discussion Draft (Summary of Changes):

Revised set of draft requirements are available on the web. (Specifically this is David Flater's material which has been submitted to the editorial team for review and formatting.) The change log file contains a count of things that were changed between drafts. David went over a few of the changes. Biggest change was in the introductory informative text to coding conventions (C language with use of COTs add ons becomes structured language) , and in the follow on changes to the conventions themselves. Other changes (subject to revision) included: data to be provided, functional testing, conformity assessment and use of components.

The question was asked if for the definition of EBMs (electronically assisted ballot markers), was consideration given to blindness or visually impaired. David noted that he clarified the definition of EBMs but that the issue with blindness or visually impaired was being looked at specifically by HFP.

Meeting adjourned at 12:00.

[* Pursuant to the Help America Vote Act of 2002, the TGDC is charged with directing NIST in performing voting systems research so that the TGDC can fulfill its role of recommending technical standards for voting equipment to the EAC. This teleconference discussion served the purposes of the CRT subcommittee of the TGDC to direct NIST staff and coordinate its voting-related research relevant to the VVSG 2007. Discussions on this telecon are preliminary, pre-decisional and do not necessarily reflect the views of NIST or the TGDC.]



Link to NIST HAVA Page

Last updated: July 25, 2007
Point of Contact

Privacy policy / security notice / accessibility statement
Disclaimer / FOIA
NIST is an agency of the U.S. Commerce Department