NYSTEC Review of NY SBOE Certification Testing Finds Poor Training, Lack of Communication to Blame for Machine Failures. Counties Balk at "CYA" Report.
UPDATED 2 PM
After receiving several complaints that state-certified voting devices failed in local testing, the New York State Board of Elections (SBOE) ordered an independent audit of its acceptance testing process. The New York State Technology Enterprise Corporation (NYSTEC) also evaluated "whether the testing process provides an adequate evaluation of the condition of electronic voting systems." NYSTEC's main findings center on two factors: better vendor training of county employees; and increased communication by vendors and the SBOE with counties.
Nassau County purchased 450 ballot marking devices (BMDs) from Sequoia, at a cost of $12,000 each. It reported that 85% of 240 machines were non-functional, one fifth of them damaged during shipment. New York City also experienced software failure, when it tested ES&S AutoMARK's BMD, as attested at the June 23rd NYC Government Services Committee, reported Nassau County Attorney Lori Barrett.
Ballot marking devices allow disabled voters to vote independently, printing the ballot for them, and would fulfill NY's compliance with the Help America Vote Act. Yet a substantial portion of BMDs received in Nassau registered a printer failure.
NYSTEC is a private, not-for-profit firm that provides systems engineering and technical assistance in "acquiring, implementing and securing technology systems," according to its website. After a one-day review on July 8th, NYSTEC concluded on July 10th:
"[T]he policies and procedures used for acceptance testing of the BMD's are quite good and are being followed diligently. There are many checks and balances in place that would make it very hard for a machine to pass acceptance testing and arrive at a county with the number of issues that were noted by Nassau. That being said, we did find a few things outside of the actual process of acceptance testing that are areas in need of improvement.
"The main concern is a lack of communication and coordination with the counties by both the voting system vendors and SBOE. On the vendor side, each vendor should make sure that each county board is adequately trained on the use of their system prior to any delivery of their equipment.... SBOE also has room for improvement in communicating with the counties....
"It is recommended that any tips discovered during [centralized] acceptance testing be quickly passed on to the counties so they can take save time and effort by taking advantage of lessons learned."
Inadequate training and poor communication cannot fully explain the situation in Nassau, since officials successfully operated 22 of the 240 machines it received from the State. NYSTEC's report also failed to mention Sequoia's admission of "systemic failure" in the design of these BMDs.When asked about the NYSTEC findings, Nassau County Commissioner Bill Biamonte said, "This report is CYA."
July 9th Testing at Nassau CountyYesterday, representatives from the SBOE, Sequoia and the Department of Justice met in Nassau County to test 25 of the machines that failed local testing. We would expect Sequoia fully understands its machines, yet discovered non-resolvable problems with six of them, shipping them back to the plant.
Biamonte pointed out, "These are all tech-related issues with the equipment." Nassau knows how to follow instructions, the BMDs simply don't work. "If this was an issue of properly training the counties, then why did Sequoia just now assign a full time technician to Nassau County to stay with us through the election?"
The SYSTEC report also failed to mention that Nassau was advised that the BMD's "internal diagnostics testing was turned off, to accommodate a USB cable failure," said Biamonte. This explains why some of the machines reported printer failure. BMDs were created to print ballots for disabled voters. Biamonte asks:
"How do we know, then, that the printer works if the diagnostics is turned off? If you pay for something that has a diagnostics feature, you expect to get that feature. It's like buying a car where the gauges don't work. So you learn you're out of oil on the highway when the engine seizes."
Biamonte also reported that when the same machine was tested more than once, sometimes it worked and sometimes it didn't. "These machines are skittish!"