This piece was reprinted by OpEdNews with permission or license. It may not be reproduced in any form without permission or license from the source.
Reprinted from Consortium News
Former National Security Agency official William Binney sitting in the offices of Democracy Now! in New York City.
(Image by (Photo credit: Jacob Appelbaum)) Permission Details DMCA
When Edward Snowden in early June 2013 began to reveal classified data showing criminal collect-it-all surveillance programs operated by the U.S. government's National Security Agency, former NSA professionals became freer to spell out the liberties taken with the Bill of Rights, as well as the feckless, counterproductive nature of bulk electronic data collection.
On Jan. 7, 2014, four senior retired specialists with a cumulative total of 144 years of work with NSA -- William Binney, Thomas Drake, Edward Loomis, and Kirk Wiebe -- prepared a Memorandum for the President providing a comprehensive account of the problems at NSA, together with suggestions as to how they might be best addressed.
The purpose was to inform President Obama as fully as possible, as he prepared to take action in light of Snowden's revelations.
On Jan. 23, 2015 in Berlin, Binney was honored with the annual Sam Adams Award for Integrity in Intelligence. Ed Snowden was live-streamed-in for the occasion, and said, "Without Bill Binney there would be no Ed Snowden." (Binney had been among the first to speak out publicly about NSA abuses; apparently that emboldened Snowden to do what he did.)
Snowden had already said when he fled to Hong Kong in June 2013 that he had learned an extremely important lesson from the four years of government persecution/prosecution of Tom Drake; namely, that he, Ed Snowden, had to leave the country in order to fulfill his mission -- and to have some reasonable chance to avoid spending the rest of his life behind bars. (Eventually, all the felony charges against Drake were dismissed.)
An important take-away lesson from Binney's and Drake's boldness and tenacity is that one never knows what impetus courageous truth-tellers can give to other, potential whistleblowers -- like Ed Snowden.
In 1998, Bill Binney, with some 35 years under his belt as a senior NSA mathematician and cryptologist took on a staggering problem for NSA: how to deal with the vast amount of data available on the worldwide web without burying intelligence analysts under a haystack of data.
From Binney's long experience, it seemed clear that selecting information by using metadata relationships was the smart way to go. As he puts it, "Smart selection is smart collection."
This approach was totally different form the word/phrase dictionary-select type approach in general use -- even today. Binney's technique was to use metadata and some additional rules to define relationships. This enabled discriminate selection of data from the tens of terabytes twisting in the ether. The approach focused the collected data around known targets, plus some potential developmental targets, and yielded much more manageable content for analysts to deal with.
Missing the Needles
Experience had long since shown that collecting everything in bulk, and using word/phrase type queries, end up burying analysts in data and making them dysfunctional. In some of the internal NSA memos released by Snowden, NSA analysts complain of the kind of analysis paralysis that makes it extremely difficult for them to find and address the real threats.
As Snowden has quipped, "The problem with mass surveillance is when you collect everything, you understand nothing."
The net result is that people die first. Only then do detectives and law enforcement go wading into their vast data, focus on possible perpetrators of the crime and often find related information. This is, of course, exactly the reverse of how the security services should proceed -- assuming the main priority is to thwart terrorist or other attacks. And yet the U.S. government proceeds willy-nilly with its SOS (Stasi-On-Steroids) approach.
In sum, success can come only from a focused, disciplined selection of data off the fiber lines, yielding usable metadata, as Binney and his NSA colleagues demonstrated. Indeed, there was quite enough electronic intelligence collected by THINTHREAD, the collection system Binney and his team created, before 9/11 to have thwarted the attacks, as NSA senior executive Thomas Drake learned, to his horror, after the fact.
"Smart selection" techniques can also protect individual privacy, as Binney and his colleagues likewise showed. More to the point, this approach can provide a rich but manageable data environment for analysts to use toward one of the most important intelligence objectives -- predicting intentions and capabilities.