ThinThread

Last updated

ThinThread was an intelligence gathering project by the United States National Security Agency (NSA) conducted throughout the 1990s. [1] The program involved wiretapping and sophisticated analysis of the resulting data. The program was discontinued three weeks before the September 11, 2001 attacks due to the changes in priorities and the consolidation of U.S. intelligence authority. [2]

Contents

The "change in priority" consisted of the decision made by the director of NSA General Michael V. Hayden to go with a concept called Trailblazer, despite the fact that ThinThread was a working prototype that claimed to protect the privacy of U.S. citizens. ThinThread was dismissed and replaced by the Trailblazer Project, which lacked the privacy protections. [3] A consortium led by Science Applications International Corporation was awarded a $280 million contract to develop Trailblazer in 2002. [4]

Whistleblowing

Redacted version of the DoD Inspector General audit, obtained through FOIA Redacted-dod-oig-audit-requirements-for-the.pdf
Redacted version of the DoD Inspector General audit, obtained through FOIA

A group of former NSA workers—Kirk Wiebe, William Binney, Ed Loomis, and Thomas A. Drake, along with House Intelligence Committee staffer Diane Roark (an expert on the NSA budget [7] )—believed the operational prototype system called ThinThread was a better solution than Trailblazer, which was just a concept on paper at the time. They complained to the DoD Inspector General office in 2002 about mismanagement and the waste of taxpayer money at the NSA surrounding the Trailblazer program. In 2007 the FBI raided the homes of these people, an evolution of President Bush's crackdown on whistleblowers and "leaks" after the New York Times disclosed a separate program (see NSA warrantless surveillance controversy ). In 2010, one of the people who had helped the IG in the ensuing investigation, NSA official Thomas Andrews Drake, was charged with espionage, [7] [8] part of the Obama administration's crackdown on whistleblowers and "leaks". [8] [9] [10] The original charges against him were later dropped and he pleaded to a misdemeanor.

The result of the DoD IG complaint was a 2004 audit report that was released under FOIA in 2011. [6] Although highly redacted, the report contained significant criticisms of Trailblazer, and included some relatively minor criticisms of ThinThread, for example, citing a low "quality of service and support" from the ThinThread program team, a lack of documentation, a lack of a configuration management system, and a lack of a trouble ticket system. However, "The findings that led to the recommendations would not have prevented the successful deployment of THINTHREAD ... the recommendations were made to improve the operational efficiency of THINTHREAD after it was deployed ..." [11]

Technical details

The program would have used a technique of encrypting sensitive privacy information in an effort to comply with legal concerns, and would have automatically identified potential threats. The sources of the data for this program would have included "massive phone and e-mail data," but the extent of this information is not clear. Only once a threat was discovered, would the data be decrypted for analysis by agents. [12]

ThinThread would have bundled together four cutting-edge surveillance tools.: [1]

Intelligence experts describe as rigorous the testing of ThinThread in 1998, the project succeeding at each task with high marks. For example, its ability to sort through massive amounts of data to find threat-related communications far surpassed the existing system. It also was able to rapidly separate and encrypt U.S.-related communications to ensure privacy. [1]

The Pentagon report concluded that ThinThread's ability to sort through data in 2001 was far superior to that of another NSA system in place in 2004, and that the program should be launched and enhanced. ThinThread was designed to address two key challenges: One, the NSA had more information than it could digest, and, two, increasingly its targets were in contact with people in the United States whose calls the agency was prohibited from monitoring. [1]

Trailblazer had more political support internally because it was initiated by Michael Hayden when he first arrived at the NSA. [1]

NSA's existing system for data-sorting had produced a database clogged with corrupted and useless information. The mass collection of relatively unsorted data, combined with system flaws erroneously flagging people as suspect, had produced numerous false leads, draining analyst resources. NSA leads had resulted in numerous dead ends. [1]

NSA dropped the component that monitored for abuse of records. It not only tracked the use of the database, but hunted for the most effective analysis techniques, and some analysts thought it would be used to judge their performance. Within the NSA, the primary advocate for the ThinThread program was Richard Taylor. Taylor has retired from the NSA.

One intelligence official told the Baltimore Sun that ThinThread "was designed very carefully from a legal point of view, so that even in non-wartime, you could have done it legitimately." [14] However, Michael Hayden asserts in his memoir that in 2000 lawyers at the NSA and Justice Department would not allow the deployment of ThinThread because it would be illegal, despite its use of encryption for US citizen data: "The answer from Justice was... clear: 'You can't do this...'" [15]

End of the project

The project was ended by General Michael Hayden after successful testing, and while the privacy elements were not retained, Hayden admitted that the analysis technology is the underlying basis of current NSA analysis techniques, saying in an interview: "But we judged fundamentally that as good as [ThinThread] was, and believe me, we pulled a whole bunch of elements out of it and used it for our final solution for these problems, as good as it was, it couldn’t scale sufficiently to the volume of modern communications . [16]

Some anonymous NSA officials told Hosenball of Newsweek that the ThinThread program, like Trailblazer, was a "wasteful failure". [7] However, as noted, the MAINWAY component of ThinThread was deployed after 9/11. NSA even tried to put ThinThread into effect before 9/11. Hayden confessed in his memoir that in 2000, fearing further terrorist attacks like the Millennium Plot, he gave the order to put ThinThread into action: "Let me be clear: This was me arguing for a limited use of the Thin Thread approach prior to 9/11." The only reason ThinThread was not put into use was because it was deemed to be illegal under US law at that time. [15]

See also

Related Research Articles

<span class="mw-page-title-main">Russ Tice</span> American intelligence analyst (born 1961)

Russell D. Tice is a former intelligence analyst for the United States Air Force, Office of Naval Intelligence, Defense Intelligence Agency (DIA), and National Security Agency (NSA).

<span class="mw-page-title-main">Terrorist Surveillance Program</span> NSA program

The Terrorist Surveillance Program was an electronic surveillance program implemented by the National Security Agency (NSA) of the United States in the wake of the September 11, 2001 attacks. It was part of the President's Surveillance Program, which was in turn conducted under the overall umbrella of the War on Terrorism. The NSA, a signals intelligence agency, implemented the program to intercept al Qaeda communications overseas where at least one party is not a U.S. person. In 2005, The New York Times disclosed that technical glitches resulted in some of the intercepts including communications which were "purely domestic" in nature, igniting the NSA warrantless surveillance controversy. Later works, such as James Bamford's The Shadow Factory, described how the nature of the domestic surveillance was much, much more widespread than initially disclosed. In a 2011 New Yorker article, former NSA employee Bill Binney said that his colleagues told him that the NSA had begun storing billing and phone records from "everyone in the country."

<span class="mw-page-title-main">MAINWAY</span> NSA database of US telephone calls

MAINWAY is a database maintained by the United States' National Security Agency (NSA) containing metadata for hundreds of billions of telephone calls made through the largest telephone carriers in the United States, including AT&T, Verizon, and T-Mobile.

<span class="mw-page-title-main">Trailblazer Project</span>

Trailblazer was a United States National Security Agency (NSA) program intended to develop a capability to analyze data carried on communications networks like the Internet. It was intended to track entities using communication methods such as cell phones and e-mail.

<span class="mw-page-title-main">Thomas A. Drake</span> Former NSA senior executive, military veteran, and whistleblower (born 1957)

Thomas Andrews Drake is a former senior executive of the National Security Agency (NSA), a decorated United States Air Force and United States Navy veteran, and a whistleblower. In 2010, the government alleged that Drake mishandled documents, one of the few such Espionage Act cases in U.S. history. Drake's defenders claim that he was instead being persecuted for challenging the Trailblazer Project. He is the 2011 recipient of the Ridenhour Prize for Truth-Telling and co-recipient of the Sam Adams Associates for Integrity in Intelligence (SAAII) award.

<span class="mw-page-title-main">Utah Data Center</span> NSA data storage facility

The Utah Data Center (UDC), also known as the Intelligence Community Comprehensive National Cybersecurity Initiative Data Center, is a data storage facility for the United States Intelligence Community that is designed to store data estimated to be on the order of exabytes or larger. Its purpose is to support the Comprehensive National Cybersecurity Initiative (CNCI), though its precise mission is classified. The National Security Agency (NSA) leads operations at the facility as the executive agent for the Director of National Intelligence. It is located at Camp Williams near Bluffdale, Utah, between Utah Lake and Great Salt Lake and was completed in May 2014 at a cost of $1.5 billion.

<span class="mw-page-title-main">Turbulence (NSA)</span> United States National Security Agency information-technology project

Turbulence is a United States National Security Agency (NSA) information-technology project started c. 2005. It was developed in small, inexpensive "test" pieces rather than one grand plan like its failed predecessor, the Trailblazer Project. It also includes offensive cyberwarfare capabilities, like injecting malware into remote computers. The U.S. Congress criticized the project in 2007 for having similar bureaucratic problems as the Trailblazer Project.

<span class="mw-page-title-main">William Binney (intelligence official)</span> Former U.S. intelligence official and cryptoanalyst; whistleblower

William "Bill" Edward Binney is a former intelligence official with the United States National Security Agency (NSA) and whistleblower. He retired on October 31, 2001, after more than 30 years with the agency.

<span class="mw-page-title-main">PRISM</span> Mass surveillance program run by the NSA

PRISM is a code name for a program under which the United States National Security Agency (NSA) collects internet communications from various U.S. internet companies. The program is also known by the SIGAD US-984XN. PRISM collects stored internet communications based on demands made to internet companies such as Google LLC and Apple under Section 702 of the FISA Amendments Act of 2008 to turn over any data that match court-approved search terms. Among other things, the NSA can use these PRISM requests to target communications that were encrypted when they traveled across the internet backbone, to focus on stored data that telecommunication filtering systems discarded earlier, and to get data that is easier to handle.

<span class="mw-page-title-main">Mass surveillance in the United States</span>

The practice of mass surveillance in the United States dates back to wartime monitoring and censorship of international communications from, to, or which passed through the United States. After the First and Second World Wars, mass surveillance continued throughout the Cold War period, via programs such as the Black Chamber and Project SHAMROCK. The formation and growth of federal law-enforcement and intelligence agencies such as the FBI, CIA, and NSA institutionalized surveillance used to also silence political dissent, as evidenced by COINTELPRO projects which targeted various organizations and individuals. During the Civil Rights Movement era, many individuals put under surveillance orders were first labelled as integrationists, then deemed subversive, and sometimes suspected to be supportive of the communist model of the United States' rival at the time, the Soviet Union. Other targeted individuals and groups included Native American activists, African American and Chicano liberation movement activists, and anti-war protesters.

<span class="mw-page-title-main">2010s global surveillance disclosures</span> Disclosures of NSA and related global espionage

During the 2010s, international media reports revealed new operational details about the Anglophone cryptographic agencies' global surveillance of both foreign and domestic nationals. The reports mostly relate to top secret documents leaked by ex-NSA contractor Edward Snowden. The documents consist of intelligence files relating to the U.S. and other Five Eyes countries. In June 2013, the first of Snowden's documents were published, with further selected documents released to various news outlets through the year.

<span class="mw-page-title-main">Global surveillance</span> Mass surveillance across national borders

Global mass surveillance can be defined as the mass surveillance of entire populations across national borders.

<span class="mw-page-title-main">Global surveillance disclosures (1970–2013)</span>

Global surveillance refers to the practice of globalized mass surveillance on entire populations across national borders. Although its existence was first revealed in the 1970s and led legislators to attempt to curb domestic spying by the National Security Agency (NSA), it did not receive sustained public attention until the existence of ECHELON was revealed in the 1980s and confirmed in the 1990s. In 2013 it gained substantial worldwide media attention due to the global surveillance disclosure by Edward Snowden.

The Fourth Amendment Protection Acts, are a collection of state legislation aimed at withdrawing state support for bulk data (metadata) collection and ban the use of warrant-less data in state courts. They are proposed nullification laws that, if enacted as law, would prohibit the state governments from co-operating with the National Security Agency, whose mass surveillance efforts are seen as unconstitutional by the proposals' proponents. Specific examples include the Kansas Fourth Amendment Preservation and Protection Act and the Arizona Fourth Amendment Protection Act. The original proposals were made in 2013 and 2014 by legislators in the American states of Utah, Washington, Arizona, Kansas, Missouri, Oklahoma and California. Some of the bills would require a warrant before information could be released, whereas others would forbid state universities from doing NSA research or hosting NSA recruiters, or prevent the provision of services such as water to NSA facilities.

<span class="mw-page-title-main">Barack Obama on mass surveillance</span> Overview of the statements of former U.S. president Barack Obama on mass surveillance

Former U.S. President Barack Obama favored some levels of mass surveillance. He has received some widespread criticism from detractors as a result. Due to his support of certain government surveillance, some critics have said his support violated acceptable privacy rights, while others dispute or attempt to provide justification for the expansion of surveillance initiatives under his administration.

<span class="mw-page-title-main">Global surveillance whistleblowers</span>

Global surveillance whistleblowers are whistleblowers who provided public knowledge of global surveillance.

<span class="mw-page-title-main">Diane Roark</span> American whistleblower (born 1949)

Diane Roark is an American whistleblower who served as a Republican staffer on the House Intelligence Committee from 1985 to 2002. She was, right after 9/11, "the House Intelligence Committee staffer in charge of oversight of the NSA". In late 2001, Roark was informed by NSA official William Binney about the Bush administration's domestic surveillance programs, including Stellar Wind. Along with Binney, Ed Loomis, and J. Kirk Wiebe, she filed a complaint to the Department of Defense's Inspector General about the National Security Agency's highly classified Trailblazer Project. Her house was raided by armed FBI agents in 2007 after she was wrongly suspected of leaking to The New York Times reporter James Risen and to Siobhan Gorman at The Baltimore Sun in stories about NSA warrantless surveillance. This led her to sue the government in 2012 for not having returned her computer, which they had seized during the raid, and because the government failed to clear her name. The punitive treatment of Roark, Binney, Wiebe, and Loomis, as well as, and, in particular, then still-active NSA executive Thomas Andrews Drake, who had gone in confidence with anonymity assured to the DoD IG, led the Assistant Inspector General John Crane to eventually become a public whistleblower himself and also led Edward Snowden to go public with revelations rather than to report within the internal whistleblower program.

<i>A Good American</i> Austrian film

A Good American is a 2015 Austrian documentary film that chronicles the work of whistleblower William Binney, a former official of the National Security Agency who resigned shortly after the September 11 attacks.

John Kirk Wiebe is a former senior intelligence official with the United States National Security Agency and whistleblower on the matter of NSA mass surveillance of Americans. Kirk managed data collection, processing and analysis programs and has criticized the NSA's mass surveillance policies that continue today. Wiebe also agreed with Bill Binney's technical assessment that it was not true that the Russians had hacked the DNC's webserver in 2016.

References

  1. 1 2 3 4 5 6 Gorman, Siobhan (17 May 2006). "NSA killed system that sifted phone data legally". Baltimore Sun. Archived from the original on 27 September 2007. Retrieved 12 January 2017. - Archive does not provide second page; full text currently available at Pundita
  2. "Obama's Crackdown on Whistleblowers."
  3. "NSA datamining pushes tech envelope". PhysOrg.com. May 25, 2006..
  4. "SAIC Team Wins National Security Agency TRAILBLAZER Contract". SAIC. October 21, 2002.
  5. POGO Obtains Pentagon Inspector General Report Associated With NSA Whistleblower Tom Drake, By Nick Schwellenbach, Project on Government Oversight, 2011 6 22, http://pogo.typepad.com%5B%5D
  6. 1 2 Too Classified to Try Myth in Failed Drake Prosecution, Jesselyn Radack, DailyKos, 6/11/11
  7. 1 2 3 Exclusive: House Republican Staffer Introduced Alleged NSA Leaker to Reporter, Mark Hosenball, Declassified, Newsweek.com, 2010 Apr 16, accessed 2010 Apr 17
  8. 1 2 Indictment Continues Obama Administration's War on Leaks, Shane Harris, Washingtonian, 01/25/2011, retrieved 3/9/11
  9. Scott Shane (11 June 2010). "Obama Takes a Hard Line Against Leaks to Press". The New York Times .
  10. Checkpoint Washington - Setback in case against accused NSA leaker, Ellen Nakashima, Washington Post, 2010 Nov, retrieved from voices.washingtonpost.com on 2011 03 10]
  11. See the report, linked above. page 79 & preceding
  12. The Secret Sharer, Jane Mayer, The New Yorker, 2011 May, retrieved from www.newyorker.com on 2011 05 29]
  13. Risen, James (2014). Pay Any Price: Greed, Power, and Endless War. Houghton Mifflin Harcourt. ISBN   9780544341418.
  14. NSA Killed System That Sifted Phone Data Legally Archived 2008-03-31 at the Wayback Machine
  15. 1 2 Hayden, Michael V. (2017-02-21). Playing to the Edge: American Intelligence in the Age of Terror. Penguin. ISBN   9780143109983.
  16. "Former CIA and NSA Director General Michael Hayden (UAF ret) On His New Book "Playing To The Edge" « The Hugh Hewitt Show". The Hugh Hewitt Show. 2016-02-23. Retrieved 2017-10-09.