Boundless Informant

Last updated

Boundless Informant (stylized as BOUNDLESSINFORMANT) is a big data analysis and data visualization tool used by the United States National Security Agency (NSA). It gives NSA managers summaries of the NSA's worldwide data collection activities by counting metadata. [1] The existence of this tool was disclosed by documents leaked by Edward Snowden, who worked at the NSA for the defense contractor Booz Allen Hamilton. [2] Those disclosed documents were in a direct contradiction to the NSA's assurance to United States Congress that it does not collect any type of data on millions of Americans. [3]

Contents

History

Intelligence gathered by the United States government inside the United States or specifically targeting US citizens is legally required to be gathered in compliance with the Foreign Intelligence Surveillance Act of 1978 (FISA) and under the authority of the Foreign Intelligence Surveillance Court (FISA court). [4] [5] [6]

NSA global data mining projects have existed for decades, but recent programs of intelligence gathering and analysis that include data gathered from inside the United States such as PRISM were enabled by changes to US surveillance law introduced under President Bush and renewed under President Obama in December 2012. [7]

Boundless Informant was first publicly revealed on June 8, 2013, after classified documents about the program were leaked to The Guardian . [1] [8] This report contained a Top Secret heat map produced by the Boundless Informant program summarizing data records from 504 separate DNR and DNI collection sources or SIGADs. In the map, countries that are under surveillance are assigned a color from green to red (which does not correspond to intensity of surveillance). [9]

The worldwide heat map from the NSA's data visualisation tool BOUNDLESSINFORMANT, showing that during a 30-day period, 97 billion internet data records (DNI) and 124 billion telephony data records (DNR) were collected. Boundless Informant data collection - DNI.jpg
The worldwide heat map from the NSA's data visualisation tool BOUNDLESSINFORMANT, showing that during a 30-day period, 97 billion internet data records (DNI) and 124 billion telephony data records (DNR) were collected.

As this map shows that almost 3 billion data elements from inside the United States were captured by the NSA over a 30-day period ending in March 2013, Snowden stated that this tool was collecting more information on Americans located within the United States than on Russians in Russia. [10] Snowden stated that he had raised concerns about this with his superiors at the NSA beginning in October 2012, specifically with two superiors in the Hawaii regional base of the NSA Threat Operations Center and two superiors in the Technology Directorate of the NSA, Snowden claims that he brought up these concerns through the Dissent Channel. [10]

Snowden added that coworkers often were "astonished to learn" about this detail and did not wish to know any more about the program, and that until April 2012 he often asked these colleagues "What do you think the public would do if this was on the front page?" [10] Vanee Vines, an NSA spokesperson, stated that "After extensive investigation, including interviews with his former NSA supervisors and co-workers, we have not found any evidence to support Mr. Snowden's contention that he brought these matters to anyone's attention." [10]

The first publication about Boundless Informant was followed by screenshots from this program showing charts with details about the data that NSA allegedly collected from several European countries between December 10, 2012 and January 8, 2013. These charts were published by a major news outlet from each of these countries:

Screenshot from the BOUNDLESSINFORMANT tool, showing charts with different details about data collection related to Germany. The upper chart shows internet (blue bars) and telephony (green bars) data, the bottom center chart mentions two SIGADs and the most important "tech" in the bottom right section is the XKeyscore program. Boundless Informant Screencap, Germany.jpg
Screenshot from the BOUNDLESSINFORMANT tool, showing charts with different details about data collection related to Germany. The upper chart shows internet (blue bars) and telephony (green bars) data, the bottom center chart mentions two SIGADs and the most important "tech" in the bottom right section is the XKeyscore program.

Initially, these media wrote that the BoundlessInformant charts showed how many phone calls the NSA intercepted from a particular country. A first correction of this interpretation is that the program doesn't count the content of phone calls, but only the metadata thereof (see below).

A second correction is about by whom and where these data were collected. On August 5, a week after the publication of a chart from BoundlessInformant in Germany, the German intelligence agency (BND) said that they collected these data from foreign communications, related to military operations abroad. [16] [17] A similar statement was made by the Norwegian Intelligence Service, after a chart about Norway was published on November 19. [18] On February 4, 2014, the Dutch government revealed that the 1.8 million metadata in the chart about the Netherlands were not collected by NSA, but instead by the Dutch Military Intelligence and Security Service (MIVD), also to support military operations, which almost led to the resignation of the Dutch interior minister. [19]

On October 29, 2013, NSA-director Keith B. Alexander declared that accusations in French, Spanish and Italian media about NSA intercepting millions of phone calls from these countries are "completely false". He added that "This is not information that we collected on European citizens. It represents information that we and our NATO allies have collected in defense of our countries and in support of military operations." [20]

Technology

Although the initial reports in European media stated that the various charts presented the numbers of phone calls intercepted by NSA, a PowerPoint presentation and a FAQ document published by The Guardian [21] say that BoundlessInformant is counting and analysing DNI (internet) and DNR (telephony) metadata records passing through the NSA's signals intelligence systems, and are therefore not showing how much content of internet and telephone communications is intercepted. [22]

Data analyzed by Boundless Informant includes electronic surveillance program records and telephone call metadata records stored in an NSA data archive called GM-PLACE. It does not include FISA data, according to the FAQ memo. PRISM, a government codename for a collection effort known officially as US-984XN, which was revealed at the same time as Boundless Informant, is one source of DNR data. [9]

According to published slides, Boundless Informant leverages Free and Open Source Software—and is therefore "available to all NSA developers"—and corporate services hosted in the cloud. The tool uses HDFS, MapReduce, and Accumulo (formerly Cloudbase) [23] for data processing. [24]

See also

Related Research Articles

<span class="mw-page-title-main">United States Foreign Intelligence Surveillance Court</span> U.S. federal court

The United States Foreign Intelligence Surveillance Court (FISC), also called the FISA Court, is a U.S. federal court established under the Foreign Intelligence Surveillance Act of 1978 (FISA) to oversee requests for surveillance warrants against foreign spies inside the United States by federal law enforcement and intelligence agencies.

<span class="mw-page-title-main">National Security Agency</span> U.S. signals intelligence organization

The National Security Agency (NSA) is a national-level intelligence agency of the United States Department of Defense, under the authority of the Director of National Intelligence (DNI). The NSA is responsible for global monitoring, collection, and processing of information and data for foreign and domestic intelligence and counterintelligence purposes, specializing in a discipline known as signals intelligence (SIGINT). The NSA is also tasked with the protection of U.S. communications networks and information systems. The NSA relies on a variety of measures to accomplish its mission, the majority of which are clandestine. The existence of the NSA was not revealed until 1975. The NSA has roughly 32,000 employees.

<span class="mw-page-title-main">Utah Data Center</span> NSA data storage facility

The Utah Data Center (UDC), also known as the Intelligence Community Comprehensive National Cybersecurity Initiative Data Center, is a data storage facility for the United States Intelligence Community that is designed to store data estimated to be on the order of exabytes or larger. Its purpose is to support the Comprehensive National Cybersecurity Initiative (CNCI), though its precise mission is classified. The National Security Agency (NSA) leads operations at the facility as the executive agent for the Director of National Intelligence. It is located at Camp Williams near Bluffdale, Utah, between Utah Lake and Great Salt Lake and was completed in May 2014 at a cost of $1.5 billion.

<span class="mw-page-title-main">PRISM</span> Mass surveillance program run by the NSA

PRISM is a code name for a program under which the United States National Security Agency (NSA) collects internet communications from various U.S. internet companies. The program is also known by the SIGAD US-984XN. PRISM collects stored internet communications based on demands made to internet companies such as Google LLC and Apple under Section 702 of the FISA Amendments Act of 2008 to turn over any data that match court-approved search terms. Among other things, the NSA can use these PRISM requests to target communications that were encrypted when they traveled across the internet backbone, to focus on stored data that telecommunication filtering systems discarded earlier, and to get data that is easier to handle.

<span class="mw-page-title-main">Edward Snowden</span> American whistleblower and former NSA contractor (born 1983)

Edward Joseph Snowden is a United States and naturalized Russian citizen who was a computer intelligence consultant and whistleblower who leaked highly classified information from the National Security Agency (NSA) in 2013 when he was an employee and subcontractor. His disclosures revealed numerous global surveillance programs, many run by the NSA and the Five Eyes intelligence alliance with the cooperation of telecommunication companies and European governments and prompted a cultural discussion about national security and individual privacy.

Special Source Operations (SSO) is a division in the US National Security Agency (NSA) which is responsible for all programs aimed at collecting data from major fiber-optic cables and switches, both inside the US and abroad, and also through corporate partnerships. Its existence was revealed through documents provided by Edward Snowden to media outlets in 2013 and, according to him, it is the "crown jewel" of the NSA.

<span class="mw-page-title-main">Fairview (surveillance program)</span>

Fairview is a secret program under which the National Security Agency cooperates with the American telecommunications company AT&T in order to collect phone, internet and e-mail data mainly of foreign countries' citizens at major cable landing stations and switching stations inside the United States. The FAIRVIEW program started in 1985, one year after the Bell breakup.

<span class="mw-page-title-main">XKeyscore</span> Mass surveillance system

XKeyscore is a secret computer system used by the United States National Security Agency (NSA) for searching and analyzing global Internet data, which it collects in real time. The NSA has shared XKeyscore with other intelligence agencies, including the Australian Signals Directorate, Canada's Communications Security Establishment, New Zealand's Government Communications Security Bureau, Britain's Government Communications Headquarters, Japan's Defense Intelligence Headquarters, and Germany's Bundesnachrichtendienst.

The Unified Targeting Tool (UTT) is a software program used by NSA to select targets for surveillance. It has gained attention as one of the programs exposed by Edward Snowden. It is mentioned as part of the PRISM program, and in other documents.

<span class="mw-page-title-main">Blarney (code name)</span> US NSA communications surveillance program

BLARNEY is a communications surveillance program of the National Security Agency (NSA) of the United States. It started in 1978, operated under the Foreign Intelligence Surveillance Act and was expanded after the September 11 attacks.

<span class="mw-page-title-main">Mass surveillance in the United States</span>

The practice of mass surveillance in the United States dates back to wartime monitoring and censorship of international communications from, to, or which passed through the United States. After the First and Second World Wars, mass surveillance continued throughout the Cold War period, via programs such as the Black Chamber and Project SHAMROCK. The formation and growth of federal law-enforcement and intelligence agencies such as the FBI, CIA, and NSA institutionalized surveillance used to also silence political dissent, as evidenced by COINTELPRO projects which targeted various organizations and individuals. During the Civil Rights Movement era, many individuals put under surveillance orders were first labelled as integrationists, then deemed subversive, and sometimes suspected to be supportive of the communist model of the United States' rival at the time, the Soviet Union. Other targeted individuals and groups included Native American activists, African American and Chicano liberation movement activists, and anti-war protesters.

<span class="mw-page-title-main">2010s global surveillance disclosures</span> Disclosures of NSA and related global espionage

Ongoing news reports in the international media have revealed operational details about the Anglophone cryptographic agencies' global surveillance of both foreign and domestic nationals. The reports mostly emanate from a cache of top secret documents leaked by ex-NSA contractor Edward Snowden, which he obtained whilst working for Booz Allen Hamilton, one of the largest contractors for defense and intelligence in the United States. In addition to a trove of U.S. federal documents, Snowden's cache reportedly contains thousands of Australian, British, Canadian and New Zealand intelligence files that he had accessed via the exclusive "Five Eyes" network. In June 2013, the first of Snowden's documents were published simultaneously by The Washington Post and The Guardian, attracting considerable public attention. The disclosure continued throughout 2013, and a small portion of the estimated full cache of documents was later published by other media outlets worldwide, most notably The New York Times, the Canadian Broadcasting Corporation, the Australian Broadcasting Corporation, Der Spiegel (Germany), O Globo (Brazil), Le Monde (France), L'espresso (Italy), NRC Handelsblad, Dagbladet (Norway), El País (Spain), and Sveriges Television (Sweden).

<span class="mw-page-title-main">Reactions to global surveillance disclosures</span>

The global surveillance disclosure released to media by Edward Snowden has caused tension in the bilateral relations of the United States with several of its allies and economic partners as well as in its relationship with the European Union. In August 2013, U.S. President Barack Obama announced the creation of "a review group on intelligence and communications technologies" that would brief and later report to him. In December, the task force issued 46 recommendations that, if adopted, would subject the National Security Agency (NSA) to additional scrutiny by the courts, Congress, and the president, and would strip the NSA of the authority to infiltrate American computer systems using "backdoors" in hardware or software. Geoffrey R. Stone, a White House panel member, said there was no evidence that the bulk collection of phone data had stopped any terror attacks.

This is a category of disclosures related to global surveillance.

<span class="mw-page-title-main">Global surveillance</span> Mass surveillance across national borders

Global mass surveillance can be defined as the mass surveillance of entire populations across national borders.

The Fourth Amendment Protection Acts, are a collection of state legislation aimed at withdrawing state support for bulk data (metadata) collection and ban the use of warrant-less data in state courts. They are proposed nullification laws that, if enacted as law, would prohibit the state governments from co-operating with the National Security Agency, whose mass surveillance efforts are seen as unconstitutional by the proposals' proponents. Specific examples include the Kansas Fourth Amendment Preservation and Protection Act and the Arizona Fourth Amendment Protection Act. The original proposals were made in 2013 and 2014 by legislators in the American states of Utah, Washington, Arizona, Kansas, Missouri, Oklahoma and California. Some of the bills would require a warrant before information could be released, whereas others would forbid state universities from doing NSA research or hosting NSA recruiters, or prevent the provision of services such as water to NSA facilities.

<span class="mw-page-title-main">Data Intercept Technology Unit</span> US FBI special unit

The Data Intercept Technology Unit is a unit of the Federal Bureau of Investigation (FBI) of the United States, which is responsible for intercepting telephone calls and e-mail messages of terrorists and foreign intelligence targets inside the US. It is not known when DITU was established, but the unit already existed in 1997.

In Re Electronic Privacy Information Center, 134 S.Ct. 638 (2013), was a direct petition to the Supreme Court of the United States regarding the National Security Agency's (NSA) telephony metadata collection program. On July 8, 2013, the Electronic Privacy Information Center (EPIC) filed a petition for a writ of mandamus and prohibition, or a writ of certiorari, to vacate an order of the Foreign Intelligence Surveillance Court (FISC) in which the court compelled Verizon to produce telephony metadata records from all of its subscribers' calls and deliver those records to the NSA. On November 18, 2013, the Supreme Court denied EPIC's petition.

<span class="mw-page-title-main">Timeline of global surveillance disclosures (2013–present)</span>

This timeline of global surveillance disclosures from 2013 to the present day is a chronological list of the global surveillance disclosures that began in 2013. The disclosures have been largely instigated by revelations from the former American National Security Agency contractor Edward Snowden.

<span class="mw-page-title-main">MYSTIC</span> Secret intelligence program used by NSA (2009–2014)

MYSTIC is a former secret program used since 2009 by the US National Security Agency (NSA) to collect the metadata as well as the content of phone calls from several countries. The program was first revealed in March 2014, based upon documents leaked by Edward Snowden.

References

  1. 1 2 Glenn Greenwald and Ewen MacAskill (June 8, 2013). "Boundless Informant: the NSA's secret tool to track global surveillance data". The Guardian. London. Retrieved June 12, 2013.
  2. Greenwald, Glenn; MacAskill, Ewen; Poitras, Laura (June 9, 2013). "Edward Snowden: the whistleblower behind revelations of NSA surveillance". The Guardian. London. Retrieved June 9, 2013.
  3. "Here's The NSA's Supposedly Non-Existent Tool To Track Global Metadata". Gawker. June 9, 2013. Archived from the original on March 20, 2014. Retrieved March 20, 2014.
  4. Dean, John W. George W. Bush as the New Richard M. Nixon: Both Wiretapped Illegally, and Impeachable; Both Claimed That a President May Violate Congress' Laws to Protect National Security, FindLaw, December 30, 2005
  5. The Impeachment of George W. Bush Archived March 18, 2006, at the Wayback Machine by Elizabeth Holtzman, The Nation, January 11, 2006
  6. Adopted By The House Of Delegates Archived March 26, 2009, at the Wayback Machine (Archive), American Bar Association, February 13, 2006
  7. Greenwald, Glenn (June 6, 2013). "NSA taps in to internet giants' systems to mine user data, secret files reveal". The Guardian. London. Retrieved June 6, 2013.
  8. "Boundless Informant | World news". The Guardian. London. June 8, 2013. Retrieved June 9, 2013.
  9. 1 2 "Boundless Informant NSA data-mining tool – four key slides". The Guardian. London. June 8, 2013. Retrieved June 9, 2013.
  10. 1 2 3 4 Gellman, Barton. "Edward Snowden, after months of NSA revelations, says his mission’s accomplished." The Washington Post . December 23, 2013. Retrieved on February 7, 2014.
  11. Daten aus Deutschland, August 5, 2013
  12. Glenn Greenwald & German Aranda, La NSA espió 60 millones de llamadas en España en sólo un mes, October 28, 2013
  13. Glenn Greenwald & Arne Halvorsen, USA overvåket 33 millioner norske mobilsamtaler, November 19, 2013
  14. Glenn Greenwald & Stefania Maurizi, Da qui ci spiano gli americani, December 6, 2013.
  15. Top Level Telecommunications, BOUNDLESSINFORMANT: metadata collection by Dutch MIVD instead of NSA, February 8, 2014
  16. Der Spiegel, Mass Data: Transfers from Germany Aid US Surveillance, August 5, 2013
  17. Marcel Rosenbach & Holger Stark, Der NSA Komplex, Deutsche Verlags-Anstalt, München 2014, p. 235 and 326.
  18. Greenwald, Glenn (November 22, 2013). "NSA-files repeatedly show collection of data «against countries» - not «from»". dagbladet.no (in Norwegian). Retrieved April 28, 2021.
  19. Top Level Telecommunications, Dutch government tried to hide the truth about metadata collection, February 17, 2014
  20. Reuters.com, NSA chief defends agency amid U.S. spy rift with Europe Archived September 24, 2015, at the Wayback Machine , October 29, 2013
  21. "Boundless Informant: NSA explainer – full document text". The Guardian. London. June 8, 2013. Retrieved June 12, 2013.
  22. Top Level Telecommunications, BOUNDLESSINFORMANT only shows metadata, October 22, 2013.
  23. "NSA Mimics Google, Pisses Off Senate, Cade Metz". Wired. July 17, 2012.
  24. "Boundless Informant slides". Documentcloud.org. Retrieved June 9, 2013.