Open-source intelligence

Last updated

Open-source intelligence (OSINT) is the collection and analysis of data gathered from open sources (covert sources and publicly available information; PAI) to produce actionable intelligence. OSINT is primarily used in national security, law enforcement, and business intelligence functions and is of value to analysts who use non-sensitive intelligence in answering classified, unclassified, or proprietary intelligence requirements across the previous intelligence disciplines. [1]

Contents

Categories

OSINT sources can be divided up into six different categories of information flow: [2]

OSINT is distinguished from research in that it applies the process of intelligence to create tailored knowledge supportive of a specific decision by a specific individual or group. [3]

OSINT collection methodologies

Collecting open-source intelligence is achieved in a variety of different ways, [4] such as:

Definition

OSINT is defined in the United States of America by Public Law 109-163 as cited by both the U.S. Director of National Intelligence and the U.S. Department of Defense (DoD), as intelligence "produced from publicly available information that is collected, exploited, and disseminated in a timely manner to an appropriate audience for the purpose of addressing a specific intelligence requirement." [5] As defined by NATO, OSINT is intelligence "derived from publicly available information, as well as other unclassified information that has limited public distribution or access." [6]

According to political scientist Jeffrey T. Richelson, “open source acquisition involves procuring verbal, written, or electronically transmitted material that can be obtained legally. In addition to documents and videos available via the Internet or provided by a human source, others are obtained after U.S. or allied forces have taken control of a facility or site formerly operated by a foreign government or terrorist group.” [7]

Former Assistant Director of Central Intelligence for Analysis Mark M. Lowenthal defines OSINT as “any and all information that can be derived from overt collection: all types of media, government reports and other documents, scientific research and reports, commercial vendors of information, the Internet, and so on. The main qualifiers to open-source information are that it does not require any type of clandestine collection techniques to obtain it and that it must be obtained through means that entirely meet the copyright and commercial requirements of the vendors where applicable." [8]

History

Seal of the 9/11 Commission 911 commission seal.svg
Seal of the 9/11 Commission

OSINT practices have been documented as early as the mid-19th century in the United States and early 20th century in the United Kingdom. [9]

OSINT in the United States traces its origins to the 1941 creation of the Foreign Broadcast Monitoring Service (FBMS), an agency responsible for the monitoring of foreign broadcasts. An example of their work was the correlation of changes in the price of oranges in Paris with successful bombings of railway bridges during World War II. [10]

The Aspin-Brown Commission stated in 1996 that US access to open sources was "severely deficient" and that this should be a "top priority" for both funding and DCI attention. [11]

In July 2004, following the September 11 attacks, the 9/11 Commission recommended the creation of an open-source intelligence agency. [12] In March 2005, the Iraq Intelligence Commission recommended [13] the creation of an open-source directorate at the CIA.

Following these recommendations, in November 2005 the Director of National Intelligence announced the creation of the DNI Open Source Center. The Center was established to collect information available from "the Internet, databases, press, radio, television, video, geospatial data, photos and commercial imagery." [14] In addition to collecting openly available information, it would train analysts to make better use of this information. The center absorbed the CIA's previously existing Foreign Broadcast Information Service (FBIS), originally established in 1941, with FBIS head Douglas Naquin named as director of the center. [15] Then, following the events of 9/11 the Intelligence Reform and Terrorism Prevention Act merged FBIS and other research elements into the Office of the Director of National Intelligence creating the Open Source Enterprise.

Furthermore, the private sector has invested in tools which aid in OSINT collection and analysis. Specifically, In-Q-Tel, a Central Intelligence Agency supported venture capital firm in Arlington, VA assisted companies develop web-monitoring and predictive analysis tools.

In December 2005, the Director of National Intelligence appointed Eliot A. Jardines as the Assistant Deputy Director of National Intelligence for Open Source to serve as the Intelligence Community's senior intelligence officer for open source and to provide strategy, guidance and oversight for the National Open Source Enterprise. [16] Mr. Jardines has established the National Open Source Enterprise [17] and authored intelligence community directive 301. In 2008, Mr. Jardines returned to the private sector and was succeeded by Dan Butler who is ADDNI/OS [18] and previously Mr. Jardines' Senior Advisor for Policy. [19]

Tools

It is possible for any user to extract the first and last name provided at sign-up with Kik Messenger, even without user profiles. Pawny4 James Gordon Meek Kik Messenger Pete Fawny.png
It is possible for any user to extract the first and last name provided at sign-up with Kik Messenger, even without user profiles.
Open source intelligence may be ingested to battle management systems such as CPCE by Systematic, which uses an open source feed from Janes Information Services. Command Post Computing Environment multiple screens Photo US Army released to Public Domain.jpg
Open source intelligence may be ingested to battle management systems such as CPCE by Systematic, which uses an open source feed from Janes Information Services.

The web browser is a powerful OSINT tool that provides access to numerous websites and both open source and proprietary software tools that are either purpose-built for open source information collection or which can be exploited for the purposes of either gathering of open source information or to facilitate analysis and validation to provide intelligence. A cottage industry of both for-profit and not-for-profit investigative and educational groups such as Bellingcat, IntelTechniques SANS and others offer indices, books, podcasts and video training materials on OSINT tools and techniques. Books such as Michael Bazzell's Open Source Intelligence Techniques serve as indices to resources across multiple domains but according the author, due to the rapidly changing information landscape, some tools and techniques change or become obsolete frequently, hence it is imperative for OSINT researchers to study, train and survey the landscape of source material regularly. [20] A guide by Ryan Fedasiuk, an analyst at the Center for Security and Emerging Technology, lists six tools open-source analysts can use to stay safe and utilize operational security (OPSEC) when conducting online investigations. These include VPNs, cached webpages, digital archive services, URL and file scanners, browser sandbox applications, and antivirus software. [21]

Numerous lists of aggregated OSINT content are available on the web. The OSINT Framework contains over 30 primary categories of tools and is maintained as an open source project on GitHub. [22]

Risks for practitioners

A main hindrance to practical OSINT is the volume of information it has to deal with ("information explosion"). The amount of data being distributed increases at a rate that it becomes difficult to evaluate sources in intelligence analysis. To a small degree the work has sometimes been done by amateur crowd-sourcing. [23]

Accredited journalists have some protection in asking questions, and researching for recognized media outlets. Even so, they can be imprisoned, even executed, for seeking out OSINT. Private individuals illegally collecting data for a foreign military or intelligence agency is considered espionage in most countries. Of course, espionage that is not treason (i.e. betraying one's country of citizenship) has been a tool of statecraft since ancient times. [24]

Professional association

The OSINT Foundation is a professional association for OSINT practitioners in the United States Intelligence Community. [25] It is open to U.S. Citizens and seeks to raise the prominence of the open-source intelligence discipline. [26]

See also

Related Research Articles

<span class="mw-page-title-main">Director of National Intelligence</span> US Cabinet-level government official

The director of national intelligence (DNI) is a senior, cabinet-level United States government official, required by the Intelligence Reform and Terrorism Prevention Act of 2004 to serve as executive head of the United States Intelligence Community (IC) and to direct and oversee the National Intelligence Program (NIP). All IC agencies report directly to the DNI. The DNI also serves, upon invitation, as an advisor to the president of the United States, the National Security Council and the Homeland Security Council on all intelligence matters. The DNI, supported by the Office of the Director of National Intelligence (ODNI), produces the President's Daily Brief (PDB), a classified document including intelligence from all IC agencies, handed each morning to the president of the United States.

<span class="mw-page-title-main">United States Intelligence Community</span> Collective term for US federal intelligence and security agencies

The United States Intelligence Community (IC) is a group of separate United States government intelligence agencies and subordinate organizations that work both separately and collectively to conduct intelligence activities which support the foreign policy and national security interests of the United States. Member organizations of the IC include intelligence agencies, military intelligence, and civilian intelligence and analysis offices within federal executive departments.

<span class="mw-page-title-main">Foreign Broadcast Information Service</span> CIA foreign news monitoring service (1941–2005)

The Foreign Broadcast Information Service (FBIS) was an open source intelligence component of the Central Intelligence Agency's Directorate of Science and Technology. It monitored, translated, and disseminated within the U.S. government openly available news and information from media sources outside the United States. Its headquarters was in Rosslyn, later Reston, Virginia, and it maintained approximately 20 monitoring stations worldwide. In November 2005, it was announced that FBIS would become the newly formed Open Source Center, tasked with the collection and analysis of publicly available intelligence.

<span class="mw-page-title-main">National Counterterrorism Center</span> U.S. government organization responsible for national and international counterterrorism efforts

The National Counterterrorism Center (NCTC) is a United States government organization responsible for national and international counterterrorism efforts. It is based in Liberty Crossing, a modern complex near Tysons Corner in McLean, Virginia. NCTC advises the United States on terrorism.

The National Intelligence Board (NIB), formerly the National Foreign Intelligence Board and before that the United States Intelligence Board is a body of senior U.S. Intelligence Community leaders currently led by the Director of National Intelligence (DNI). The Board is tasked with reviewing and approving National Intelligence Estimates (NIEs).

<span class="mw-page-title-main">National Center for Medical Intelligence</span> Military medical intelligence agency of the United States

The National Center for Medical Intelligence (NCMI), formerly known as the Armed Forces Medical Intelligence Center, is a component of the United States Defense Intelligence Agency (DIA) responsible for the production of medical intelligence and all-source intelligence on foreign health threats and other medical issues to protect U.S. interests worldwide. Headquartered at Fort Detrick, Maryland, the center provides finished intelligence products to the Department of Defense, U.S. Intelligence Community, Five Eyes, NATO, allies and partners, as well as international health organizations and NGO's.

<span class="mw-page-title-main">Eliot A. Jardines</span>

Eliot A. Jardines was the first Assistant Deputy Director of National Intelligence for Open Source (ADDNI/OS) in the United States.

The Open Source Enterprise (OSE) is a United States Government organization dedicated to open-source intelligence. Initially part of the Office of the Director of National Intelligence, it is now part of the Directorate of Digital Innovation at the Central Intelligence Agency (CIA). Former iterations of the organization were the Open Source Center (OSC) and the Foreign Broadcast Information Service (FBIS).

<span class="mw-page-title-main">Intellipedia</span> US Intelligence Community encyclopedia

Intellipedia is an online system for collaborative data sharing used by the United States Intelligence Community (IC). It was established as a pilot project in late 2005 and formally announced in April 2006. Intellipedia consists of three wikis running on the separate JWICS (Intellipedia-TS), SIPRNet (Intellipedia-S), and DNI-U (Intellipedia-U) networks. The levels of classification allowed for information on the three wikis are Top Secret Sensitive Compartmented Information, Secret (S), and Sensitive But Unclassified information, respectively. Each of the wikis is used by individuals with appropriate clearances from the 18 agencies of the US intelligence community and other national-security related organizations, including Combatant Commands and other federal departments. The wikis are not open to the public.

<span class="mw-page-title-main">Intelligence Advanced Research Projects Activity</span> American government agency

The Intelligence Advanced Research Projects Activity (IARPA) is an organization within the Office of the Director of National Intelligence responsible for leading research to overcome difficult challenges relevant to the United States Intelligence Community. IARPA characterizes its mission as follows: "To envision and lead high-risk, high-payoff research that delivers innovative technology for future overwhelming intelligence advantage."

The United States Intelligence Community A-Space, or Analytic Space, is a project started in 2007 from the Office of the Director of National Intelligence's (ODNI) Office of Analytic Transformation and Technology to develop a common collaborative workspace for all analysts from the USIC. It is accessible from common workstations and provides unprecedented access to interagency databases, a capability to search classified and unclassified sources simultaneously, web-based messaging, and collaboration tools. The Defense Intelligence Agency (DIA) is the executive agent for building the first phase of A-Space. Initial operational capability was scheduled for December 2007. A-Space went live on the government's classified Joint Worldwide Intelligence Communications System 22 September 2008. A-Space is built on Jive Software's Clearspace application.

The target-centric approach to intelligence is a method of intelligence analysis that Robert M. Clark introduced in his book "Intelligence Analysis: A Target-Centric Approach" in 2003 to offer an alternative methodology to the traditional intelligence cycle. Its goal is to redefine the intelligence process in such a way that all of the parts of the intelligence cycle come together as a network. It is a collaborative process where collectors, analysts and customers are integral, and information does not always flow linearly.

<span class="mw-page-title-main">United States intelligence budget</span> Funding for US intelligence agencies

The United States intelligence budget comprises all the funding for the 18 agencies of the United States Intelligence Community. These agencies and other programs fit into one of the intelligence budget's two components, the National Intelligence Program (NIP) and the Military Intelligence Program (MIP). As with other parts of the federal budget, the US intelligence budget runs according to the Fiscal year (FY), not the calendar year. Before government finances are spent on intelligence, the funds must first be authorized and appropriated by committees in both the United States House of Representatives and the United States Senate.

Geographic information systems (GIS) play a constantly evolving role in geospatial intelligence (GEOINT) and United States national security. These technologies allow a user to efficiently manage, analyze, and produce geospatial data, to combine GEOINT with other forms of intelligence collection, and to perform highly developed analysis and visual production of geospatial data. Therefore, GIS produces up-to-date and more reliable GEOINT to reduce uncertainty for a decisionmaker. Since GIS programs are Web-enabled, a user can constantly work with a decision maker to solve their GEOINT and national security related problems from anywhere in the world. There are many types of GIS software used in GEOINT and national security, such as Google Earth, ERDAS IMAGINE, GeoNetwork opensource, and Esri ArcGIS.

<span class="mw-page-title-main">Eliot Higgins</span> British citizen journalist

Eliot Ward Higgins, who previously wrote under the pseudonym Brown Moses, is a British citizen journalist and former blogger, known for using open sources and social media for investigations. He is the founder of Bellingcat, an investigative journalism website that specialises in fact-checking and open-source intelligence. He has investigated incidents including the Syrian Civil War, the Russo-Ukrainian War, the downing of Malaysia Airlines Flight 17 and the poisoning of Sergei and Yulia Skripal. He first gained mainstream media attention by identifying weapons in uploaded videos from the Syrian conflict.

Bellingcat is a Netherlands-based investigative journalism group that specialises in fact-checking and open-source intelligence (OSINT). It was founded by British citizen journalist and former blogger Eliot Higgins in July 2014. Bellingcat publishes the findings of both professional and citizen journalist investigations into war zones, human rights abuses, and the criminal underworld. The site's contributors also publish guides to their techniques, as well as case studies.

<span class="mw-page-title-main">Susan M. Gordon</span> American intelligence officer

Susan M. Gordon served as Principal Deputy Director of National Intelligence until August 15, 2019. Prior to assuming that role, she was the Deputy Director of the National Geospatial-Intelligence Agency (NGA), having assumed the position on January 1, 2015. Before joining the NGA, she served as director of the Central Intelligence Agency's Information Operations Center and senior cyber adviser to the Director of the Central Intelligence Agency. Gordon worked for the CIA for over 25 years.

All-source intelligence is a term used to describe intelligence organizations, intelligence analysts, or intelligence products that are based on all available sources of intelligence collection information.

<span class="mw-page-title-main">Open-source intelligence in the Russian invasion of Ukraine</span> Use of publicly available information for military strategy

The role of open-source intelligence (OSINT) in response to the 2022 Russian invasion of Ukraine has attracted significant attention.

<span class="mw-page-title-main">National Open Source-Intelligence Agency</span> Proposed US government agency

The National Open Source-Intelligence Agency (NOSA) is a proposed 19th member of the United States Intelligence Community (IC) to be tasked with the collection and exploitation of open-source intelligence (OSINT). Creation of the agency would consolidate open source efforts from across the US government into a new functional manager for the open-source intelligence discipline, drawing resources from the Open Source Enterprise of the Central Intelligence Agency, the Open Source Integration Center (OSIC) of the Defense Intelligence Agency, the National Geospatial-Intelligence Agency, as well as other open source focused entities across the government.

References

  1. ↑ Schwartz, Leo (March 7, 2022). "Amateur open-source researchers went viral unpacking the war in Ukraine". Rest of World. Retrieved 8 March 2022.
  2. ↑ Richelson, Jeffrey (2016). The US Intelligence Community. Avalon. ISBN   978-0813349183.
  3. ↑ "Spy Agencies Turn to Newspapers, NPR, and Wikipedia for Information: The intelligence community is learning to value 'open-source' information". Archived from the original on 2012-10-23. Retrieved 2008-09-15.
  4. ↑ Leos, Devan (2023-02-28). "Thinking Like a Spy: How Open Source Intelligence Can Give You a Competitive Advantage". Entrepreneur. Retrieved 2023-11-08.
  5. ↑ "As defined in Sec. 931 of Public Law 109-163, entitled, "National Defense Authorization Act for Fiscal Year 2006."". Archived from the original on 2008-11-12. Retrieved 2006-12-08.
  6. ↑ "NATOTermOTAN". nso.nato.int. Retrieved 2021-04-02.
  7. ↑ Richelson, Jeffrey T (2015-07-14). The U.S. Intelligence Community. Avalon Publishing. ISBN   9780813349190 . Retrieved 15 May 2017.
  8. ↑ Lowenthal, Mark M. (2005), "Open-Source Intelligence: New Myths, New Realities", in George, Roger Z; Kline, Robert D (eds.), Intelligence and the national security strategist : enduring issues and challenges, Lanham: Rowman and Littlefield, ISBN   9780742540392
  9. ↑ Block, Ludo (2023). "The long history of OSINT". Journal of Intelligence History: 1–15. doi: 10.1080/16161262.2023.2224091 . ISSN   1616-1262.
  10. ↑ Bornn, D Marshall (9 Jan 2013). "Service members, civilians learn to harness power of 'Open Source' information". www.army.mil. Archived from the original on 9 December 2017. Retrieved 14 May 2017.
  11. ↑ Lowenthal, Mark; Clark, Robert (2015). The Five Disciplines of Intelligence Collection. CQ Press. p. 18. ISBN   978-1483381114.
  12. ↑ See page 413 of the 9-11 Commission Report (pdf) Archived 2007-07-05 at the Wayback Machine .
  13. ↑ McLaughlin, Michael (June 2012). "Using open source intelligence for cybersecurity intelligence". ComputerWeekly.com. Archived from the original on 2018-06-29. Retrieved 2018-06-29.
  14. ↑ Office of the Director of National Intelligence. "ODNI Announces Establishment of Open Source Center Archived 2006-06-23 at the Wayback Machine ". Press release, 8 November 2005.
  15. ↑ Ensor, David. "The Situation Report: Open source intelligence center Archived 2007-03-25 at the Wayback Machine ". CNN, 8 November 2005.
  16. ↑ Office of the Director of National Intelligence "ODNI Senior Leadership Announcement Archived 2006-06-23 at the Wayback Machine ". Press release, 7 December 2005.
  17. ↑ "National Open Source Entreprise Vision Statement" Archived 2007-09-28 at the Wayback Machine May 2006
  18. ↑ DNI Open Source Conference 2008 "Decision Advantage" agenda, Office of the Director of National Intelligence, July 2008. Archived 2010-04-17 at the Wayback Machine
  19. ↑ DNI Open Source Conference 2007 "Expanding the Horizons" agenda, Office of the Director of National Intelligence, July 2007. Archived 2008-08-01 at the Wayback Machine
  20. ↑ "Books by Michael Bazzell". inteltechniques.com. Retrieved 2022-05-02.
  21. ↑ Fedasiuk, Ryan (2022-04-06). "Into the Jungle: Best Practices for Open-Source Researchers". Center for Security and Emerging Technology. Retrieved 2022-04-22.
  22. ↑ OSINT Framework, lockFALE, 2022-05-02, retrieved 2022-05-02
  23. ↑ "Bellingcat's Eliot Higgins Explains Why Ukraine Is Winning the Information War". Time. Retrieved 2022-04-13.
  24. ↑ Sun Tzu (Warring States period), The Art of War , Chapter 13: "Hostile armies may face each other for years, striving for the victory which is decided in a single day. This being so, to remain in ignorance of the enemy's condition simply because one grudges the outlay of 2 hundred ounces of silver in honors and emoluments, is the height of inhumanity."
  25. ↑ New OSINT foundation aims to 'professionalize' open source discipline across spy agencies, 2022-07-27
  26. ↑ Volz, Dustin (2022-07-27), "New Group to Promote Open-Source Intelligence, Seen as Vital in Ukraine War", Wall Street Journal


Literature

Scientific Publications
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.