The Video and Image Retrieval and Analysis Tool (VIRAT) program is a video surveillance project funded by the Information Processing Technology Office of the Defense Advanced Research Projects Agency (DARPA). [2] [3] [4]
The purpose of the program was to create a database that could store large quantities of video, and make it easily searchable by intelligence agents to find "video content of interest" (e.g. "find all of the footage where three or more people are standing together in a group") -- this is known as "content-based searching". [1]
The other primary purpose was to create software that could provide "alerts" to intelligence operatives during live operations (e.g. "a person just entered the building"). [1]
The focus of VIRAT is primarily on footage from UAVs such as the MQ-1 Predator. As of the writing of the project solicitation in March 2008, most analysis of drone footage is done in a very labor-intensive manner by humans, who have to do manual "fast-forwarding" searches through video, or perform search queries of metadata or annotations added to videos earlier. The goal of VIRAT is to change all of this and have a large portion of the burden taken off of humans, and automating the analysis of surveillance video. [1]
VIRAT will[ when? ] focus heavily on developing means to be able to search through databases containing thousands of hours of video, looking for footage where certain types of activities took place, such as: [1]
There are already highly developed object detection systems (e.g. programs that can determine whether an object in video footage is a "car" or a "person wearing a backpack"). VIRAT will utilize what is currently available for object detection. It is not within the scope of VIRAT to fund research in object detection, unless it is somehow related to identifying certain types of activities, like those mentioned above. [1]
The DARPA program manager for the VIRAT project is Dr. Mita Desai.
Computer vision tasks include methods for acquiring, processing, analyzing and understanding digital images, and extraction of high-dimensional data from the real world in order to produce numerical or symbolic information, e.g. in the forms of decisions. Understanding in this context means the transformation of visual images into descriptions of the world that make sense to thought processes and can elicit appropriate action. This image understanding can be seen as the disentangling of symbolic information from image data using models constructed with the aid of geometry, physics, statistics, and learning theory.
The Defense Advanced Research Projects Agency (DARPA) is a research and development agency of the United States Department of Defense responsible for the development of emerging technologies for use by the military. Originally known as the Advanced Research Projects Agency (ARPA), the agency was created on February 7, 1958, by President Dwight D. Eisenhower in response to the Soviet launching of Sputnik 1 in 1957. By collaborating with academia, industry, and government partners, DARPA formulates and executes research and development projects to expand the frontiers of technology and science, often beyond immediate U.S. military requirements. The name of the organization first changed from its founding name, ARPA, to DARPA, in March 1972, changing back to ARPA in February 1993, then reverted to DARPA in March 1996.
Surveillance aircraft are aircraft used for surveillance. They are primarily operated by military forces and government agencies in roles including intelligence gathering, maritime patrol, battlefield and airspace surveillance, observation, and law enforcement.
Surveillance is the monitoring of behavior, many activities, or information for the purpose of information gathering, influencing, managing, or directing. This can include observation from a distance by means of electronic equipment, such as closed-circuit television (CCTV), or interception of electronically transmitted information like Internet traffic. Increasingly, governments may also obtain consumer data through the purchase of online information, effectively expanding surveillance capabilities through commercially available digital records. It can also include simple technical methods, such as human intelligence gathering and postal interception.
The Information Awareness Office (IAO) was established by the United States Defense Advanced Research Projects Agency (DARPA) in January 2002 to bring together several DARPA projects focused on applying surveillance and information technology to track and monitor terrorists and other asymmetric threats to U.S. national security by achieving "Total Information Awareness" (TIA).
Total Information Awareness (TIA) was a mass detection program by the United States Information Awareness Office. It operated under this title from February to May 2003 before being renamed Terrorism Information Awareness.
LifeLog was a project of the Information Processing Techniques Office of the Defense Advanced Research Projects Agency (DARPA) of the U.S. Department of Defense (DOD). According to its bid solicitation pamphlet in 2003, it was to be "an ontology-based (sub)system that captures, stores, and makes accessible the flow of one person's experience in and interactions with the world in order to support a broad spectrum of associates/assistants and other system capabilities". The objective of the LifeLog concept was "to be able to trace the 'threads' of an individual's life in terms of events, states, and relationships", and it has the ability to "take in all of a subject's experience, from phone numbers dialed and e-mail messages viewed to every breath taken, step made and place gone".
Combat Zones That See, or CTS, is a project of the United States Defense Advanced Research Projects Agency (DARPA) whose goal is to "track everything that moves" in a city by linking up a massive network of surveillance cameras to a centralized computer system. Artificial intelligence software will then identify and track all vehicle movement throughout the city.
The following outline is provided as an overview of and topical guide to computer vision:
Countersurveillance refers to measures that are usually undertaken by the public to prevent surveillance, including covert surveillance. Countersurveillance may include electronic methods such as technical surveillance counter-measures, which is the process of detecting surveillance devices. It can also include covert listening devices, visual surveillance devices, and countersurveillance software to thwart unwanted cybercrime, such as accessing computing and mobile devices for various nefarious reasons. More often than not, countersurveillance will employ a set of actions (countermeasures) that, when followed, reduce the risk of surveillance. Countersurveillance is different from sousveillance, as the latter does not necessarily aim to prevent or reduce surveillance.
The Honeywell RQ-16A T-Hawk is a ducted fan VTOL miniature UAV. Developed by Honeywell, it is suitable for backpack deployment and single-person operation.
The DARPA FORESTER is a technology development program sponsored jointly by the Defense Advanced Research Projects Agency (DARPA) and the U.S. Army intended to produce an advanced airborne UHF radar system that can track personnel and vehicles on the ground when they are hidden by foliage. FORESTER is an acronym for FOPEN Reconnaissance, Surveillance, Tracking and Engagement Radar.
The Heterogeneous Aerial Reconnaissance Team (HART)—formerly known as the "Heterogeneous Urban RSTA Team (HURT)"—program was an aerial surveillance project funded by the Information Processing Technology Office of the Defense Advanced Research Projects Agency with program managers John Bay and Michael Pagels. The purpose of the program was to develop systems that could provide continuous, real-time, three-dimensional surveillance of large urbanized areas, using unmanned aerial vehicles. The project team was led by Northrop Grumman Corporation, and involved several other academic and corporate researchers.
The Australian Research Centre for Aerospace Automation (ARCAA) was a research centre of the Queensland University of Technology. ARCAA conducted research into all aspects of aviation automation, with a particular research focus on autonomous technologies which support the more efficient and safer utilisation of airspace, and the development of autonomous aircraft and on-board sensor systems for a wide range of commercial applications.
The ARGUS-IS, or the Autonomous Real-Time Ground Ubiquitous Surveillance Imaging System, is a Defense Advanced Research Projects Agency (DARPA) project contracted to BAE Systems.
Video content analysis or video content analytics (VCA), also known as video analysis or video analytics (VA), is the capability of automatically analyzing video to detect and determine temporal and spatial events.
Cyber Insider Threat, or CINDER, is a digital threat method. In 2010, DARPA initiated a program under the same name to develop novel approaches to the detection of activities within military-interest networks that are consistent with the activities of cyber espionage.
Artificial intelligence for video surveillance utilizes computer software programs that analyze the audio and images from video surveillance cameras in order to recognize humans, vehicles, objects, attributes, and events. Security contractors program the software to define restricted areas within the camera's view and program for times of day for the property being protected by the camera surveillance. The artificial intelligence ("A.I.") sends an alert if it detects a trespasser breaking the "rule" set that no person is allowed in that area during that time of day.
Small object detection is a particular case of object detection where various techniques are employed to detect small objects in digital images and videos. "Small objects" are objects having a small pixel footprint in the input image. In areas such as aerial imagery, state-of-the-art object detection techniques under performed because of small objects.