VIRAT

Last updated
Concept diagram of the VIRAT system, from the DARPA project solicitation VIRAT-- system concept diagram.jpg
Concept diagram of the VIRAT system, from the DARPA project solicitation

The Video and Image Retrieval and Analysis Tool (VIRAT) program is a video surveillance project funded by the Information Processing Technology Office of the Defense Advanced Research Projects Agency (DARPA). [2] [3] [4]

Contents

The purpose of the program was to create a database that could store large quantities of video, and make it easily searchable by intelligence agents to find "video content of interest" (e.g. "find all of the footage where three or more people are standing together in a group") -- this is known as "content-based searching". [1]

The other primary purpose was to create software that could provide "alerts" to intelligence operatives during live operations (e.g. "a person just entered the building"). [1]

The focus of VIRAT is primarily on footage from UAVs such as the MQ-1 Predator. As of the writing of the project solicitation in March 2008, most analysis of drone footage is done in a very labor-intensive manner by humans, who have to do manual "fast-forwarding" searches through video, or perform search queries of metadata or annotations added to videos earlier. The goal of VIRAT is to change all of this and have a large portion of the burden taken off of humans, and automating the analysis of surveillance video. [1]

VIRAT will[ when? ] focus heavily on developing means to be able to search through databases containing thousands of hours of video, looking for footage where certain types of activities took place, such as: [1]

Diagram of example operation using VIRAT system, (from the DARPA project solicitation ) VIRAT-operational-concept-diagram.jpg
Diagram of example operation using VIRAT system, (from the DARPA project solicitation )

There are already highly developed object detection systems (e.g. programs that can determine whether an object in video footage is a "car" or a "person wearing a backpack"). VIRAT will utilize what is currently available for object detection. It is not within the scope of VIRAT to fund research in object detection, unless it is somehow related to identifying certain types of activities, like those mentioned above. [1]

The DARPA program manager for the VIRAT project is Dr. Mita Desai.

See also

Related Research Articles

<span class="mw-page-title-main">Computer vision</span> Computerized information extraction from images

Computer vision is an interdisciplinary scientific field that deals with how computers can gain high-level understanding from digital images or videos. From the perspective of engineering, it seeks to understand and automate tasks that the human visual system can do.

<span class="mw-page-title-main">DARPA</span> Agency of the U.S. Department of Defense responsible for the development of new technologies

The Defense Advanced Research Projects Agency (DARPA) is a research and development agency of the United States Department of Defense responsible for the development of emerging technologies for use by the military.

<span class="mw-page-title-main">Surveillance</span> Monitoring something for the purposes of influencing, protecting, or suppressing it

Surveillance is the monitoring of behavior, many activities, or information for the purpose of information gathering, influencing, managing or directing. This can include observation from a distance by means of electronic equipment, such as closed-circuit television (CCTV), or interception of electronically transmitted information like Internet traffic. It can also include simple technical methods, such as human intelligence gathering and postal interception.

<span class="mw-page-title-main">Information Awareness Office</span> DARPA division overseeing the "Total Information Awareness" program

The Information Awareness Office (IAO) was established by the United States Defense Advanced Research Projects Agency (DARPA) in January 2002 to bring together several DARPA projects focused on applying surveillance and information technology to track and monitor terrorists and other asymmetric threats to U.S. national security by achieving "Total Information Awareness" (TIA).

<span class="mw-page-title-main">Total Information Awareness</span> US mass detection program

Total Information Awareness (TIA) was a mass detection program by the United States Information Awareness Office. It operated under this title from February to May 2003 before being renamed Terrorism Information Awareness.

LifeLog was a project of the Information Processing Techniques Office of the Defense Advanced Research Projects Agency (DARPA) of the U.S. Department of Defense (DOD). According to its bid solicitation pamphlet in 2003, it was to be "an ontology-based (sub)system that captures, stores, and makes accessible the flow of one person's experience in and interactions with the world in order to support a broad spectrum of associates/assistants and other system capabilities". The objective of the LifeLog concept was "to be able to trace the 'threads' of an individual's life in terms of events, states, and relationships", and it has the ability to "take in all of a subject's experience, from phone numbers dialed and e-mail messages viewed to every breath taken, step made and place gone".

The Information Processing Techniques Office (IPTO), originally "Command and Control Research", was part of the Defense Advanced Research Projects Agency of the United States Department of Defense.

Combat Zones That See, or CTS, is a project of the United States Defense Advanced Research Projects Agency (DARPA) whose goal is to "track everything that moves" in a city by linking up a massive network of surveillance cameras to a centralized computer system. Artificial intelligence software will then identify and track all vehicle movement throughout the city.

<span class="mw-page-title-main">Face detection</span> Identification of human faces in images

Face detection is a computer technology being used in a variety of applications that identifies human faces in digital images. Face detection also refers to the psychological process by which humans locate and attend to faces in a visual scene.

<span class="mw-page-title-main">Unmanned ground vehicle</span> Type of vehicle

An unmanned ground vehicle (UGV) is a vehicle that operates while in contact with the ground and without an onboard human presence. UGVs can be used for many applications where it may be inconvenient, dangerous, or impossible to have a human operator present. Generally, the vehicle will have a set of sensors to observe the environment, and will either autonomously make decisions about its behavior or pass the information to a human operator at a different location who will control the vehicle through teleoperation.

The following outline is provided as an overview of and topical guide to computer vision:

<span class="mw-page-title-main">Object detection</span>

Object detection is a computer technology related to computer vision and image processing that deals with detecting instances of semantic objects of a certain class in digital images and videos. Well-researched domains of object detection include face detection and pedestrian detection. Object detection has applications in many areas of computer vision, including image retrieval and video surveillance.

<span class="mw-page-title-main">Heterogeneous Aerial Reconnaissance Team</span>

The Heterogeneous Aerial Reconnaissance Team (HART)—formerly known as the "Heterogeneous Urban RSTA Team (HURT)"—program was an aerial surveillance project funded by the Information Processing Technology Office of the Defense Advanced Research Projects Agency with program managers John Bay and Michael Pagels. The purpose of the program was to develop systems that could provide continuous, real-time, three-dimensional surveillance of large urbanized areas, using unmanned aerial vehicles. The project team was led by Northrop Grumman Corporation, and involved several other academic and corporate researchers.

The Australian Research Centre for Aerospace Automation (ARCAA) was a research centre of the Queensland University of Technology. ARCAA conducted research into all aspects of aviation automation, with a particular research focus on autonomous technologies which support the more efficient and safer utilisation of airspace, and the development of autonomous aircraft and on-board sensor systems for a wide range of commercial applications.

The ARGUS-IS, or the Autonomous Real-Time Ground Ubiquitous Surveillance Imaging System, is a Defense Advanced Research Projects Agency (DARPA) project contracted to BAE Systems.

Video content analysis or video content analytics (VCA), also known as video analysis or video analytics (VA), is the capability of automatically analyzing video to detect and determine temporal and spatial events.

INDECT is a research project in the area of intelligent security systems performed by several European universities since 2009 and funded by the European Union. The purpose of the project is to involve European scientists and researchers in the development of solutions to and tools for automatic threat detection through e.g. processing of CCTV camera data streams, standardization of video sequence quality for user applications, threat detection in computer networks as well as data and privacy protection.

Cyber Insider Threat, or CINDER, is a digital threat method. In 2010, DARPA initiated a program under the same name to develop novel approaches to the detection of activities within military-interest networks that are consistent with the activities of cyber espionage.

<span class="mw-page-title-main">Rita Cucchiara</span> Italian electrical and computer engineer (born 1965)

Rita Cucchiara is an Italian electrical and computer engineer, and professor of computer architecture and computer vision in the Enzo Ferrari Department of Engineering at the University of Modena and Reggio Emilia (UNIMORE) in Italy. Cucchiara's work focuses on artificial intelligence, specifically deep network technologies and computer vision to human behavior understanding (HBU). She is the director of the AImage Lab at UNIMORE and is director of the Artificial Intelligence Research and Innovation Center (AIRI) as well as the ELLIS Unit at Modena. She was founder and director from 2018 to 2021 of the Italian National Lab of Artificial Intelligence and intelligent systems of CINI. Cucchiara was also president of the CVPL GIRPR the Italian Association of Computer Vision, Machine Learning and Pattern Recognition from 2016 to 2018.

References

  1. 1 2 3 4 5 6 7 "BAA-08-20: Video and Image Retrieval and Analysis Tool (VIRAT)". Information Processing Technology Office. March 3, 2008. Retrieved 2012-11-01.
  2. Sanchez, Julian. "DARPA building search engine for video surveillance footage". Ars Technica. Retrieved 2009-06-18.
  3. "DARPA Wants VIBRANT Results From VIRAT For UAV Data". SatNews (Industry Publication). September 29, 2008. Retrieved 2009-06-18.
  4. Pincus, Walter (October 20, 2008). "DARPA Contract Description Hints at Advanced Video Spying". The Washington Post. pp. A13. Retrieved 2009-06-30.