Forward-looking infrared (FLIR) cameras, typically used on military and civilian aircraft, use a thermographic camera that senses infrared radiation. [1]
The sensors installed in forward-looking infrared cameras, as well as those of other thermal imaging cameras, use detection of infrared radiation, typically emitted from a heat source (thermal radiation), to create an image assembled for video output.
They can be used to help pilots and drivers steer their vehicles at night and in fog, or to detect warm objects against a cooler background. The wavelength of infrared that thermal imaging cameras detect is 3 to 12 μm and differs significantly from that of night vision, which operates in the visible light and near-infrared ranges (0.4 to 1.0 μm).
Infrared light falls into two basic ranges: long-wave and medium-wave. Long-wave infrared (LWIR) cameras, sometimes called "far-infrared", operate at 8 to 12 μm and can see heat sources, such as hot engine parts or human body heat, several kilometers away. Longer-distance viewing is made more difficult with LWIR because the infrared light is absorbed, scattered, and refracted by air and by water vapor.
Some long-wave cameras require their detector to be cryogenically cooled, typically for several minutes before use, although some moderately sensitive infrared cameras do not require this. Many thermal imagers, including some forward-looking infrared cameras (such as some LWIR enhanced vision systems (EVS)) are also uncooled.
Medium-wave (MWIR) cameras operate in the 3–5 μm range. These can see almost as well, since those frequencies are less affected by water-vapor absorption, but generally require a more expensive sensor array, along with cryogenic cooling.
Many camera systems use digital image processing to improve the image quality. Infrared imaging sensor arrays often have wildly inconsistent sensitivities from pixel to pixel, due to limitations in the manufacturing process. To remedy this, the response of each pixel is measured at the factory, and a transform, most often linear, maps the measured input signal to an output level.
Some companies offer advanced "fusion" technologies that blend a visible-spectrum image with an infrared-spectrum image to produce better results than a single-spectrum image alone. [2]
Thermal imaging cameras such as the Raytheon AN/AAQ-26 are used in a variety of applications, including naval vessels, fixed-wing aircraft, helicopters, armored fighting vehicles, and military-grade smartphones. [3]
In warfare, they have three distinct advantages over other imaging technologies:
The term "forward-looking" is used to distinguish fixed forward-looking thermal imaging systems from sideways-tracking infrared systems, also known as "push broom" imagers, and other thermal imaging systems such as gimbal-mounted imaging systems, handheld imaging systems, and the like. Pushbroom systems typically have been used on aircraft and satellites.
Sideways-tracking imagers normally involve a one-dimensional (1D) array of pixels, which uses the motion of the aircraft or satellite to move the view of the 1D array across the ground to build up a 2D image over time. Such systems cannot be used for real-time imaging and must look perpendicular to the direction of travel.
In 1956, Texas Instruments began research on infrared technology that led to several line scanner contracts and, with the addition of a second scan mirror, the invention of the first forward-looking infrared camera occurred in 1963, with production beginning in 1966. In 1972, TI introduced the Common Module concept, which greatly reduced costs and allowed for the reuse of common components.
The cost of thermal imaging equipment in general has fallen dramatically after inexpensive portable and fixed infrared detectors and systems based on microelectromechanical technology were designed and manufactured for commercial, industrial, and military application. [6] [7] [8] Also, older camera designs used rotating mirrors to scan the image to a small sensor. More modern cameras no longer use this method; the simplification helps reduce cost. Uncooled technology available in many Enhanced Flight Vision System (EFVS or EVS) products have reduced the costs to fractions of the price of older cooled technology, with similar performance. [9] [10] EVS is rapidly becoming mainstream on many fixed wing and rotary wing operators from Cirrus and Cessna aircraft to large business jets.
In 2001, the United States Supreme Court decided in Kyllo v. United States that performing surveillance of private property (ostensibly to detect high emission grow lights used in clandestine cannabis farming) using thermal imaging cameras without a search warrant by law enforcement violates the Fourth Amendment's protection from unreasonable searches and seizures. [11]
In the 2004 R. v. Tessling judgment, [12] the Supreme Court of Canada determined that the use of airborne FLIR in surveillance by police was permitted without requiring a search warrant. The Court determined that the general nature of the data gathered by FLIR did not reveal personal information of the occupants and therefore was not in violation of Tessling's Section 8 rights afforded under the Charter of Rights and Freedoms (1982). Ian Binnie distinguished the Canadian law with respect to the Kyllo judgment, by agreeing with the Kyllo minority that public officials should not have to avert their senses or their equipment from detecting emissions in the public domain such as excessive heat, traces of smoke, suspicious odors, odorless gases, airborne particulates, or radioactive emissions, any of which could identify hazards to the community.
In June 2014, the Canadian National Aerial Surveillance Program DHC-8M-100 aircraft mounted with infrared sensors was instrumental in the search for Justin Bourque, a fugitive who had killed three Royal Canadian Mounted Police members in Moncton. The plane's crew used its advanced heat-sensing camera to discover Bourque's heat signature in the deep brushwoods at midnight. [13]
During 2015 Baltimore protests, the FBI conducted 10 aerial surveillance missions between April 29 and May 3, which included "infrared and day color, full-motion FLIR video evidence" collection, according to FBI spokesman Christopher Allen. [14] A FLIR Talon multi-sensor camera system equipped with an infrared laser pointer (which is invisible to casual observers) for illumination purposes was used to gather data at night. [15] The American Civil Liberties Union raised concerns over the fact that new surveillance technology is implemented without judicial guidance and public discussion. [16] According to Nathan Wessler, an ACLU attorney, "this is a dynamic we see again and again when it comes to advances in surveillance. By the time details leak out, programs are firmly entrenched, and it's all but impossible to roll them back – and very hard to put in place restrictions and oversight." [14]
Infrared is electromagnetic radiation (EMR) with wavelengths longer than that of visible light but shorter than microwaves. The infrared spectral band begins with waves that are just longer than those of red light, so IR is invisible to the human eye. IR is generally understood to include wavelengths from around 750 nm (400 THz) to 1 mm (300 GHz). IR is commonly divided between longer-wavelength thermal IR, emitted from terrestrial sources, and shorter-wavelength IR or near-IR, part of the solar spectrum. Longer IR wavelengths (30–100 μm) are sometimes included as part of the terahertz radiation band. Almost all black-body radiation from objects near room temperature is in the IR band. As a form of electromagnetic radiation, IR carries energy and momentum, exerts radiation pressure, and has properties corresponding to both those of a wave and of a particle, the photon.
Night vision is the ability to see in low-light conditions, either naturally with scotopic vision or through a night-vision device. Night vision requires both sufficient spectral range and sufficient intensity range. Humans have poor night vision compared to many animals such as cats, dogs, foxes and rabbits, in part because the human eye lacks a tapetum lucidum, tissue behind the retina that reflects light back through the retina thus increasing the light available to the photoreceptors.
Infrared thermography (IRT), thermal video or thermal imaging, is a process where a thermal camera captures and creates an image of an object by using infrared radiation emitted from the object in a process, which are examples of infrared imaging science. Thermographic cameras usually detect radiation in the long-infrared range of the electromagnetic spectrum and produce images of that radiation, called thermograms. Since infrared radiation is emitted by all objects with a temperature above absolute zero according to the black body radiation law, thermography makes it possible to see one's environment with or without visible illumination. The amount of radiation emitted by an object increases with temperature; therefore, thermography allows one to see variations in temperature. When viewed through a thermal imaging camera, warm objects stand out well against cooler backgrounds; humans and other warm-blooded animals become easily visible against the environment, day or night. As a result, thermography is particularly useful to the military and other users of surveillance cameras.
A laser designator is a laser light source which is used to designate a target. Laser designators provide targeting for laser-guided bombs, missiles, or precision artillery munitions, such as the Paveway series of bombs, AGM-114 Hellfire, or the M712 Copperhead round, respectively.
Multispectral imaging captures image data within specific wavelength ranges across the electromagnetic spectrum. The wavelengths may be separated by filters or detected with the use of instruments that are sensitive to particular wavelengths, including light from frequencies beyond the visible light range. It can allow extraction of additional information the human eye fails to capture with its visible receptors for red, green and blue. It was originally developed for military target identification and reconnaissance. Early space-based imaging platforms incorporated multispectral imaging technology to map details of the Earth related to coastal boundaries, vegetation, and landforms. Multispectral imaging has also found use in document and painting analysis.
A microbolometer is a specific type of bolometer used as a detector in a thermal camera. Infrared radiation with wavelengths between 7.5–14 μm strikes the detector material, heating it, and thus changing its electrical resistance. This resistance change is measured and processed into temperatures which can be used to create an image. Unlike other types of infrared detecting equipment, microbolometers do not require cooling.
Kyllo v. United States, 533 U.S. 27 (2001), was a decision by the Supreme Court of the United States in which the court ruled that the use of thermal imaging devices to monitor heat radiation in or around a person's home, even if conducted from a public vantage point, is unconstitutional without a search warrant. In its majority opinion, the court held that thermal imaging constitutes a "search" under the Fourth Amendment, as the police were using devices to "explore details of the home that would previously have been unknowable without physical intrusion." The ruling has been noted for refining the reasonable expectation of privacy doctrine in light of new surveillance technologies, and when those are used in areas that are accessible to the public. This case has been praised by legal scholars since the Court refused to be the arbiter to determine "what is and is not intimate" and thus worthy of protection. Instead, the Court opted to focus on "the invasiveness of the technology itself" and its ability to enable all kinds of government surveillance in the home.
A staring array, also known as staring-plane array or focal-plane array (FPA), is an image sensor consisting of an array of light-sensing pixels at the focal plane of a lens. FPAs are used most commonly for imaging purposes, but can also be used for non-imaging purposes such as spectrometry, LIDAR, and wave-front sensing.
An image sensor or imager is a sensor that detects and conveys information used to form an image. It does so by converting the variable attenuation of light waves into signals, small bursts of current that convey the information. The waves can be light or other electromagnetic radiation. Image sensors are used in electronic imaging devices of both analog and digital types, which include digital cameras, camera modules, camera phones, optical mouse devices, medical imaging equipment, night vision equipment such as thermal imaging devices, radar, sonar, and others. As technology changes, electronic and digital imaging tends to replace chemical and analog imaging.
R v Tessling [2004] 3 S.C.R. 432, is a leading Supreme Court of Canada decision where the Court held that the use of thermal imaging by police in the course of an investigation of a suspect's property did not constitute a violation of the accused's right to a reasonable expectation of privacy under section 8 of the Canadian Charter of Rights and Freedoms.
Hyperspectral imaging collects and processes information from across the electromagnetic spectrum. The goal of hyperspectral imaging is to obtain the spectrum for each pixel in the image of a scene, with the purpose of finding objects, identifying materials, or detecting processes. There are three general types of spectral imagers. There are push broom scanners and the related whisk broom scanners, which read images over time, band sequential scanners, which acquire images of an area at different wavelengths, and snapshot hyperspectral imagers, which uses a staring array to generate an image in an instant.
Teledyne FLIR LLC, formerly FLIR Systems Inc,, a subsidiary of Teledyne Technologies, specializes in the design and production of thermal imaging cameras and sensors. Its main customers are governments and in 2020, approximately 31% of its revenues were from the federal government of the United States and its agencies.
Ophir Optronics Solutions is a multinational company that sells optronics solutions. The company develops, manufactures and markets infrared (IR) optics and laser measurement equipment. Founded in 1976, the company was traded on the Tel Aviv Stock Exchange from 1991 until it was acquired, and was a constituent of its Tel-tech index. Headquartered in the Har Hotzvim industrial park in Jerusalem, Israel Ophir owns a 100,000-square-foot (9,300 m2) complex that includes the group's main production plant. Ophir has additional production plants in North Andover, Massachusetts and Logan, Utah in the US and sales offices in the US, Japan and Europe. In 2006, Ophir acquired Spiricon Group, a US-based company in the beam-profiling market. Ophir's sales increased sharply from $45 million in 2005 to $74 million in 2007. During 2007, Ophir established a Swiss-based subsidiary to market lenses and components for surveillance and imaging systems in Europe. In May 2010, Ophir acquired Photon Inc., another US-based beam-profiling company. Newport Corporation, a global supplier in photonics solutions, completed its acquisition of the Ophir company in October 2011. In 2016, metrology firm MKS Instruments bought Newport Corporation, including the Ophir brand, for $980 million.
Electro-optical MASINT is a subdiscipline of Measurement and Signature Intelligence, (MASINT) and refers to intelligence gathering activities which bring together disparate elements that do not fit within the definitions of Signals Intelligence (SIGINT), Imagery Intelligence (IMINT), or Human Intelligence (HUMINT).
A flame detector is a sensor designed to detect and respond to the presence of a flame or fire, allowing flame detection. Responses to a detected flame depend on the installation, but can include sounding an alarm, deactivating a fuel line, and activating a fire suppression system. When used in applications such as industrial furnaces, their role is to provide confirmation that the furnace is working properly; it can be used to turn off the ignition system though in many cases they take no direct action beyond notifying the operator or control system. A flame detector can often respond faster and more accurately than a smoke or heat detector due to the mechanisms it uses to detect the flame.
Infrared vision is the capability of biological or artificial systems to detect infrared radiation. The terms thermal vision and thermal imaging are also commonly used in this context since infrared emissions from a body are directly related to their temperature: hotter objects emit more energy in the infrared spectrum than colder ones.
The Lockheed Martin Desert Hawk III (DHIII) is a miniature UAV designed by the Lockheed Martin Aeronautics in 2006 for use by modern militaries. It is a small surveillance drone, which is mainly used by the United Kingdom, but has also been used by the United States to assist in the war on terror by executing reconnaissance and recovery missions.
A Readout integrated circuit (ROIC) is an integrated circuit (IC) specifically used for reading detectors of a particular type. They are compatible with different types of detectors such as infrared and ultraviolet. The primary purpose for ROICs is to accumulate the photocurrent from each pixel and then transfer the resultant signal onto output taps for readout. Conventional ROIC technology stores the signal charge at each pixel and then routes the signal onto output taps for readout. This requires storing large signal charge at each pixel site and maintaining signal-to-noise ratio as the signal is read out and digitized.
Astronics Max-Viz is an American company founded in Portland, Oregon on May 31, 2001 as Max-Viz, Inc. to design, manufacture and certify Enhanced Vision Systems ("EVS") primarily for use in the aerospace industry. Max-Viz EVS devices present real-time images of the external environment on aircraft cockpit monitors to improve pilot situational awareness under circumstances where visibility is impaired by weather or darkness. The company objective is to help the pilot see clearly and fly safely by providing visual information about where they are, where they are going and what is in their way. The Max-Viz EVS captures and enhances thermal infrared signals and can be combined with visible light as well as other electromagnetic energy sources. The company's systems are designed to be integrated with a variety of displays already in the aircraft cockpit.
An enhanced flight vision system is an airborne system which provides an image of the scene and displays it to the pilot, in order to provide an image in which the scene and objects in it can be better detected. In other words, an EFVS is a system which provides the pilot with an image which is better than unaided human vision. An EFVS includes imaging sensors such as a color camera, infrared camera or radar, and typically a display for the pilot, which can be a head-mounted display or head-up display. An EFVS may be combined with a synthetic vision system to create a combined vision system.