Hyperspectral imaging

Last updated
Two-dimensional projection of a hyperspectral cube. HyperspectralCube.jpg
Two-dimensional projection of a hyperspectral cube.

Hyperspectral imaging collects and processes information from across the electromagnetic spectrum. [1] The goal of hyperspectral imaging is to obtain the spectrum for each pixel in the image of a scene, with the purpose of finding objects, identifying materials, or detecting processes. [2] [3] There are three general types of spectral imagers. There are push broom scanners and the related whisk broom scanners (spatial scanning), which read images over time, band sequential scanners (spectral scanning), which acquire images of an area at different wavelengths, and snapshot hyperspectral imagers, which uses a staring array to generate an image in an instant.

Contents

Whereas the human eye sees color of visible light in mostly three bands (long wavelengths, perceived as red; medium wavelengths, perceived as green; and short wavelengths, perceived as blue), spectral imaging divides the spectrum into many more bands. This technique of dividing images into bands can be extended beyond the visible. In hyperspectral imaging, the recorded spectra have fine wavelength resolution and cover a wide range of wavelengths. Hyperspectral imaging measures continuous spectral bands, as opposed to multiband imaging which measures spaced spectral bands. [4]

Engineers build hyperspectral sensors and processing systems for applications in astronomy, agriculture, molecular biology, biomedical imaging, geosciences, physics, and surveillance. Hyperspectral sensors look at objects using a vast portion of the electromagnetic spectrum. Certain objects leave unique "fingerprints" in the electromagnetic spectrum. Known as spectral signatures, these "fingerprints" enable identification of the materials that make up a scanned object. For example, a spectral signature for oil helps geologists find new oil fields. [5]

Sensors

Figuratively speaking, hyperspectral sensors collect information as a set of "images." Each image represents a narrow wavelength range of the electromagnetic spectrum, also known as a spectral band. These "images" are combined to form a three-dimensional (x, y, λ) hyperspectral data cube for processing and analysis, where x and y represent two spatial dimensions of the scene, and λ represents the spectral dimension (comprising a range of wavelengths). [6]

Technically speaking, there are four ways for sensors to sample the hyperspectral cube: spatial scanning, spectral scanning, snapshot imaging, [5] [7] and spatio-spectral scanning. [8]

Hyperspectral cubes are generated from airborne sensors like NASA's Airborne Visible/Infrared Imaging Spectrometer (AVIRIS), or from satellites like NASA's EO-1 with its hyperspectral instrument Hyperion. [9] [10] However, for many development and validation studies, handheld sensors are used. [11]

The precision of these sensors is typically measured in spectral resolution, which is the width of each band of the spectrum that is captured. If the scanner detects a large number of fairly narrow frequency bands, it is possible to identify objects even if they are only captured in a handful of pixels. However, spatial resolution is a factor in addition to spectral resolution. If the pixels are too large, then multiple objects are captured in the same pixel and become difficult to identify. If the pixels are too small, then the intensity captured by each sensor cell is low, and the decreased signal-to-noise ratio reduces the reliability of measured features.

The acquisition and processing of hyperspectral images is also referred to as imaging spectroscopy or, with reference to the hyperspectral cube, as 3D spectroscopy.

Scanning techniques

Photos illustrating individual sensor outputs for the four hyperspectral imaging techniques. From left to right: Slit spectrum; monochromatic spatial map; 'perspective projection' of hyperspectral cube; wavelength-coded spatial map. Hyperspectral Imaging Techniques.jpg
Photos illustrating individual sensor outputs for the four hyperspectral imaging techniques. From left to right: Slit spectrum; monochromatic spatial map; 'perspective projection' of hyperspectral cube; wavelength-coded spatial map.

There are four basic techniques for acquiring the three-dimensional (x, y, λ) dataset of a hyperspectral cube. The choice of technique depends on the specific application, seeing that each technique has context-dependent advantages and disadvantages.

Spatial scanning

Acquisition techniques for hyperspectral imaging, visualized as sections of the hyperspectral datacube with its two spatial dimensions (x, y) and one spectral dimension (l). AcquisitionTechniques.jpg
Acquisition techniques for hyperspectral imaging, visualized as sections of the hyperspectral datacube with its two spatial dimensions (x, y) and one spectral dimension (λ).

In spatial scanning, each two-dimensional (2D) sensor output represents a full slit spectrum (x, λ). Hyperspectral imaging (HSI) devices for spatial scanning obtain slit spectra by projecting a strip of the scene onto a slit and dispersing the slit image with a prism or a grating. These systems have the drawback of having the image analyzed per lines (with a push broom scanner) and also having some mechanical parts integrated into the optical train. With these line-scan cameras , the spatial dimension is collected through platform movement or scanning. This requires stabilized mounts or accurate pointing information to 'reconstruct' the image. Nonetheless, line-scan systems are particularly common in remote sensing, where it is sensible to use mobile platforms. Line-scan systems are also used to scan materials moving by on a conveyor belt. A special case of line scanning is point scanning (with a whisk broom scanner), where a point-like aperture is used instead of a slit, and the sensor is essentially one-dimensional instead of 2D. [7] [12]

Spectral scanning

In spectral scanning, each 2D sensor output represents a monochromatic (i.e. single wavelength), spatial (x, y)-map of the scene. HSI devices for spectral scanning are typically based on optical band-pass filters (either tunable or fixed). The scene is spectrally scanned by exchanging one filter after another while the platform remains stationary. In such "staring", wavelength scanning systems, spectral smearing can occur if there is movement within the scene, invalidating spectral correlation/detection. Nonetheless, there is the advantage of being able to pick and choose spectral bands, and having a direct representation of the two spatial dimensions of the scene. [6] [7] [12] If the imaging system is used on a moving platform, such as an airplane, acquired images at different wavelengths corresponds to different areas of the scene. The spatial features on each of the images may be used to realign the pixels.

Non-scanning

In non-scanning, a single 2D sensor output contains all spatial (x, y) and spectral (λ) data. HSI devices for non-scanning yield the full datacube at once, without any scanning. Figuratively speaking, a single snapshot represents a perspective projection of the datacube, from which its three-dimensional structure can be reconstructed. [7] [13] The most prominent benefits of these snapshot hyperspectral imaging systems are the snapshot advantage (higher light throughput) and shorter acquisition time. A number of systems have been designed, including computed tomographic imaging spectrometry (CTIS), fiber-reformatting imaging spectrometry (FRIS), integral field spectroscopy with lenslet arrays (IFS-L), multi-aperture integral field spectrometer (Hyperpixel Array), integral field spectroscopy with image slicing mirrors (IFS-S), image-replicating imaging spectrometry (IRIS), filter stack spectral decomposition (FSSD), coded aperture snapshot spectral imaging (CASSI), image mapping spectrometry (IMS), and multispectral Sagnac interferometry (MSI). [14] However, computational effort and manufacturing costs are high. In an effort to reduce the computational demands and potentially the high cost of non-scanning hyperspectral instrumentation, prototype devices based on Multivariate Optical Computing have been demonstrated. These devices have been based on the Multivariate Optical Element [15] [16] spectral calculation engine or the Spatial Light Modulator [17] spectral calculation engine. In these platforms, chemical information is calculated in the optical domain prior to imaging such that the chemical image relies on conventional camera systems with no further computing. As a disadvantage of these systems, no spectral information is ever acquired, i.e. only the chemical information, such that post processing or reanalysis is not possible.

Spatiospectral scanning

In spatiospectral scanning, each 2D sensor output represents a wavelength-coded ("rainbow-colored", λ = λ(y)), spatial (x, y)-map of the scene. A prototype for this technique, introduced in 2014, consists of a camera at some non-zero distance behind a basic slit spectroscope (slit + dispersive element). [8] [18] Advanced spatiospectral scanning systems can be obtained by placing a dispersive element before a spatial scanning system. Scanning can be achieved by moving the whole system relative to the scene, by moving the camera alone, or by moving the slit alone. Spatiospectral scanning unites some advantages of spatial and spectral scanning, thereby alleviating some of their disadvantages. [8]

Distinguishing hyperspectral from multispectral imaging

Multispectral and hyperspectral differences. MultispectralComparedToHyperspectral.jpg
Multispectral and hyperspectral differences.

Hyperspectral imaging is part of a class of techniques commonly referred to as spectral imaging or spectral analysis. The term “hyperspectral imaging” derives from the development of NASA's Airborne Imaging Spectrometer (AIS) and AVIRIS in the mid-1980s. Although NASA prefers the earlier term “imaging spectroscopy” over “hyperspectral imaging,” use of the latter term has become more prevalent in scientific and non-scientific language. In a peer reviewed letter, experts recommend using the terms “imaging spectroscopy” or “spectral imaging” and avoiding exaggerated prefixes such as “hyper-,” “super-” and "ultra-,” to prevent misnomers in discussion. [19]

Hyperspectral imaging is related to multispectral imaging. The distinction between hyper- and multi-band is sometimes based incorrectly on an arbitrary "number of bands" or on the type of measurement. Hyperspectral imaging (HSI) uses continuous and contiguous ranges of wavelengths (e.g. 400 - 1100 nm in steps of 1 nm) whilst multiband imaging (MSI) uses a subset of targeted wavelengths at chosen locations (e.g. 400 - 1100 nm in steps of 20 nm). [20]

Multiband imaging deals with several images at discrete and somewhat narrow bands. Being "discrete and somewhat narrow" is what distinguishes multispectral imaging in the visible wavelength from color photography. A multispectral sensor may have many bands covering the spectrum from the visible to the longwave infrared. Multispectral images do not produce the "spectrum" of an object. Landsat is a prominent practical example of multispectral imaging.

Hyperspectral deals with imaging narrow spectral bands over a continuous spectral range, producing the spectra of all pixels in the scene. A sensor with only 20 bands can also be hyperspectral when it covers the range from 500 to 700 nm with 20 bands each 10 nm wide, while a sensor with 20 discrete bands covering the visible, near, short wave, medium wave and long wave infrared would be considered multispectral.

Ultraspectral could be reserved for interferometer type imaging sensors with a very fine spectral resolution. These sensors often have (but not necessarily) a low spatial resolution of several pixels only, a restriction imposed by the high data rate.

Applications

Hyperspectral remote sensing is used in a wide array of applications. Although originally developed for mining and geology (the ability of hyperspectral imaging to identify various minerals makes it ideal for the mining and oil industries, where it can be used to look for ore and oil), [11] [21] it has now spread into fields as widespread as ecology and surveillance, as well as historical manuscript research, such as the imaging of the Archimedes Palimpsest. This technology is continually becoming more available to the public. Organizations such as NASA and the USGS have catalogues of various minerals and their spectral signatures, and have posted them online to make them readily available for researchers. On a smaller scale, NIR hyperspectral imaging can be used to rapidly monitor the application of pesticides to individual seeds for quality control of the optimum dose and homogeneous coverage.

Agriculture

Hyperspectral camera embedded on OnyxStar HYDRA-12 UAV from AltiGator. Onyxstar HYDRA-12 UAV with embedded hyperspectral camera for agricultural research.jpg
Hyperspectral camera embedded on OnyxStar HYDRA-12 UAV from AltiGator.

Although the cost of acquiring hyperspectral images is typically high for specific crops and in specific climates, hyperspectral remote sensing use is increasing for monitoring the development and health of crops. In Australia, work is under way to use imaging spectrometers to detect grape variety and develop an early warning system for disease outbreaks. [22] Furthermore, work is under way to use hyperspectral data to detect the chemical composition of plants, [23] which can be used to detect the nutrient and water status of wheat in irrigated systems. [24] On a smaller scale, NIR hyperspectral imaging can be used to rapidly monitor the application of pesticides to individual seeds for quality control of the optimum dose and homogeneous coverage. [25]

Another application in agriculture is the detection of animal proteins in compound feeds to avoid bovine spongiform encephalopathy (BSE), also known as mad-cow disease. Different studies have been done to propose alternative tools to the reference method of detection, (classical microscopy). One of the first alternatives is near infrared microscopy (NIR), which combines the advantages of microscopy and NIR. In 2004, the first study relating this problem with hyperspectral imaging was published. [26] Hyperspectral libraries that are representative of the diversity of ingredients usually present in the preparation of compound feeds were constructed. These libraries can be used together with chemometric tools to investigate the limit of detection, specificity and reproducibility of the NIR hyperspectral imaging method for the detection and quantification of animal ingredients in feed.

HSI cameras can also be used to detect stress from heavy metals in plants and become an earlier and faster alternative to post-harvest wet chemical methods. [27] [28]

Zoology

Hyperspectral imaging is also used in zoology; it is used to investigate the spatial distribution of coloration and its extension into the near-infrared and SWIR range of the spectrum. [29] Some animals for example, such as some tropical frogs and certain leaf-sitting insects are highly reflective in the near-infrared. [29] [30]

Waste sorting and recycling

Hyperspectral imaging can provide information about the chemical constituents of materials which makes it useful for waste sorting and recycling. [31] It has been applied to distinguish between substances with different fabrics and to identify natural, animal and synthetic fibers. [32] HSI cameras can be integrated with machine vision systems and, via simplifying platforms, allow end-customers to create new waste sorting applications and other sorting/identification applications. [33] A system of machine learning and hyperspectral camera can distinguish between 12 different types of plastics such as PET and PP for automated separation of waste of, as of 2020, highly unstandardized [34] [ additional citation(s) needed ] plastics products and packaging. [35] [36]

Eye care

Researchers at the Université de Montréal are working with Photon etc. and Optina Diagnostics [37] to test the use of hyperspectral photography in the diagnosis of retinopathy and macular edema before damage to the eye occurs. The metabolic hyperspectral camera will detect a drop in oxygen consumption in the retina, which indicates potential disease. An ophthalmologist will then be able to treat the retina with injections to prevent any potential damage. [38]

Food processing

A line scan push-broom system was used to scan the cheeses and images were acquired using a Hg-Cd-Te array (386x288) equipped linescan camera with halogen light as a radiation source. Hi camera.jpg
A line scan push-broom system was used to scan the cheeses and images were acquired using a Hg-Cd-Te array (386x288) equipped linescan camera with halogen light as a radiation source.

In the food processing industry, hyperspectral imaging, combined with intelligent software, enables digital sorters (also called optical sorters) to identify and remove defects and foreign material (FM) that are invisible to traditional camera and laser sorters. [39] [40] By improving the accuracy of defect and FM removal, the food processor’s objective is to enhance product quality and increase yields.

Adopting hyperspectral imaging on digital sorters achieves non-destructive, 100 percent inspection in-line at full production volumes. The sorter’s software compares the hyperspectral images collected to user-defined accept/reject thresholds, and the ejection system automatically removes defects and foreign material.

Hyperspectral image of "sugar end" potato strips shows invisible defects. Hyperspectral image of "sugar end" potato strips.jpg
Hyperspectral image of "sugar end" potato strips shows invisible defects.

The recent commercial adoption of hyperspectral sensor-based food sorters is most advanced in the nut industry where installed systems maximize the removal of stones, shells and other foreign material (FM) and extraneous vegetable matter (EVM) from walnuts, pecans, almonds, pistachios, peanuts and other nuts. Here, improved product quality, low false reject rates and the ability to handle high incoming defect loads often justify the cost of the technology.

Commercial adoption of hyperspectral sorters is also advancing at a fast pace in the potato processing industry where the technology promises to solve a number of outstanding product quality problems. Work is under way to use hyperspectral imaging to detect “sugar ends,” [41] “hollow heart” [42] and “common scab,” [43] conditions that plague potato processors.

Mineralogy

A set of stones is scanned with a Specim LWIR-C imager in the thermal infrared range from 7.7 mm to 12.4 mm. The quartz and feldspar spectra are clearly recognizable. HSI LWIR stones.png
A set of stones is scanned with a Specim LWIR-C imager in the thermal infrared range from 7.7 μm to 12.4 μm. The quartz and feldspar spectra are clearly recognizable.

Geological samples, such as drill cores, can be rapidly mapped for nearly all minerals of commercial interest with hyperspectral imaging. Fusion of SWIR and LWIR spectral imaging is standard for the detection of minerals in the feldspar, silica, calcite, garnet, and olivine groups, as these minerals have their most distinctive and strongest spectral signature in the LWIR regions. [44]

Hyperspectral remote sensing of minerals is well developed. Many minerals can be identified from airborne images, and their relation to the presence of valuable minerals, such as gold and diamonds, is well understood. Currently, progress is towards understanding the relationship between oil and gas leakages from pipelines and natural wells, and their effects on the vegetation and the spectral signatures. Recent work includes the PhD dissertations of Werff [45] and Noomen. [46]

Surveillance

Hyperspectral thermal infrared emission measurement, an outdoor scan in winter conditions, ambient temperature -15degC--relative radiance spectra from various targets in the image are shown with arrows. The infrared spectra of the different objects such as the watch glass have clearly distinctive characteristics. The contrast level indicates the temperature of the object. This image was produced with a Specim LWIR hyperspectral imager. Specim aisaowl outdoor.png
Hyperspectral thermal infrared emission measurement, an outdoor scan in winter conditions, ambient temperature -15°C—relative radiance spectra from various targets in the image are shown with arrows. The infrared spectra of the different objects such as the watch glass have clearly distinctive characteristics. The contrast level indicates the temperature of the object. This image was produced with a Specim LWIR hyperspectral imager.

Hyperspectral surveillance is the implementation of hyperspectral scanning technology for surveillance purposes. Hyperspectral imaging is particularly useful in military surveillance because of countermeasures that military entities now take to avoid airborne surveillance. The idea that drives hyperspectral surveillance is that hyperspectral scanning draws information from such a large portion of the light spectrum that any given object should have a unique spectral signature in at least a few of the many bands that are scanned. Hyperspectral imaging has also shown potential to be used in facial recognition purposes. Facial recognition algorithms using hyperspectral imaging have been shown to perform better than algorithms using traditional imaging. [47]

Traditionally, commercially available thermal infrared hyperspectral imaging systems have needed liquid nitrogen or helium cooling, which has made them impractical for most surveillance applications. In 2010, Specim introduced a thermal infrared hyperspectral camera that can be used for outdoor surveillance and UAV applications without an external light source such as the sun or the moon. [48] [49]

Astronomy

In astronomy, hyperspectral imaging is used to determine a spatially-resolved spectral image. Since a spectrum is an important diagnostic, having a spectrum for each pixel allows more science cases to be addressed. In astronomy, this technique is commonly referred to as integral field spectroscopy, and examples of this technique include FLAMES [50] and SINFONI [51] on the Very Large Telescope, but also the Advanced CCD Imaging Spectrometer on Chandra X-ray Observatory uses this technique.

Remote chemical imaging of a simultaneous release of SF6 and NH3 at 1.5 km using the Telops Hyper-Cam imaging spectrometer. FIRST measurement of SF6 and NH3.jpg
Remote chemical imaging of a simultaneous release of SF6 and NH3 at 1.5 km using the Telops Hyper-Cam imaging spectrometer.

Chemical imaging

Soldiers can be exposed to a wide variety of chemical hazards. These threats are mostly invisible but detectable by hyperspectral imaging technology. The Telops Hyper-Cam, introduced in 2005, has demonstrated this at distances up to 5 km. [53]

Environment

Top panel: Contour map of the time-averaged spectral radiance at 2078 cm corresponding to a CO2 emission line. Bottom panel: Contour map of the spectral radiance at 2580 cm corresponding to continuum emission from particulates in the plume. The translucent gray rectangle indicates the position of the stack. The horizontal line at row 12 between columns 64-128 indicate the pixels used to estimate the background spectrum. Measurements made with the Telops Hyper-Cam. Hyper-Cam smokestack.png
Top panel: Contour map of the time-averaged spectral radiance at 2078 cm corresponding to a CO2 emission line. Bottom panel: Contour map of the spectral radiance at 2580 cm corresponding to continuum emission from particulates in the plume. The translucent gray rectangle indicates the position of the stack. The horizontal line at row 12 between columns 64-128 indicate the pixels used to estimate the background spectrum. Measurements made with the Telops Hyper-Cam.

Most countries require continuous monitoring of emissions produced by coal and oil-fired power plants, municipal and hazardous waste incinerators, cement plants, as well as many other types of industrial sources. This monitoring is usually performed using extractive sampling systems coupled with infrared spectroscopy techniques. Some recent standoff measurements performed allowed the evaluation of the air quality but not many remote independent methods allow for low uncertainty measurements.

Civil engineering

Recent research indicates that hyperspectral imaging may be useful to detect the development of cracks in pavements [55] which are hard to detect from images taken with visible spectrum cameras. [55]

Biomedical imaging

Hyperspectral imaging has also been used to detect cancer, identify nerves and analyze bruises. [56]

Advantages and disadvantages

The primary advantage to hyperspectral imaging is that, because an entire spectrum is acquired at each point, the operator needs no prior knowledge of the sample, and postprocessing allows all available information from the dataset to be mined. Hyperspectral imaging can also take advantage of the spatial relationships among the different spectra in a neighbourhood, allowing more elaborate spectral-spatial models for a more accurate segmentation and classification of the image. [57] [58]

The primary disadvantages are cost and complexity. Fast computers, sensitive detectors, and large data storage capacities are needed for analyzing hyperspectral data. Significant data storage capacity is necessary since uncompressed hyperspectral cubes are large, multidimensional datasets, potentially exceeding hundreds of megabytes. All of these factors greatly increase the cost of acquiring and processing hyperspectral data. Also, one of the hurdles researchers have had to face is finding ways to program hyperspectral satellites to sort through data on their own and transmit only the most important images, as both transmission and storage of that much data could prove difficult and costly. [9] As a relatively new analytical technique, the full potential of hyperspectral imaging has not yet been realized.

See also

Related Research Articles

<span class="mw-page-title-main">Optical spectrometer</span> Instrument to measure the properties of visible light

An optical spectrometer is an instrument used to measure properties of light over a specific portion of the electromagnetic spectrum, typically used in spectroscopic analysis to identify materials. The variable measured is most often the irradiance of the light but could also, for instance, be the polarization state. The independent variable is usually the wavelength of the light or a closely derived physical quantity, such as the corresponding wavenumber or the photon energy, in units of measurement such as centimeters, reciprocal centimeters, or electron volts, respectively.

<span class="mw-page-title-main">Remote sensing</span> Acquisition of information at a significant distance from the subject

Remote sensing is the acquisition of information about an object or phenomenon without making physical contact with the object, in contrast to in situ or on-site observation. The term is applied especially to acquiring information about Earth and other planets. Remote sensing is used in numerous fields, including geophysics, geography, land surveying and most Earth science disciplines. It also has military, intelligence, commercial, economic, planning, and humanitarian applications, among others.

<span class="mw-page-title-main">Thermography</span> Infrared imaging used to reveal temperature

Infrared thermography (IRT), thermal video or thermal imaging, is a process where a thermal camera captures and creates an image of an object by using infrared radiation emitted from the object in a process, which are examples of infrared imaging science. Thermographic cameras usually detect radiation in the long-infrared range of the electromagnetic spectrum and produce images of that radiation, called thermograms. Since infrared radiation is emitted by all objects with a temperature above absolute zero according to the black body radiation law, thermography makes it possible to see one's environment with or without visible illumination. The amount of radiation emitted by an object increases with temperature; therefore, thermography allows one to see variations in temperature. When viewed through a thermal imaging camera, warm objects stand out well against cooler backgrounds; humans and other warm-blooded animals become easily visible against the environment, day or night. As a result, thermography is particularly useful to the military and other users of surveillance cameras.

Measurement and signature intelligence (MASINT) is a technical branch of intelligence gathering, which serves to detect, track, identify or describe the distinctive characteristics (signatures) of fixed or dynamic target sources. This often includes radar intelligence, acoustic intelligence, nuclear intelligence, and chemical and biological intelligence. MASINT is defined as scientific and technical intelligence derived from the analysis of data obtained from sensing instruments for the purpose of identifying any distinctive features associated with the source, emitter or sender, to facilitate the latter's measurement and identification.

<span class="mw-page-title-main">Spectral signature</span> Variation of reflectance or emittance of a material with respect to wavelengths

Spectral signature is the variation of reflectance or emittance of a material with respect to wavelengths. The spectral signature of stars indicates the composition of the stellar atmosphere. The spectral signature of an object is a function of the incidental EM wavelength and material interaction with that section of the electromagnetic spectrum.

<span class="mw-page-title-main">Multispectral imaging</span> Capturing image data across multiple electromagnetic spectrum ranges

Multispectral imaging captures image data within specific wavelength ranges across the electromagnetic spectrum. The wavelengths may be separated by filters or detected with the use of instruments that are sensitive to particular wavelengths, including light from frequencies beyond the visible light range. It can allow extraction of additional information the human eye fails to capture with its visible receptors for red, green and blue. It was originally developed for military target identification and reconnaissance. Early space-based imaging platforms incorporated multispectral imaging technology to map details of the Earth related to coastal boundaries, vegetation, and landforms. Multispectral imaging has also found use in document and painting analysis.

Spectral imaging is imaging that uses multiple bands across the electromagnetic spectrum. While an ordinary camera captures light across three wavelength bands in the visible spectrum, red, green, and blue (RGB), spectral imaging encompasses a wide variety of techniques that go beyond RGB. Spectral imaging may use the infrared, the visible spectrum, the ultraviolet, x-rays, or some combination of the above. It may include the acquisition of image data in visible and non-visible bands simultaneously, illumination from outside the visible range, or the use of optical filters to capture a specific spectral range. It is also possible to capture hundreds of wavelength bands for each pixel in an image.

A staring array, also known as staring-plane array or focal-plane array (FPA), is an image sensor consisting of an array of light-sensing pixels at the focal plane of a lens. FPAs are used most commonly for imaging purposes, but can also be used for non-imaging purposes such as spectrometry, LIDAR, and wave-front sensing.

<span class="mw-page-title-main">Imaging spectrometer</span>

An imaging spectrometer is an instrument used in hyperspectral imaging and imaging spectroscopy to acquire a spectrally-resolved image of an object or scene, usually to support analysis of the composition the object being imaged. The spectral data produced for a pixel is often referred to as a datacube due to the three-dimensional representation of the data. Two axes of the image correspond to vertical and horizontal distance and the third to wavelength. The principle of operation is the same as that of the simple spectrometer, but special care is taken to avoid optical aberrations for better image quality.

Chemical imaging is the analytical capability to create a visual image of components distribution from simultaneous measurement of spectra and spatial, time information. Hyperspectral imaging measures contiguous spectral bands, as opposed to multispectral imaging which measures spaced spectral bands.

<span class="mw-page-title-main">Airborne Real-time Cueing Hyperspectral Enhanced Reconnaissance</span> Aerial imaging system

Airborne Real-time Cueing Hyperspectral Enhanced Reconnaissance, also known by the acronym ARCHER, is an aerial imaging system that produces ground images far more detailed than plain sight or ordinary aerial photography can. It is the most sophisticated unclassified hyperspectral imaging system available, according to U.S. Government officials. ARCHER can automatically scan detailed imaging for a given signature of the object being sought, for abnormalities in the surrounding area, or for changes from previous recorded spectral signatures.

Electro-optical MASINT is a subdiscipline of Measurement and Signature Intelligence, (MASINT) and refers to intelligence gathering activities which bring together disparate elements that do not fit within the definitions of Signals Intelligence (SIGINT), Imagery Intelligence (IMINT), or Human Intelligence (HUMINT).

<span class="mw-page-title-main">Full-spectrum photography</span> Photography capturing visible and near-infrared light

Full-spectrum photography is a subset of multispectral imaging, defined among photography enthusiasts as imaging with consumer cameras the full, broad spectrum of a film or camera sensor bandwidth. In practice, specialized broadband/full-spectrum film captures visible and near infrared light, commonly referred to as the "VNIR".

Optical sorting is the automated process of sorting solid products using cameras and/or lasers.

<span class="mw-page-title-main">Integral field spectrograph</span> Spectrograph equipped with an integral field unit

Integral field spectrographs (IFS) combine spectrographic and imaging capabilities in the optical or infrared wavelength domains (0.32 μm – 24 μm) to get from a single exposure spatially resolved spectra in a bi-dimensional region. The name originates from the fact that the measurements result from integrating the light on multiple sub-regions of the field. Developed at first for the study of astronomical objects, this technique is now also used in many other fields, such bio-medical science and Earth remote sensing. Integral field spectrography is part of the broader category of snapshot hyperspectral imaging techniques, itself a part of hyperspectral imaging.

<span class="mw-page-title-main">Snapshot hyperspectral imaging</span> Method for capturing hyperspectral images

Snapshot hyperspectral imaging is a method for capturing hyperspectral images during a single integration time of a detector array. No scanning is involved with this method, in contrast to push broom and whisk broom scanning techniques. The lack of moving parts means that motion artifacts should be avoided. This instrument typically features detector arrays with a high number of pixels.

Photon etc. is a Canadian manufacturer of infrared cameras, widely tunable optical filters, hyperspectral imaging and spectroscopic scientific instruments for academic and industrial applications. Its main technology is based on volume Bragg gratings, which are used as filters either for swept lasers or for global imaging.

<span class="mw-page-title-main">Gaofen</span> Chinese satellites

Gaofen is a series of Chinese high-resolution Earth imaging satellites launched as part of the China High-resolution Earth Observation System (CHEOS) program. CHEOS is a state-sponsored, civilian Earth-observation program used for agricultural, disaster, resource, and environmental monitoring. Proposed in 2006 and approved in 2010, the CHEOS program consists of the Gaofen series of space-based satellites, near-space and airborne systems such as airships and UAVs, ground systems that conduct data receipt, processing, calibration, and taskings, and a system of applications that fuse observation data with other sources to produce usable information and knowledge.

<span class="mw-page-title-main">Remote sensing in geology</span> Data acquisition method for earth sciences

Remote sensing is used in the geological sciences as a data acquisition method complementary to field observation, because it allows mapping of geological characteristics of regions without physical contact with the areas being explored. About one-fourth of the Earth's total surface area is exposed land where information is ready to be extracted from detailed earth observation via remote sensing. Remote sensing is conducted via detection of electromagnetic radiation by sensors. The radiation can be naturally sourced, or produced by machines and reflected off of the Earth surface. The electromagnetic radiation acts as an information carrier for two main variables. First, the intensities of reflectance at different wavelengths are detected, and plotted on a spectral reflectance curve. This spectral fingerprint is governed by the physio-chemical properties of the surface of the target object and therefore helps mineral identification and hence geological mapping, for example by hyperspectral imaging. Second, the two-way travel time of radiation from and back to the sensor can calculate the distance in active remote sensing systems, for example, Interferometric synthetic-aperture radar. This helps geomorphological studies of ground motion, and thus can illuminate deformations associated with landslides, earthquakes, etc.

<span class="mw-page-title-main">Spectroradiometry for Earth and planetary remote sensing</span>

Spectroradiometry is a technique in Earth and planetary remote sensing, which makes use of light behaviour, specifically how light energy is reflected, emitted, and scattered by substances, to explore their properties in the electromagnetic (light) spectrum and identify or differentiate between them. The interaction between light radiation and the surface of a given material determines the manner in which the radiation reflects back to a detector, i.e., a spectroradiometer. Combining the elements of spectroscopy and radiometry, spectroradiometry carries out precise measurements of electromagnetic radiation and associated parameters within different wavelength ranges. This technique forms the basis of multi- and hyperspectral imaging and reflectance spectroscopy, commonly applied across numerous geoscience disciplines, which evaluates the spectral properties exhibited by various materials found on Earth and planetary bodies.

References

  1. Chilton, Alexander (2013-10-07). "The Working Principle and Key Applications of Infrared Sensors". AZoSensors. Retrieved 2020-07-11.
  2. Chein-I Chang (31 July 2003). Hyperspectral Imaging: Techniques for Spectral Detection and Classification. Springer Science & Business Media. ISBN   978-0-306-47483-5.
  3. Hans Grahn; Paul Geladi (27 September 2007). Techniques and Applications of Hyperspectral Image Analysis. John Wiley & Sons. ISBN   978-0-470-01087-7.
  4. Hagen, Nathan; Kudenov, Michael W. (2013). "Review of snapshot spectral imaging technologies" (PDF). Optical Engineering. 52 (9): 090901. Bibcode:2013OptEn..52i0901H. doi: 10.1117/1.OE.52.9.090901 . S2CID   215807781.
  5. 1 2 Lu, G; Fei, B (January 2014). "Medical Hyperspectral Imaging: a review". Journal of Biomedical Optics . 19 (1): 10901. Bibcode:2014JBO....19a0901L. doi:10.1117/1.JBO.19.1.010901. PMC   3895860 . PMID   24441941.
  6. 1 2 "Spectral Imaging and Linear Unmixing". Nikon’s MicroscopyU.
  7. 1 2 3 4 http://www.bodkindesign.com/wp-content/uploads/2012/09/Hyperspectral-1011.pdf [ bare URL PDF ]
  8. 1 2 3 Grusche, Sascha (2014). "OSA – Basic slit spectroscope reveals three-dimensional scenes through diagonal slices of hyperspectral cubes". Applied Optics. 53 (20): 4594–5103. Bibcode:2014ApOpt..53.4594G. doi:10.1364/AO.53.004594. PMID   25090082.
  9. 1 2 Schurmer, J.H., (Dec 2003), Air Force Research Laboratories Technology Horizons
  10. "Earth Observing 1 (EO-1)". earthobservatory.nasa.gov. 2000-11-15. Retrieved 2020-07-17.
  11. 1 2 Ellis, J., (Jan 2001) Searching for oil seeps and oil-impacted soil with hyperspectral imagery Archived 2008-03-05 at the Wayback Machine , Earth Observation Magazine.
  12. 1 2 Lu, Guolan; Fei, Baowei (2014). "SPIE – Journal of Biomedical Optics – Medical hyperspectral imaging: a review". Journal of Biomedical Optics. 19 (1): 010901. Bibcode:2014JBO....19a0901L. doi:10.1117/1.JBO.19.1.010901. PMC   3895860 . PMID   24441941.
  13. "StackPath". www.laserfocusworld.com. Archived from the original on 2019-10-10. Retrieved 2021-08-20.
  14. Hagen, Nathan; Kester, Robert T.; Gao, Liang; Tkaczyk, Tomasz S. (2012). "SPIE – Optical Engineering – Snapshot advantage: a review of the light collection improvement for parallel high-dimensional measurement systems". Optical Engineering. 51 (11): 111702. Bibcode:2012OptEn..51k1702H. doi:10.1117/1.OE.51.11.111702. PMC   3393130 . PMID   22791926.
  15. Myrick, Michael L.; Soyemi, Olusola O.; Haibach, Fred; Zhang, Lixia; Greer, Ashley; Li, Hongli; Priore, Ryan; Schiza, Maria V.; Farr, J. R. (2002-02-22). Christesen, Steven D; Sedlacek Iii, Arthur J (eds.). "Application of multivariate optical computing to near-infrared imaging". Vibrational Spectroscopy-Based Sensor Systems. 4577: 148–158. Bibcode:2002SPIE.4577..148M. doi:10.1117/12.455732. S2CID   109007082.
  16. J Priore, Ryan; Haibach, Frederick; V Schiza, Maria; E Greer, Ashley; L Perkins, David; Myrick, M.L. (2004-08-01). "Miniature Stereo Spectral Imaging System for Multivariate Optical Computing". Applied Spectroscopy. 58 (7): 870–3. Bibcode:2004ApSpe..58..870P. doi:10.1366/0003702041389418. PMID   15282055. S2CID   39015203.
  17. Davis, Brandon M.; Hemphill, Amanda J.; Cebeci Maltaş, Derya; Zipper, Michael A.; Wang, Ping; Ben-Amotz, Dor (2011-07-01). "Multivariate Hyperspectral Raman Imaging Using Compressive Detection". Analytical Chemistry. 83 (13): 5086–5092. doi:10.1021/ac103259v. ISSN   0003-2700. PMID   21604741.
  18. Hyperspectral imaging with spatiospectral images from a simple spectroscope. 12 July 2014. Archived from the original on 2021-12-19 via YouTube.
  19. Polder, Gerrit; Gowen, Aoife (27 February 2020). "The hype in spectral imaging". Journal of Spectral Imaging. 9: a4. doi: 10.1255/jsi.2020.a4 (inactive 2024-09-06). S2CID   213347436 . Retrieved 23 July 2021.{{cite journal}}: CS1 maint: DOI inactive as of September 2024 (link)
  20. CM Veys; et al. (2017). "An Ultra-Low-Cost Active Multispectral Crop Diagnostics Device" (PDF). IEEE Sensors Journal. 113: 1005–1007.
  21. Smith, R.B. (July 14, 2006), Introduction to hyperspectral imaging with TMIPS Archived 2008-05-09 at the Wayback Machine , MicroImages Tutorial Web site
  22. Lacar, F.M.; et al. (2001). "Use of hyperspectral imagery for mapping grape varieties in the Barossa Valley, South Australia". IGARSS 2001. Scanning the Present and Resolving the Future. Proceedings. IEEE 2001 International Geoscience and Remote Sensing Symposium (Cat. No.01CH37217). Vol. 6. pp. 2875–2877. doi:10.1109/IGARSS.2001.978191. hdl:2440/39292. ISBN   0-7803-7031-7. S2CID   61008168.
  23. Ferwerda, J.G. (2005), Charting the quality of forage: measuring and mapping the variation of chemical components in foliage with hyperspectral remote sensing , Wageningen University, ITC Dissertation 126, 166p. ISBN   90-8504-209-7
  24. Tilling, A.K., et al., (2006) Remote sensing to detect nitrogen and water stress in wheat , The Australian Society of Agronomy
  25. Vermeulen, Ph.; et al. (2017). "Assessment of pesticide coating on cereal seeds by near infrared hyperspectral imaging". Journal of Spectral Imaging. 6: a1. doi: 10.1255/jsi.2017.a1 (inactive 2024-09-06).{{cite journal}}: CS1 maint: DOI inactive as of September 2024 (link)
  26. Fernández Pierna, J.A., et al., 'Combination of Support Vector Machines (SVM) and Near Infrared (NIR) imaging spectroscopy for the detection of meat and bone meat (MBM) in compound feeds' Journal of Chemometrics 18 (2004) 341-349
  27. Gardner, Elizabeth K. "Study finds that heavy metal-contaminated leafy greens turn purple". Purdue University. Retrieved 26 January 2022.
  28. Zea, Maria; Souza, Augusto; Yang, Yang; Lee, Linda; Nemali, Krishna; Hoagland, Lori (1 January 2022). "Leveraging high-throughput hyperspectral imaging technology to detect cadmium stress in two leafy green crops and accelerate soil remediation efforts". Environmental Pollution. 292 (Pt B): 118405. Bibcode:2022EPoll.29218405Z. doi: 10.1016/j.envpol.2021.118405 . ISSN   0269-7491. PMID   34710518. S2CID   239975631.
  29. 1 2 Francisco Pinto, Michael Mielewczik, Frank Liebisch, Achim Walter, Hartmut Greven, Uwe Rascher (2013), "Non-Invasive Measurement of Frog Skin Reflectivity in High Spatial Resolution Using a Dual Hyperspectral Approach.", PLOS ONE, vol. 8, no. 9, pp. e73234, Bibcode:2013PLoSO...873234P, doi: 10.1371/journal.pone.0073234 , hdl: 20.500.11850/76533 , PMC   3776832 , PMID   24058464 {{citation}}: CS1 maint: multiple names: authors list (link)
  30. Mielewczik, Michael; Liebisch, Frank; Walter, Achim; Greven, Hartmut. "Near-infrared (NIR)-reflectance in insects–Phenetic studies of 181 species". Entomologie Heute. 24: 183–215.
  31. Karaca, Ali Can; Erturk, Alp; Gullu, M. Kemal; Elmas, M.; Erturk, Sarp (June 2013). "Automatic waste sorting using shortwave infrared hyperspectral imaging system". 2013 5th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS). pp. 1–4. doi:10.1109/WHISPERS.2013.8080744. ISBN   978-1-5090-1119-3. S2CID   37092593.
  32. Brunn, Michael (1 September 2020). "Hyperspectral imaging reducing textile waste". RECYCLING magazine. Retrieved 26 January 2022.
  33. "Specim launches complete spectral imaging platform for the sorting industry". optics.org. Retrieved 26 January 2022.
  34. Qureshi, Muhammad Saad; Oasmaa, Anja; Pihkola, Hanna; Deviatkin, Ivan; Tenhunen, Anna; Mannila, Juha; Minkkinen, Hannu; Pohjakallio, Maija; Laine-Ylijoki, Jutta (1 November 2020). "Pyrolysis of plastic waste: Opportunities and challenges". Journal of Analytical and Applied Pyrolysis. 152: 104804. Bibcode:2020JAAP..15204804Q. doi:10.1016/j.jaap.2020.104804. ISSN   0165-2370. S2CID   200068035.
  35. "Breakthrough in separating plastic waste: Machines can now distinguish 12 different types of plastic". Aarhus University. Retrieved 19 January 2022.
  36. Henriksen, Martin L.; Karlsen, Celine B.; Klarskov, Pernille; Hinge, Mogens (1 January 2022). "Plastic classification via in-line hyperspectral camera analysis and unsupervised machine learning". Vibrational Spectroscopy. 118: 103329. doi: 10.1016/j.vibspec.2021.103329 . ISSN   0924-2031. S2CID   244913832.
  37. "Home". Optina.
  38. AM Shahidi; et al. (2013). "Regional variation in human retinal vessel oxygen saturation". Experimental Eye Research. 113: 143–147. doi:10.1016/j.exer.2013.06.001. PMID   23791637.
  39. Higgins, Kevin. "Five New Technologies for Inspection". Food Processing. Archived from the original on 15 August 2013. Retrieved 6 September 2013.
  40. "Hyperspectral Imaging Fights Food Waste". www.photonics.com. Retrieved 26 January 2022.
  41. Burgstaller, Markus; et al. (February 2012). "Spotlight: Spectral Imaging Sorts 'Sugar-End' Defects". PennWell.
  42. Dacal-Nieto, Angel; et al. (2011). Non-Destructive Detection of Hollow Heart in Potatoes Using Hyperspectral Imaging (PDF). Springer. pp. 180–187. ISBN   978-3-642-23677-8. Archived from the original (PDF) on 2014-08-10.
  43. Dacal-Nieto, Angel; et al. (2011). "Common Scab Detection on Potatoes Using an Infrared Hyperspectral Imaging System". Image Analysis and Processing – ICIAP 2011. Lecture Notes in Computer Science. Vol. 6979. pp. 303–312. doi:10.1007/978-3-642-24088-1_32. ISBN   978-3-642-24087-4.
  44. 1 2 3 Holma, H., (May 2011), Thermische Hyperspektralbildgebung im langwelligen Infrarot Archived July 26, 2011, at the Wayback Machine , Photonik
  45. Werff H. (2006), Knowledge based remote sensing of complex objects: recognition of spectral and spatial patterns resulting from natural hydrocarbon seepages , Utrecht University, ITC Dissertation 131, 138p. ISBN   90-6164-238-8
  46. Noomen, M.F. (2007), Hyperspectral reflectance of vegetation affected by underground hydrocarbon gas seepage , Enschede, ITC 151p. ISBN   978-90-8504-671-4.
  47. "Studies on Hyperspectral Face Recognition in Visible Spectrum With Feature Band Selection - IEEE Journals & Magazine". CiteSeerX   10.1.1.413.3801 . doi:10.1109/TSMCA.2010.2052603. S2CID   18058981.{{cite journal}}: Cite journal requires |journal= (help)
  48. Frost & Sullivan (Feb 2011). Technical Insights, Aerospace & Defence: World First Thermal Hyperspectral Camera for Unmanned Aerial Vehicles.
  49. Specim's Owl sees an invisible object and identifies its materials even in a pitch-dark night. Archived 2011-02-21 at the Wayback Machine .
  50. "FLAMES – Fibre Large Array Multi Element Spectrograph". ESO. Retrieved 30 November 2012.
  51. "SINFONI – Spectrograph for INtegral Field Observations in the Near Infrared". ESO. Retrieved 30 November 2012.
  52. M. Chamberland, V. Farley, A. Vallières, L. Belhumeur, A. Villemaire, J. Giroux et J. Legault, "High-Performance Field-Portable Imaging Radiometric Spectrometer Technology For Hyperspectral imaging Applications," Proc. SPIE 5994, 59940N, September 2005.
  53. Farley, V., Chamberland, M., Lagueux, P., et al., "Chemical agent detection and identification with a hyperspectral imaging infrared sensor," Archived 2012-07-13 at archive.today Proceedings of SPIE Vol. 6661, 66610L (2007).
  54. Gross, Kevin C.; Bradley, Kenneth C.; Perram, Glen P. (2010). "Remote Identification and Quantification of Industrial Smokestack Effluents via Imaging Fourier-Transform Spectroscopy". Environmental Science & Technology. 44 (24): 9390–9397. Bibcode:2010EnST...44.9390G. doi:10.1021/es101823z. PMID   21069951.
  55. 1 2 Abdellatif, Mohamed; Peel, Harriet; Cohn, Anthony G.; Fuentes, Raul (2020). "Pavement Crack Detection from Hyperspectral Images Using a Novel Asphalt Crack Index". Remote Sensing. 12 (18): 3084. Bibcode:2020RemS...12.3084A. doi: 10.3390/rs12183084 .
  56. Lu, Guolan; Fei, Baowei (2014). "Medical hyperspectral imaging: a review". Journal of Biomedical Optics. 19 (1): 010901. Bibcode:2014JBO....19a0901L. doi:10.1117/1.JBO.19.1.010901. ISSN   1083-3668. PMC   3895860 . PMID   24441941.
  57. A. Picon, O. Ghita, P.F. Whelan, P. Iriondo (2009), Spectral and Spatial Feature Integration for Classification of Non-ferrous Materials in Hyper-spectral Data , IEEE Transactions on Industrial Informatics, Vol. 5, N° 4, November 2009.
  58. Ran, Lingyan; Zhang, Yanning; Wei, Wei; Zhang, Qilin (2017-10-23). "A Hyperspectral Image Classification Framework with Spatial Pixel Pair Features". Sensors. 17 (10): 2421. Bibcode:2017Senso..17.2421R. doi: 10.3390/s17102421 . PMC   5677443 . PMID   29065535.