Angle–sensitive pixel

Last updated

An angle-sensitive pixel (ASP) is a light sensor made entirely in CMOS with a sensitivity to incoming light that is sinusoidal in incident angle. [1]

Contents

Principles of operation

Simulation of light interacting with an ASP. Light from a range of incident angles (arrows at top) is refracted by the SiO2 surface and interacts with the top diffraction grating. Metals (made from intrinsic CMOS interconnects, shown in black) create a top and a bottom grating. The top grating creates a Talbot pattern at the depth of the bottom grating, which lines up with either opaque metal or transparent gap in the lower, analyzer grating, depending on incident angle. A large photodiode below measures the light flux through the analyzer grating, which is a sinusoidal function of incident angle. EM Simulation of Light Interacting with an ASP.gif
Simulation of light interacting with an ASP. Light from a range of incident angles (arrows at top) is refracted by the SiO2 surface and interacts with the top diffraction grating. Metals (made from intrinsic CMOS interconnects, shown in black) create a top and a bottom grating. The top grating creates a Talbot pattern at the depth of the bottom grating, which lines up with either opaque metal or transparent gap in the lower, analyzer grating, depending on incident angle. A large photodiode below measures the light flux through the analyzer grating, which is a sinusoidal function of incident angle.

ASPs are typically composed of two gratings (a diffraction grating and an analyzer grating) above a single photodiode. ASPs exploit the moire effect and the Talbot effect to gain their sinusoidal light sensitivity. According to the moire effect, if light acted as a particle, at certain incident angles the gaps in the diffraction and analyzer gratings line up, while at other incident angles light passed by the diffraction grating is blocked by the analyzer grating. The amount of light reaching the photodiode would be proportional to a sinusoidal function of incident angle, as the two gratings come in and out of phase with each other with shifting incident angle. The wave nature of light becomes important at small scales such as those in ASPs, meaning a pure-moire model of ASP function is insufficient. However, at half-integer multiples of the Talbot depth, the periodicity of the diffraction grating is recapitulated, and the moire effect is rescued. By building ASPs where the vertical separation between the gratings is approximately equal to a half-integer multiple of the Talbot depth, the sinusoidal sensitivity with incident angle is observed.

Applications

ASPs can be used in miniature imaging devices. They do not require any focusing elements to achieve sinusoidal incident angle sensitivity, meaning that they can be deployed without a lens to image the near field, or the far field using a Fourier-complete planar Fourier capture array. They can also be used in conjunction with a lens, in which case they perform a depth-sensitive, physics-based wavelet transform of the far-away scene, allowing single-lens 3D photography [2] similar to that of the Lytro camera.

See also

Related Research Articles

Diffraction refers to various phenomena that occur when a wave encounters an obstacle or a slit

Diffraction refers to various phenomena that occur when a wave encounters an obstacle or a slit. It is defined as the bending of waves around the corners of an obstacle or through an aperture into the region of geometrical shadow of the obstacle/aperture. The diffracting object or aperture effectively becomes a secondary source of the propagating wave. Italian scientist Francesco Maria Grimaldi coined the word "diffraction" and was the first to record accurate observations of the phenomenon in 1660.

Diffraction grating optical component which splits light into several beams

In optics, a diffraction grating is an optical component with a periodic structure that splits and diffracts light into several beams travelling in different directions. The emerging coloration is a form of structural coloration. The directions of these beams depend on the spacing of the grating and the wavelength of the light so that the grating acts as the dispersive element. Because of this, gratings are commonly used in monochromators and spectrometers.

Photodiode type of photodetector based on a p–n junction

A photodiode is a semiconductor device that converts light into an electrical current. The current is generated when photons are absorbed in the photodiode. Photodiodes may contain optical filters, built-in lenses, and may have large or small surface areas. Photodiodes usually have a slower response time as their surface area increases. The common, traditional solar cell used to generate electric solar power is a large area photodiode.

Optics is the branch of physics which involves the behavior and properties of light, including its interactions with matter and the construction of instruments that use or detect it. Optics usually describes the behavior of visible, ultraviolet, and infrared light. Because light is an electromagnetic wave, other forms of electromagnetic radiation such as X-rays, microwaves, and radio waves exhibit similar properties.

The Foveon X3 sensor is an image sensor for use in digital cameras, designed by Foveon, Inc. and manufactured by Dongbu Electronics. It uses an array of photosites, each of which consists of three vertically stacked photodiodes, organized in a two-dimensional grid. Because different wavelengths of light penetrate silicon to different depths, each of the three stacked photodiodes has a different spectral sensitivity curve, allowing it to respond to different wavelengths of light. The signals from the three photodiodes are then processed, resulting in additive data for the three primary colors: red, green, and blue.

Grating famework of spaced bars that are parallel to or cross each other

A grating is any regularly spaced collection of essentially identical, parallel, elongated elements. Gratings usually consist of a single set of elongated elements, but can consist of two sets, in which case the second set is usually perpendicular to the first. When the two sets are perpendicular, this is also known as a grid or a mesh.

Bayer filter color filter array for arranging RGB color filters on a square grid of photosensors

A Bayer filter mosaic is a color filter array (CFA) for arranging RGB color filters on a square grid of photosensors. Its particular arrangement of color filters is used in most single-chip digital image sensors used in digital cameras, camcorders, and scanners to create a color image. The filter pattern is 50% green, 25% red and 25% blue, hence is also called BGGR,RGBG, GRGB, or RGGB.

In optics, the Fraunhofer diffraction equation is used to model the diffraction of waves when the diffraction pattern is viewed at a long distance from the diffracting object, and also when it is viewed at the focal plane of an imaging lens. In contrast, the diffraction pattern created near the object, in the near field region, is given by the Fresnel diffraction equation.

Vignetting reduction of an images brightness or saturation toward the periphery compared to the image center

In photography and optics, vignetting (; French: vignette) is a reduction of an image's brightness or saturation toward the periphery compared to the image center. The word vignette, from the same root as vine, originally referred to a decorative border in a book. Later, the word came to be used for a photographic portrait that is clear at the center and fades off toward the edges. A similar effect is visible in photographs of projected images or videos off a projection screen, resulting in a so-called "hotspot" effect.

A spectroradiometer is a light measurement tool that is able to measure both the wavelength and amplitude of the light emitted from a light source. Spectrometers discriminate the wavelength based on the position the light hits at the detector array allowing the full spectrum to be obtained with a single acquisition. Most spectrometers have a base measurement of counts which is the un-calibrated reading and is thus impacted by the sensitivity of the detector to each wavelength. By applying a calibration, the spectrometer is then able to provide measurements of spectral irradiance, spectral radiance and/or spectral flux. This data is also then used with built in or PC software and numerous algorithms to provide readings or Irradiance (W/cm2), Illuminance, Radiance (W/sr), Luminance (cd), Flux, Chromaticity, Color Temperature, Peak and Dominant Wavelength. Some more complex spectrometer software packages also allow calculation of PAR µmol/m²/s, Metamerism, and candela calculations based on distance and include features like 2- and 20-degree observer, baseline overlay comparisons, transmission and reflectance.

Photodetector sensors of light or other electromagnetic energy

Photodetectors, also called photosensors, are sensors of light or other electromagnetic radiation. A photo detector has a p–n junction that converts light photons into current. The absorbed photons make electron–hole pairs in the depletion region. Photodiodes and photo transistors are a few examples of photo detectors. Solar cells convert some of the light energy absorbed into electrical energy.

The science of photography refers to the use of science, such as chemistry and physics, in all aspects of photography. This applies to the camera, its lenses, physical operation of the camera, electronic camera internals, and the process of developing film in order to take and develop pictures properly.

Image sensor device that converts an optical image into an electronic signal

An image sensor or imager is a sensor that detects and conveys information used to make an image. It does so by converting the variable attenuation of light waves into signals, small bursts of current that convey the information. The waves can be light or other electromagnetic radiation. Image sensors are used in electronic imaging devices of both analog and digital types, which include digital cameras, camera modules, camera phones, optical mouse devices, medical imaging equipment, night vision equipment such as thermal imaging devices, radar, sonar, and others. As technology changes, electronic and digital imaging tends to replace chemical and analog imaging.

Active-pixel sensor image sensor consisting of an integrated circuit

An active-pixel sensor (APS) is an image sensor where each pixel sensor unit cell has a photodetector and one or more active transistors. In a metal–oxide–semiconductor (MOS) active-pixel sensor, MOS field-effect transistors (MOSFETs) are used as amplifiers. There are different types of APS, including the early NMOS APS and the much more common complementary MOS (CMOS) APS, also known as the CMOS sensor, which is widely used in digital camera technologies such as cell phone cameras, web cameras, most modern digital pocket cameras, most digital single-lens reflex cameras (DSLRs), and mirrorless interchangeable-lens cameras (MILCs). CMOS sensors emerged as an alternative to charge-coupled device (CCD) image sensors and eventually outsold them by the mid-2000s.

Image sensor format shape and size of a digital cameras image sensor

Note: For a quick understanding of numbers like 1/2.3, skip to table of sensor formats and sizes. For a simplified discussion of image sensors see image sensor.

Talbot effect near-field diffraction effect

The Talbot effect is a near-field diffraction effect first observed in 1836 by Henry Fox Talbot. When a plane wave is incident upon a periodic diffraction grating, the image of the grating is repeated at regular distances away from the grating plane. The regular distance is called the Talbot length, and the repeated images are called self images or Talbot images. Furthermore, at half the Talbot length, a self-image also occurs, but phase-shifted by half a period. At smaller regular fractions of the Talbot length, sub-images can also be observed. At one quarter of the Talbot length, the self-image is halved in size, and appears with half the period of the grating. At one eighth of the Talbot length, the period and size of the images is halved again, and so forth creating a fractal pattern of sub images with ever-decreasing size, often referred to as a Talbot carpet.

Diffractive beam splitter

The diffractive beam splitter (also known as multispot beam generator or array beam generator) is a single optical element that divides an input beam into N output beams. Each output beam retains the same optical characteristics as the input beam, such as size, polarization and phase. A diffractive beam splitter can generate either a 1-dimensional beam array (1xN) or a 2-dimensional beam matrix (MxN), depending on the diffractive pattern on the element. The diffractive beam splitter is used with monochromatic light such as a laser beam, and is designed for a specific wavelength and angle of separation between output beams.

Planar Fourier capture array

A planar Fourier capture array (PFCA) is a tiny camera that requires no mirror, lens, focal length, or moving parts. It is composed of angle-sensitive pixels, which can be manufactured in unmodified CMOS processes.

Phase-contrast X-ray imaging

Phase-contrast X-ray imaging (PCI) or phase-sensitive X-ray imaging is a general term for different technical methods that use information concerning changes in the phase of an X-ray beam that passes through an object in order to create its images. Standard X-ray imaging techniques like radiography or computed tomography (CT) rely on a decrease of the X-ray beam's intensity (attenuation) when traversing the sample, which can be measured directly with the assistance of an X-ray detector. In PCI however, the beam's phase shift caused by the sample is not measured directly, but is transformed into variations in intensity, which then can be recorded by the detector.

References

  1. A. Wang, P. Gill, and A. Molnar, "Light field image sensors based on the talbot effect," Applied Optics, vol. 48, no. 31, pp. 5897–5905, 2009.
  2. Wang, Albert; Gill, Patrick R.; Molnar, Alyosha (2011). "An angle-sensitive CMOS imager for single-sensor 3D photography". 2011 IEEE International Solid-State Circuits Conference. pp. 412–414. doi:10.1109/ISSCC.2011.5746375. ISBN   978-1-61284-303-2.