Foveon X3 sensor

Last updated

The Foveon X3 sensor is a digital camera image sensor designed by Foveon, Inc., (now part of Sigma Corporation) and manufactured by Dongbu Electronics. [1] It uses an array of photosites that consist of three vertically stacked photodiodes. Each of the three stacked photodiodes has a different spectral sensitivity, allowing it to respond differently to different wavelengths. [2] The signals from the three photodiodes are then processed as additive color data that are transformed to a standard RGB color space. In the late 1970s, a similar color sensor having three stacked photo detectors at each pixel location, with different spectral responses due to the differential absorption of light by the semiconductor, had been developed and patented by Kodak. [3]

Contents

The X3 sensor technology was first deployed in 2002 in the Sigma SD9 DSLR camera, and subsequently in the SD10, SD14, SD15, SD1 (including SD1 Merrill), the original mirrorless compact Sigma DP1 and Sigma DP2 in 2008 and 2009 respectively, the Sigma dp2 Quattro series from 2014, and the Sigma SD Quattro series from 2016. The development of the Foveon X3 technology is the subject of the 2005 book The Silicon Eye by George Gilder.

Operation

Wavelength-dependent absorption in silicon and the Foveon X3 sensor. See text for explanation. Absorption-X3.png
Wavelength-dependent absorption in silicon and the Foveon X3 sensor. See text for explanation.

The diagram to the right depicts how the Foveon X3 sensor works. The image on the left shows the absorption of colors for each wavelength as it passes through the silicon wafer. The image on the right shows a layered sensor stack depicting the colors it detects at each absorption level for each output pixel. The sensor colors shown are only examples. In practice, the color attributes of each output pixel using this sensor result from the camera's image processing algorithms, which use a matrix process to construct a single RGB color from all the data sensed by the photodiode stack. [2]

The depth of the silicon wafer in each of the three sensors is less than five micrometers that creates a negligible effect on focusing or chromatic aberration. However, because the collection depth of the deepest sensor layer (red) is comparable to collection depths in other silicon CMOS and CCD sensors, some diffusion of electrons and loss of sharpness in the longer wavelengths occurs. [4]

Use

The first digital camera to use a Foveon X3 sensor was the Sigma SD9, a digital SLR launched in 2002. [5] It used a 20.7 × 13.8 mm, 2268 x 1512 × 3 (3.54 × 3 MP) iteration of the sensor and was built on a Sigma-designed body using the Sigma SA mount. The camera was followed in 2003 by the improved but technically similar Sigma SD10, [6] which was in turn succeeded in 2006 by the Sigma SD14, which used a higher-resolution, 2640 × 1760 × 3 (4.64 × 3 MP) sensor. The SD14's successor, the Sigma SD15, was released in June 2010 [7] and used the same 2640 × 1760 × 3 sensor as the SD14. The Sigma SD1 was released in June 2011 [8] with a new 23.5×15.7mm APS-C 4800 × 3200 × 3 (15.36 × 3 MP) sensor developed for the professional market. [9]

In 2004, Polaroid Corporation announced the Polaroid x530, [10] a compact camera with a 1408 × 1056 × 3, 1/1.8-in. sensor. The camera had a limited release in 2005 but was recalled later in the year for unspecified image quality problems. [11] Sigma announced a prototype of its Foveon-based compact camera in 2006, the Sigma DP1, using the same 14 MP sensor as the SD14 DSLR. A revised version of the prototype was exhibited in 2007, and the camera was eventually launched in spring 2008. [12] Unlike the Polaroid x530, the DP1 had an APS-C-sized sensor with a 28mm equivalent prime lens. The camera was revised as the DP1s and the DP1x. In 2009, the company launched the DP2, [13] a compact camera using the same sensor and body as the DP1 but with a 41 mm-equivalent f/2.8 lens.

Comparison to Bayer-filter sensors

The operation of the Foveon X3 sensor is different from that of the Bayer filter image sensor, which is more commonly used in digital cameras. In the Bayer sensor, each photosite in the array consists of a single light sensor (either CMOS or CCD) that, as a result of filtration, is exposed to only one of the three primary colors: red, green, or blue. Constructing a full-color image from a Bayer sensor requires demosaicing, an interpolative process in which the output pixel associated with each photosite is assigned an RGB value based in part on the level of red, green, and blue reported by those photosites adjacent to it. However, the Foveon X3 sensor creates its RGB color output for each photosite by combining the outputs of each of the stacked photodiodes at each of its photosites. This operational difference results in several significant consequences.

Color artifacts

Because demosaicing is not required for the Foveon X3 sensor to produce a full-color image, the color artifacts ("colored jaggies") associated with the process are not seen. The separate anti-aliasing filter [14] commonly used [n 1] to mitigate those artifacts in a Bayer sensor is not required; this is because little aliasing occurs when the photodiodes for each color, with the assistance of the microlenses, integrate the optical image over a region almost as big as the spacing of sensors for that color. [n 2] [15] On the other hand, the method of color separation by silicon penetration depth gives more cross-contamination between color layers, meaning more issues with color accuracy.

Light gathering and low-light performance

Theoretically, the Foveon X3 photosensor can detect more photons entering the camera lens than a mosaic sensor, because each of the color filters overlaying each photosite of a mosaic sensor passes only one of the primary colors and absorbs the other two. However, the individual layers in a Fovean sensor do not respond as sharply to the respective colors; thus color-indicating information in the sensor's raw data requires an "aggressive" matrix (i.e., the removal of common-mode signals) to produce color data in a standard color space, which can increase color noise in low-light situations. [16]

Spatial resolution

According to Sigma Corporation, "there has been some controversy in how to specify the number of pixels in Foveon sensors." [17] The argument has been over whether sellers should count the number of photosites or the total number of photodiodes, as a megapixel count, and whether either of those should be compared with the number of photodiodes in a Bayer filter sensor or camera as a measure of resolution.

For example, the dimensions of the photosite array in the sensor in the Sigma SD10 camera are 2268 × 1512, and the camera produces a native file size of those dimensions (times three color layers), which amounts to approximately 3.4 million three-color pixels. However, it has been advertised as a 10.2 MP camera by taking into account that each photosite contains stacked red, green, and blue color-sensing photodiodes, or pixel sensors (2268 × 1512 × 3). By comparison, the dimensions of the photosite array in the 10.2 MP Bayer sensor in the Nikon D200 camera are 3872 × 2592, but there is only one photodiode, or one-pixel sensor, at each site. The cameras have equal numbers of photodiodes and produce similar raw data file sizes, but the Bayer filter camera produces a larger native file size via demosaicing.

The actual resolution produced by the Bayer sensor is more complicated than the count of its photosites, or its native file size might suggest; the demosaicing and the separate anti-aliasing filter are both commonly used to reduce the occurrence or severity of color moiré patterns that the mosaic characteristic of the Bayer sensor produces. The effect of this filter blurs the image output of the sensor which produces a lower resolution than the photosite count would seem to imply. This filter is mostly unnecessary with the Foveon X3 sensor and is not used. The earliest camera with a Foveon X3 sensor, the Sigma SD9, showed visible luminance moiré patterns without color moiré. [18]

Subsequent X3-equipped cameras have less aliasing because they include micro-lenses, which provide an anti-aliasing filter by averaging the optical signal over an area commensurate with the sample density. This is not possible in any color channel of a Bayer-type sensor. Aliasing from the Foveon X3 sensor is "far less bothersome because it's monochrome," said Norman Koren. [19] In theory, it is possible for a Foveon X3 sensor with the same number of photodiodes as a Bayer sensor and no separate anti-aliasing filter to attain a higher spatial resolution than that Bayer sensor. Independent tests indicate that the "10.2 MP" array of the Foveon X3 sensor (in the Sigma SD10) has a resolution similar to a 5 MP [20] or 6 MP [21] Bayer sensor. At low ISO speed, it is even similar to a 7.2 MP [22] Bayer sensor.

With the introduction of the Sigma SD14, the 14 MP (4.7 MP red + 4.7 MP green + 4.7 MP blue) Foveon X3 sensor resolution is compared favorably by reviewers to that of 10 MP Bayer sensors. For example, Mike Chaney of ddisoftware says "the SD14 produces better photos than a typical 10 MP DSLR because it is able to carry sharp detail all the way to the 'falloff' point at 1700 LPI, whereas contrast, color detail, and sharpness begin to degrade long before the 1700 LPI limit on a Bayer based 10 MP DSLR." [23]

Another article judges the Foveon X3 sensor as roughly equivalent to a 9 MP Bayer sensor. [24]

A visual comparison between a 14 MP Foveon sensor and a 12.3 MP Bayer sensor shows Foveon has crisper details. [25]

Noise

The Foveon X3 sensor, as used in the Sigma SD10 camera, has been characterized by two independent reviewers as noisier than the sensors in some other DSLRs using the Bayer sensor at higher ISO film speed equivalents, [26] chroma noise in particular. [27] [28] Another noted higher noise during long exposure times. [29] [n 3] However, these reviewers offer no opinion as to whether this is an inherent property of the sensor or the camera's image-processing algorithms.

With regards to the Sigma SD14, which uses a more recent Foveon X3 sensor, one reviewer judged its noise levels as ranging from "very low" at ISO 100 to "moderate" at ISO 1600 when using the camera's Raw image format. [30]

Sample images

Sigma's SD14 site has galleries of full-resolution images showing the color produced by the Foveon technology. The 14 MP Foveon chip produces 4.7 MP native-size RGB files; 14 MP Bayer filter cameras produce a 14 MP native file size by interpolation (i.e., demosaicing). Direct visual comparison of images from 12.7 MP Bayer sensors and 14.1 MP Foveon sensors show Bayer images are superior on fine monochrome detail, such as the lines between bricks on a distant building, but the Foveon images are superior in color resolution. [31]

Further development

As of May 2023, the Foveon X3 sensor is less favoured by the average photographer, being overtaken by CMOS sensors which can be made at lower cost with higher resolution and lower noise. [32]

However it was reported in February 2021 that Sigma has been working on a new Foveon sensor but that a critical flaw was found in their development to date and they had to restart development from scratch. [33]

In February 2022 it was reported that Sigma was in the second stage of prototyping the new full frame Foveon sensor. Second stage prototyping in this case is the evaluation of a small image sensor prototype with the same pixel size as the product specifications but with a reduced total pixel count to verify the performance characteristics of the image sensor in practice. Third stage prototyping will evaluate a full-frame image sensor with the same specifications as the mass production devices including the AD converter etc. It is unlikely that mass production will commence before 2024. [34]

See also

Notes

  1. ↑ Though its use is almost universal with Bayer sensors in digital cameras, it is not absolutely necessary. Kodak once produced two digital cameras, the DCS Pro SLR/n and DCS Pro SLR/c (Digital Photography Review, Kodak DCS Pro SLR/c Review, June 2004, Retrieved March 3, 2007) using Bayer sensors without such a filter. However, significant moiré patterns were produced when photographing very fine detail. Retrieved March 3, 2007.
  2. ↑ Microlenses are commonly used in all types of image sensors in digital cameras; in Bayer-filter sensors, microlenses allow the area of the optical image being averaged (i.e., integrated) per sample to approach 25 percent for red and blue, and 50 percent for green, resulting in very little anti-aliasing. For Foveon X3 sensors, the area being averaged can approach 100 percent for each color, resulting in a significant anti-alias filter effect.
  3. ↑ This observation is consistent with a comparison of the images, displayed in Digital Photography Review, taken by the Sigma SD10 (see here) with those taken approximately contemporaneously of the same scene by the Bayer sensor-equipped Nikon D70 (see here)/page15.asp. Both retrieved March 6, 2007.

Related Research Articles

<span class="mw-page-title-main">Bayer filter</span> Color filter array

A Bayer filter mosaic is a color filter array (CFA) for arranging RGB color filters on a square grid of photosensors. Its particular arrangement of color filters is used in most single-chip digital image sensors used in digital cameras, and camcorders to create a color image. The filter pattern is half green, one quarter red and one quarter blue, hence is also called BGGR, RGBG, GRBG, or RGGB.

<span class="mw-page-title-main">Digital single-lens reflex camera</span> Digital cameras combining the parts of a single-lens reflex camera and a digital camera back

A digital single-lens reflex camera is a digital camera that combines the optics and mechanisms of a single-lens reflex camera with a solid-state image sensor and digitally records the images from the sensor.

<span class="mw-page-title-main">Sigma Corporation</span> Japanese camera and camera lens manufacturer

Sigma Corporation is a Japanese company, manufacturing cameras, lenses, flashes and other photographic accessories. All Sigma products are produced in the company's own Aizu factory in Bandai, Fukushima, Japan. Although Sigma produces several camera models, the company is best known for producing high-quality lenses and other accessories that are compatible with the cameras produced by other companies.

<span class="mw-page-title-main">Sigma SD10</span> Camera model

The Sigma SD10 is a digital single-lens reflex camera (DSLR) manufactured by the Sigma Corporation of Japan. It was announced on October 27, 2003, and is an evolution of the previous SD9 model, addressing many of the shortcomings of that camera. The Sigma SD10 cameras are unique in the digital DSLR field in using full-color sensor technology, and in that they only produce raw format images that require post-processing on a computer.

<span class="mw-page-title-main">APS-C</span> Image sensor format

Advanced Photo System type-C (APS-C) is an image sensor format approximately equivalent in size to the Advanced Photo System film negative in its C ("Classic") format, of 25.1×16.7 mm, an aspect ratio of 3:2 and Ø 30.15 mm field diameter. It is therefore also equivalent in size to the Super 35 motion picture film format, which has the dimensions of 24.89 mm × 18.66 mm and Ø 31.11 mm field diameter.

<span class="mw-page-title-main">Sigma SD9</span> Camera model

The Sigma SD9 is a digital single-lens reflex camera (DSLR) produced by the Sigma Corporation of Japan. The camera was launched at the Photo Marketing Association Annual Show on February 18, 2002. It was Sigma's first digital camera, and was the first production camera to use the unique Foveon X3 image sensor, which reads full color at each pixel site. Other sensors detect only one color at each site and interpolate to produce a full-color image.

Demosaicing, also known as color reconstruction, is a digital image processing algorithm used to reconstruct a full color image from the incomplete color samples output from an image sensor overlaid with a color filter array (CFA) such as a Bayer filter. It is also known as CFA interpolation or debayering.

<span class="mw-page-title-main">Digital photography</span> Photography with a digital camera

Digital photography uses cameras containing arrays of electronic photodetectors interfaced to an analog-to-digital converter (ADC) to produce images focused by a lens, as opposed to an exposure on photographic film. The digitized image is stored as a computer file ready for further digital processing, viewing, electronic publishing, or digital printing. It is a form of digital imaging based on gathering visible light.

<span class="mw-page-title-main">Image sensor</span> Device that converts images into electronic signals

An image sensor or imager is a sensor that detects and conveys information used to form an image. It does so by converting the variable attenuation of light waves into signals, small bursts of current that convey the information. The waves can be light or other electromagnetic radiation. Image sensors are used in electronic imaging devices of both analog and digital types, which include digital cameras, camera modules, camera phones, optical mouse devices, medical imaging equipment, night vision equipment such as thermal imaging devices, radar, sonar, and others. As technology changes, electronic and digital imaging tends to replace chemical and analog imaging.

<span class="mw-page-title-main">CYGM filter</span>

In digital photography, the CYGM filter is an alternative color filter array to the Bayer filter (GRGB). It similarly uses a mosaic of pixel filters, of cyan, yellow, green and magenta, and so also requires demosaicing to produce a full-color image.

<span class="mw-page-title-main">Color filter array</span>

In digital imaging, a color filter array (CFA), or color filter mosaic (CFM), is a mosaic of tiny color filters placed over the pixel sensors of an image sensor to capture color information.

<span class="mw-page-title-main">RGBE filter</span>

In digital photography, the RGBE filter is an alternative color filter array to the Bayer filter (GRGB). It similarly uses a mosaic of pixel filters, of red, green, blue and "emerald", and so also requires demosaicing to produce a full-color image. It was developed by Sony and so far is used only in the ICX456 8-megapixel CCD and in the Sony Cyber-shot DSC-F828 camera.

<span class="mw-page-title-main">Sigma SD14</span> Camera model

The Sigma SD14 is a digital single-lens reflex camera produced by the Sigma Corporation of Japan. It is fitted with a Sigma SA mount which takes Sigma SA lenses.

<span class="mw-page-title-main">Image sensor format</span> Shape and size of a digital cameras image sensor

In digital photography, the image sensor format is the shape and size of the image sensor.

<span class="mw-page-title-main">Image processor</span> Specialized digital signal processor used for image processing

An image processor, also known as an image processing engine, image processing unit (IPU), or image signal processor (ISP), is a type of media processor or specialized digital signal processor (DSP) used for image processing, in digital cameras or other devices. Image processors often employ parallel computing even with SIMD or MIMD technologies to increase speed and efficiency. The digital image processing engine can perform a range of tasks. To increase the system integration on embedded devices, often it is a system on a chip with multi-core processor architecture.

<span class="mw-page-title-main">Sigma DP1</span>

The Sigma DP1 was a high-end compact digital camera introduced by the Sigma Corporation. It featured a 14-megapixel Foveon X3 sensor, a fixed 16.6 mm F4.0 lens, a 2.5-inch (64 mm) LCD and a pop-up flash. It was the first "compact" camera that featured an APS-C sized sensor, a feature that Sigma claimed would result in DSLR quality images from a small, pocketable camera.

<span class="mw-page-title-main">Richard B. Merrill</span>

Richard Billings Merrill (1949–2008), a.k.a. Dick Merrill, was an American inventor, engineer, and photographer.

<span class="mw-page-title-main">Sigma DP2</span> Camera model

The Sigma DP2 is a high-end compact digital camera introduced by the Sigma Corporation. It features a 14-megapixel Foveon X3 sensor, the same sensor used in its predecessor, the Sigma DP1 and in the Sigma SD14 DSLR, a fixed 24.2mm f/2.8 lens, a 2.5” LCD and a pop-up flash.

<span class="mw-page-title-main">Sigma SD15</span> Digital camera model

The Sigma SD15 is an updated version of Sigma SD14 DSLR produced by the Sigma Corporation of Japan and featuring the improved TRUE II image processing engine, but with the same image sensor as its predecessor. As such, the SD15 features the 4.7 MP Foveon X3 sensor. After having showcased the camera in photokina 2008 and officially introduced during PMA 2010, it finally began shipping in June 2010. It is Sigma's fourth DSLR since the SD9 from 2002.

<span class="mw-page-title-main">Sigma SD1</span> Camera model

The Sigma SD1 is a digital SLR camera produced by the Sigma Corporation of Japan. The camera uses a Foveon X3 sensor, which comprises 3 layers of 4800 x 3200 pixels, giving much higher chromatic resolution than the equivalent Bayer array. It uses a Milbeaut image processor. The Foveon sensor does not use an aliasing filter, thus further improving the resolution.

References

  1. ↑ Foveon Announces New Image Sensor Manufacturing Partner: Dongbu Electronics of Seoul, South Korea. Retrieved Jan. 18, 2014.
  2. 1 2 A. Rush; P. Hubel (2003). "X3 Sensor Characteristics". J. Soc. Photogr. Sci. Technol. Japan. 66 (1): 57–60. Retrieved March 6, 2007.
  3. ↑ US4613895A,Burkey, Bruce C.; VanHeyningen, Roger S.& Spaulding, Richard A.et al.,"Color responsive imaging device employing wavelength dependent semiconductor optical absorption",issued 1986-09-23
  4. ↑ Ji Soo Lee (2003). Photoresponse of CMOS Image Sensors (PDF) (Ph.D. dissertation). University of Waterloo. Archived from the original (PDF) on February 19, 2009.
  5. ↑ Digital Photography Review: 18 February 2002
  6. ↑ Digital Photography Review: Sigma SD10: March 2004
  7. ↑ Digital Photography Review: Sigma UK to start shipping SD15 digital camera: 11 June 2010
  8. ↑ "Sigma SD1 Price & Availability Announced" . Retrieved May 24, 2011.
  9. ↑ Digital Photography Review: Sigma releases SD1 flagship digital SLR: 21 September 2010
  10. ↑ Digital Photography Review: Polaroid x530: 09 February 2004
  11. ↑ Imaging Resource: 15 April 2005
  12. ↑ Digital Photography Review: Sigma announces DP1 to be available spring 2008: 13 January 2008
  13. ↑ Digital Photography Review: Sigma UK: DP2 now available: 14 May 2009
  14. ↑ See, Optical anti-aliasing filter section of anti-aliasing filter
  15. ↑ Brian W. Keelan (2004). Handbook of Image Quality: Characterization and Prediction. Marcel–Dekker. p. 390. ISBN   0-8247-0770-2.
  16. ↑ "Know raw? Part 2". Photostream on auspiciousdragon.net. July 5, 2007. Archived from the original on September 28, 2007.{{cite web}}: CS1 maint: unfit URL (link)
  17. ↑ "Sigma SD14 White Papers". Archived from the original on November 26, 2007. Retrieved April 29, 2007.
  18. ↑ Phil Askey (November 2002). "Sigma SD9 Review". DPReview.
  19. ↑ Norman Koren. "Sharpness: What is it and how is it measured?". Imatest docs. Retrieved December 16, 2007.
  20. ↑ Popular Photography & Imaging, Vol. 69, No. 6 (June, 2005), (table on p. 47).
  21. ↑ Digital Photography Review: Sigma SD10 Review, March 2004, Retrieved March 3, 2007.
  22. ↑ c|net Reviews, Sigma SD10 Retrieved March 6, 2007.
  23. ↑ Mike Chaney (2007). "Sigma SD14 Resolution: 14 MP? 4.6 MP? How does the SD14 stack up against high-end cameras like the Canon EOD 5D?". ddisoftware.
  24. ↑ "Foveon X3 Sensor Claims Put to the Test". Archived from the original on February 5, 2008.
  25. ↑ Carl Rytterfalk (February 23, 2010). "A tiny Sigma SD14 vs Nikon D90 comparison." Carl Rytterfalk Photography. Archived from the original on July 15, 2010. Retrieved May 20, 2010.
  26. ↑ See, e.g., c|net Reviews, Sigma SD10 Retrieved March 6, 2007 and Steve's Digicams Sigma SD10 review (November 28, 2003) Retrieved March 6, 2007.
  27. ↑ Camera Labs: Sigma DP1 Gallery
  28. ↑ Sigma DP1 Review, photographyreview.com
  29. ↑ Imaging Resource Sigma SD10 review (First posted 10-22-03.). Retrieved March 6, 2007.
  30. ↑ Michael J. McNamara (December 2008). "Camera Test: Sigma SD14" . Retrieved June 6, 2013.
  31. ↑ Mike Chaney (March 16, 2007). "Sigma SD14 Resolution: 14 MP? 4.6 MP?". Digital Domain Inc.
  32. ↑ Timothee Cognard (June 13, 2022). "Foveon: The Clever Image Sensor That Has Failed to Catch On" . Retrieved May 12, 2023.
  33. ↑ Jaron Schneider (February 19, 2021). "Sigma Provides Update on Foveon Camera: 'Back to the Drawing Board'" . Retrieved May 12, 2023.
  34. ↑ Jaron Schneider (February 22, 2022). "Sigma is in the Second Stage of Prototyping a New Foveon Sensor" . Retrieved May 12, 2023.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.