Pixel binning

Last updated

Pixel binning, also known as binning, is a process image sensors of digital cameras use to combine adjacent pixels throughout an image, by summing or averaging their values, during or after readout. It improves low-light performance while still allowing for highly detailed photographs in good light.

Contents

History

Normally, an increase in megapixel count on a constant image sensor size would lead to a sacrifice of the surface size of the individual pixels, which would result in each pixel being able to catch less light in the same time, thus leading to a darker and/or noisier image in low light (given the same exposure time).

In the past, camera manufacturers had to compromise between low-light performance and the amount of detail in good light, by dropping the megapixel count like HTC did in 2013 with their four-megapixel "UltraPixel" camera. However, this results in less detailed images in daylight where enough light is available. [1]

With pixel binning, the camera has "the best of both worlds", meaning both the benefit of high detail in good light and the benefit of high brightness in low light. In low light, the surfaces of four or more pixels can act as one large pixel that catches far more light. For example, some smartphones such as the Samsung Galaxy A15 are able to capture photographs with up to fifty megapixels in daylight. However, in low light, the individual pixels would be too small to capture the light needed for a bright image with the short exposure time available for handheld shooting. Therefore, with pixel binning activated, the 50-megapixel image sensor acts as a 12.5-megapixel image sensor, a quarter of its original resolution, with an accordingly larger surface area per pixel. [2]

How it works

Charge from adjacent pixels in CCD image sensors and some other image sensors can be combined during readout, increasing the line rate or frame rate.

In the context of image processing, binning is the procedure of combining clusters of adjacent pixels, throughout an image, into single pixels. For example, in 2x2 binning, an array of 4 pixels becomes a single larger pixel, [3] reducing the number of pixels to 1/4 and halving the image resolution in each dimension. The result can be the sum, average, median, minimum, or maximum value of the cluster. [4] Some systems use more advanced algorithms such as considering the values of nearby pixels, edge detection, self-claimed "AI" etc to increase the perceived visual quality of the final downsized image.

This aggregation, although associated with loss of information, reduces the amount of data to be processed, facilitating analysis. The binned image has lower resolution, but the relative noise level in each pixel is generally reduced.

See also

Related Research Articles

<span class="mw-page-title-main">Pixel</span> Physical point in a raster image

In digital imaging, a pixel, pel, or picture element is the smallest addressable element in a raster image, or the smallest addressable element in a dot matrix display device. In most digital display devices, pixels are the smallest element that can be manipulated through software.

<span class="mw-page-title-main">Digital camera</span> Camera that captures photographs or video in digital format

A digital camera, also called a digicam, is a camera that captures photographs in digital memory. Most cameras produced today are digital, largely replacing those that capture images on photographic film or film stock. Digital cameras are now widely incorporated into mobile devices like smartphones with the same or more capabilities and features of dedicated cameras. High-end, high-definition dedicated cameras are still commonly used by professionals and those who desire to take higher-quality photographs.

<span class="mw-page-title-main">Smartphone</span> Handheld mobile device

A smartphone is a mobile device that combines the functionality of a traditional mobile phone with advanced computing capabilities. It typically has a touchscreen interface, allowing users to access a wide range of applications and services, such as web browsing, email, and social media, as well as multimedia playback and streaming. Smartphones have built-in cameras, GPS navigation, and support for various communication methods, including voice calls, text messaging, and internet-based messaging apps.

<span class="mw-page-title-main">Bayer filter</span> Color filter array

A Bayer filter mosaic is a color filter array (CFA) for arranging RGB color filters on a square grid of photosensors. Its particular arrangement of color filters is used in most single-chip digital image sensors used in digital cameras, and camcorders to create a color image. The filter pattern is half green, one quarter red and one quarter blue, hence is also called BGGR, RGBG, GRBG, or RGGB.

<span class="mw-page-title-main">Camera phone</span> Mobile phone which is able to capture still photographs and usually also videos

A camera phone is a mobile phone that is able to capture photographs and often record video using one or more built-in digital cameras. It can also send the resulting image wirelessly and conveniently. The first commercial phone with a color camera was the Kyocera Visual Phone VP-210, released in Japan in May 1999. While cameras in mobile phones used to be supplementary, they have been a major selling point of mobile phones since the 2010s.

OmniVision Technologies Inc. is an American subsidiary of Chinese semiconductor device and mixed-signal integrated circuit design house Will Semiconductor. The company designs and develops digital imaging products for use in mobile phones, laptops, netbooks webcams, security, entertainment, automotive and medical imaging systems. Headquartered in Santa Clara, California, OmniVision Technologies has offices in the US, Western Europe and Asia.

<span class="mw-page-title-main">Exmor</span> Digital camera technology

Exmor is a technology developed by Sony and implemented on some of their CMOS image sensors. It performs on-chip analog/digital signal conversion and two-step noise reduction in parallel on each column of the CMOS sensor.

<span class="mw-page-title-main">Back-illuminated sensor</span> Type of digital image sensor

A back-illuminated (BI) sensor, also known as back-side illumination (BSI) sensor, is a type of digital image sensor that uses a novel arrangement of the imaging elements to increase the amount of light captured and thereby improve low-light performance.

<span class="mw-page-title-main">Nokia 808 PureView</span> Smartphone by Nokia

The Nokia 808 PureView is a Symbian-powered smartphone by Nokia. It was first unveiled on 27 February 2012 at the Mobile World Congress (MWC) and released in May 2012. It is the first smartphone to feature Nokia PureView Pro technology, a pixel oversampling technique that reduces an image taken at full resolution into a lower resolution picture, thus achieving higher definition and light sensitivity, and enables lossless digital zoom. It was one of the most advanced camera phones at the time of its release.

<span class="mw-page-title-main">Samsung Galaxy S series</span> Series of smartphones and tablet computers

The Samsung Galaxy S series is a line of Android-based smartphones and tablet computers produced by Samsung Electronics. In conjunction with the foldable Galaxy Z series, the series serves as Samsung's flagship smartphone lineup, and is the high-end line of the wider Samsung Galaxy family of Android devices.

<span class="mw-page-title-main">Nokia Lumia 1020</span> Smartphone by Nokia

The Nokia Lumia 1020 is a smartphone developed by Nokia, first unveiled on 11 July 2013 at a Nokia event in New York. It runs Windows Phone 8, but is also Windows Phone 8.1 ready. It contains Nokia's PureView technology, a pixel oversampling technique that reduces an image taken at full resolution into a lower resolution picture, thus achieving higher definition and light sensitivity, and enables lossless digital zoom. It improves on its predecessor, the Nokia 808, by coupling a 41-megapixel 2/3-inch BSI sensor with optical image stabilization (OIS) and a high resolution f/2.2 all-aspherical 1-group Carl Zeiss lens. It was considered to be the most advanced cameraphone when released in September 2013.

<span class="mw-page-title-main">Samsung Galaxy S5</span> Android-based smartphone by Samsung Electronics

The Samsung Galaxy S5 is an Android-based smartphone unveiled, produced, released and marketed by Samsung Electronics as part of the Samsung Galaxy S series. Unveiled on 24 February 2014 at Mobile World Congress in Barcelona, Spain, it was released on 11 April 2014 in 150 countries as the immediate successor to the Galaxy S4. As with the S4, the S5 is an evolution of the prior year's model, placing a particular emphasis on an improved build with a textured rear cover, IP67 certification for dust and water resistance, a more refined user experience, new security features such as a fingerprint reader and private mode, expanded health-related features including a built-in heart rate monitor, a USB 3.0 port, and an updated camera featuring speedy auto-focus through phase-detection. The video resolution has been upgraded to 2160p (4K) and the frame rate at 1080p has been doubled to 60 for a smooth appearance.

<span class="mw-page-title-main">HTC One (M8)</span> Smartphone manufactured by HTC

The HTC One (M8) is an Android or Windows smartphone manufactured and marketed by HTC. Following a number of leaks that occurred during the months prior, the device was officially unveiled in a press conference on March 25, 2014, and released the same day by Verizon Wireless at retail, and by other Canadian and United States carriers for online orders prior to its wider retail availability in mid-April.

<span class="mw-page-title-main">HTC One M9</span> Android smartphone

The HTC One M9 was an Android smartphone manufactured and marketed by HTC. The M9 was officially unveiled in a press conference at Mobile World Congress on March 1, 2015, and it was released worldwide on April 10, 2015. It is the successor to HTC One (M8).

The ISOCELL CMOS camera sensors are a family of sensors produced by Samsung and available for purchase by other companies. They are used in a wide variety of products including mobile phones, computers and digital cameras.

<span class="mw-page-title-main">Huawei P20</span> Android-based smartphone by Huawei

Huawei P20 and Huawei P20 Pro are Android smartphones manufactured by Huawei. Unveiled 27 March 2018, they succeed the Huawei P10 in the company's P series line.

<span class="mw-page-title-main">Huawei P30</span> High-end smartphone line by Huawei

Huawei P30 is a line of Android-based smartphones manufactured by Huawei. Unveiled on 26 March 2019, they succeed the Huawei P20 in the company's P series line.

<span class="mw-page-title-main">Samsung Galaxy S20</span> 2020 flagship smartphones by Samsung Electronics

The Samsung Galaxy S20 is a series of Android-based smartphones developed, manufactured, and marketed by Samsung Electronics as part of its Galaxy S series. They collectively serve as the successor to the Galaxy S10 series. The first three smartphones were unveiled at Samsung's Galaxy Unpacked event on 11 February 2020 while the Fan Edition model was unveiled at Samsung's Galaxy Unpacked event on 23 September 2020.

<span class="mw-page-title-main">Samsung Galaxy A15</span> 2024 Android-based smartphones manufactured by Samsung

The Samsung Galaxy A15 and Samsung Galaxy A15 5G are Android-based smartphones designed, developed and marketed by Samsung Electronics as a part of its Galaxy A series. They were announced on 11 December 2023, and released on the sixteenth of December less than a week later.

References

  1. Chang, Alexandra (19 February 2013). "HTC One Busts the Megapixel Myth With 'UltraPixels'". Wired. Retrieved 5 January 2025.
  2. Schmitt, Florian (28 March 2024). "Samsung Galaxy A15 5G smartphone review – Important updates for the affordable phone". Notebookcheck. Its main camera has a resolution of 50 megapixels but it makes use of the usual pixel binning method, meaning it only actually takes photos at 12.5 MP but with a bigger light yield.
  3. "Small explanation of binning in image processing". Steve Cannistra. Retrieved 2011-01-18.
  4. Bin..., ImageJ reference manual.