Coded exposure photography

Last updated
Digital Camera P camera grey.svg
Digital Camera

Coded exposure photography, also known as a flutter shutter, is the name given to any mathematical algorithm that reduces the effects of motion blur in photography. The key element of the coded exposure process is the mathematical formula that affects the shutter frequency. This involves the calculation of the relationship between the photon exposure of the light sensor and the randomized code. The camera is made to take a series of snapshots with random time intervals using a simple computer, this creates a blurred image that can be reconciled into a clear image using the algorithm.

Contents

Motion de-blurring technology grew due to increasing demand for clearer images in sporting events and other digital media. [1] The relative inexpensiveness of the coded exposure technology makes it a viable alternative to expensive cameras and equipment that are built to take millions of images per second.

History

Photography was developed to enable imaging of the visible world. Early cameras used film made of plastic coated with compounds of silver. [2] The film is highly sensitive to light. When photons (light) hit the film a reaction occurs which semi-permanently stores the data on its surface. This film is then developed by exposing it to several chemicals to create the image. The film is highly sensitive and the process is complicated. It must be stored away from light to prevent spoilage. [3]

Digital cameras use digital technologies to create images. This process involves exposing light-sensitive material to photons, creating electrical signals that are recorded in computer files. [4] This process is simple and has improved the availability of photography. One problem that digital cameras have faced is motion blur. Motion blur occurs when the camera or the subject are in motion. When motion blur happens, the resulting image is blurry, fuzzy edges and indistinct features. One solution to remove motion blur in photography is to increase the shutter speed of the camera. Unlike the coded exposure process, shutter speed is a purely physical process where the camera shutter is opened and closed more quickly, resulting in short exposure time. [5] This reduces the amount of motion that occupies each frame. [6] However shorter exposure times increase the 'noise', which can affect image quality. [7]

Coded exposure

Coded exposure solves the motion blur problem without the negative effects of shorter exposure times. It is an algorithm designed to open the camera's shutter in a pattern that enables the image to be processed in such a way that motion blur and noise are almost completely removed. [8] Contrary to other methods of de-blurring, coded exposure does not require additional hardware beyond a digital camera. [9]

The key element of the coded exposure process is the formula that affects the shutter frequency. [10] The process calculates the relationship between the exposure of the light sensor and the randomized code. [11] The digital camera takes a series of snapshots at random intervals. This creates a blurred image that can be clarified given the code or the algorithm. [12] Together with compressed sensing, this technique can be effective. [13]

Application

The relative inexpensiveness of the coded exposure technology makes it a viable alternative to expensive cameras and equipment that take millions of images per second. [14] However, the algorithm and subsequent de-blurring is a complicated process that requires specialists who can write the programs and create templates for companies to work from. Ownership of the technology is subject to dispute; no patent covers it. [15]

Coded exposure could have application on live television. Accurate footage of sporting events requires a clear image and detail. Short exposure cameras have been used, but coded exposure is typically available at a lower cost. As of October 2019, the technology had not been widely used outside of a research environment. [16]

Related Research Articles

<span class="mw-page-title-main">Camera</span> Optical device for recording images

A camera is an instrument used to capture and store images and videos, either digitally via an electronic image sensor, or chemically via a light-sensitive material such as photographic film. As a pivotal technology in the fields of photography and videography, cameras have played a significant role in the progression of visual arts, media, entertainment, surveillance, and scientific research. The invention of the camera dates back to the 19th century and has since evolved with advancements in technology, leading to a vast array of types and models in the 21st century.

<span class="mw-page-title-main">Shutter speed</span> Length of time when the film or digital sensor inside a camera is exposed to light

In photography, shutter speed or exposure time is the length of time that the film or digital sensor inside the camera is exposed to light when taking a photograph. The amount of light that reaches the film or image sensor is proportional to the exposure time. 1500 of a second will let half as much light in as 1250.

<span class="mw-page-title-main">Exposure (photography)</span> Amount of light captured by a camera

In photography, exposure is the amount of light per unit area reaching a frame of photographic film or the surface of an electronic image sensor. It is determined by shutter speed, lens F-number, and scene luminance. Exposure is measured in units of lux-seconds, and can be computed from exposure value (EV) and scene luminance in a specified region.

<span class="mw-page-title-main">Motion blur</span> Photography artifact from moving objects

Motion blur is the apparent streaking of moving objects in a photograph or a sequence of frames, such as a film or animation. It results when the image being recorded changes during the recording of a single exposure, due to rapid movement or long exposure.

<span class="mw-page-title-main">Flash synchronization</span> Synchronizing the firing of a photographic flash

In photography, flash synchronization or flash sync is the synchronizing the firing of a photographic flash with the opening of the shutter admitting light to photographic film or electronic image sensor.

In photography, bracketing is the general technique of taking several shots of the same subject using different camera settings, typically with the aim of combining the images in postprocessing. Bracketing is useful and often recommended in situations that make it difficult to obtain a satisfactory image with a single shot, especially when a small variation in exposure parameters has a comparatively large effect on the resulting image. Given the time it takes to accomplish multiple shots, it is typically, but not always, used for static subjects. Autobracketing is a feature of many modern cameras. When set, it will automatically take several bracketed shots, rather than the photographer altering the settings by hand between each shot.

<span class="mw-page-title-main">Computational photography</span> Set of digital image capture and processing techniques

Computational photography refers to digital image capture and processing techniques that use digital computation instead of optical processes. Computational photography can improve the capabilities of a camera, or introduce features that were not possible at all with film-based photography, or reduce the cost or size of camera elements. Examples of computational photography include in-camera computation of digital panoramas, high-dynamic-range images, and light field cameras. Light field cameras use novel optical elements to capture three dimensional scene information which can then be used to produce 3D images, enhanced depth-of-field, and selective de-focusing. Enhanced depth-of-field reduces the need for mechanical focusing systems. All of these features use computational imaging techniques.

A high-speed camera is a device capable of capturing moving images with exposures of less than 1/1 000 second or frame rates in excess of 250 frames per second. It is used for recording fast-moving objects as photographic images onto a storage medium. After recording, the images stored on the medium can be played back in slow motion. Early high-speed cameras used photographic film to record the high-speed events, but have been superseded by entirely electronic devices using an image sensor, recording, typically, over 1 000 frames per second onto DRAM, to be played back slowly to study the motion for scientific study of transient phenomena.

The science of photography is the use of chemistry and physics in all aspects of photography. This applies to the camera, its lenses, physical operation of the camera, electronic camera internals, and the process of developing film in order to take and develop pictures properly.

<span class="mw-page-title-main">Rotary disc shutter</span>

A rotary disc shutter is a type of shutter. It is notably used in motion picture cameras. Rotary shutters are semicircular discs that spin in front of the film gate, alternately allowing light from the lens to strike the film, or blocking it.

<span class="mw-page-title-main">Neutral-density filter</span> Device in optics that reduces light intensity

In photography and optics, a neutral-density filter, or ND filter, is a filter that reduces or modifies the intensity of all wavelengths, or colors, of light equally, giving no changes in hue of color rendition. It can be a colorless (clear) or grey filter, and is denoted by Wratten number 96. The purpose of a standard photographic neutral-density filter is to reduce the amount of light entering the lens. Doing so allows the photographer to select combinations of aperture, exposure time and sensor sensitivity that would otherwise produce overexposed pictures. This is done to achieve effects such as a shallower depth of field or motion blur of a subject in a wider range of situations and atmospheric conditions.

<span class="mw-page-title-main">Image noise</span> Visible interference in an image

Image noise is random variation of brightness or color information in images, and is usually an aspect of electronic noise. It can be produced by the image sensor and circuitry of a scanner or digital camera. Image noise can also originate in film grain and in the unavoidable shot noise of an ideal photon detector. Image noise is an undesirable by-product of image capture that obscures the desired information. Typically the term “image noise” is used to refer to noise in 2D images, not 3D images.

<span class="mw-page-title-main">High-speed photography</span> Photography genre

High-speed photography is the science of taking pictures of very fast phenomena. In 1948, the Society of Motion Picture and Television Engineers (SMPTE) defined high-speed photography as any set of photographs captured by a camera capable of 69 frames per second or greater, and of at least three consecutive frames. High-speed photography can be considered to be the opposite of time-lapse photography.

<span class="mw-page-title-main">Digital photography</span> Photography with a digital camera

Digital photography uses cameras containing arrays of electronic photodetectors interfaced to an analog-to-digital converter (ADC) to produce images focused by a lens, as opposed to an exposure on photographic film. The digitized image is stored as a computer file ready for further digital processing, viewing, electronic publishing, or digital printing. It is a form of digital imaging based on gathering visible light.

<span class="mw-page-title-main">Image sensor</span> Device that converts images into electronic signals

An image sensor or imager is a sensor that detects and conveys information used to form an image. It does so by converting the variable attenuation of light waves into signals, small bursts of current that convey the information. The waves can be light or other electromagnetic radiation. Image sensors are used in electronic imaging devices of both analog and digital types, which include digital cameras, camera modules, camera phones, optical mouse devices, medical imaging equipment, night vision equipment such as thermal imaging devices, radar, sonar, and others. As technology changes, electronic and digital imaging tends to replace chemical and analog imaging.

<span class="mw-page-title-main">Image stabilization</span> Techniques used to reduce blurring of images

Image stabilization (IS) is a family of techniques that reduce blurring associated with the motion of a camera or other imaging device during exposure.

The following outline is provided as an overview of and topical guide to photography:

<span class="mw-page-title-main">Long-exposure photography</span> Photography using a long-duration shutter speed

Long-exposure, time-exposure, or slow-shutter photography involves using a long-duration shutter speed to sharply capture the stationary elements of images while blurring, smearing, or obscuring the moving elements. Long-exposure photography captures one element that conventional photography does not: an extended period of time.

<span class="mw-page-title-main">Rolling shutter</span> Image capture method

Rolling shutter is a method of image capture in which a still picture or each frame of a video is captured not by taking a snapshot of the entire scene at a single instant in time but rather by scanning across the scene rapidly, vertically, horizontally or rotationally. In other words, not all parts of the image of the scene are recorded at exactly the same instant. This produces predictable distortions of fast-moving objects or rapid flashes of light. This is in contrast with "global shutter" in which the entire frame is captured at the same instant.

<span class="mw-page-title-main">Pixel Camera</span> Camera application developed by Google for Pixel devices

Pixel Camera, formerly Google Camera, is a camera phone application developed by Google for the Android operating system. Development for the application began in 2011 at the Google X research incubator led by Marc Levoy, which was developing image fusion technology for Google Glass. It was publicly released for Android 4.4+ on the Google Play on April 16, 2014. It was initially supported on all devices running Android 4.4 KitKat and higher, but became only officially supported on Google Pixel devices in the following years. The app was renamed Pixel Camera in October 2023, with the launch of the Pixel 8 and Pixel 8 Pro.

References

  1. Pueo, Basilio (2016). "High speed cameras for motion analysis in sports science". Journal of Human Sport and Exercise. 11. doi: 10.14198/jhse.2016.111.05 . hdl: 10045/61909 . ISSN   1988-5202.
  2. Woodford, Chris (11 July 2010). "Film cameras and 35mm photography – A simple introduction". Explain that Stuff. Retrieved 2019-05-13.
  3. Woodford, Chris (12 May 2006). "How do digital cameras work?". Explain that Stuff. Retrieved 2019-05-13.
  4. Tarrant, Jon (2006). Understanding Digital Cameras. ISBN   9780240520247.[ page needed ]
  5. Pueo, Basilio (2016). "High speed cameras for motion analysis in sports science". Journal of Human Sport and Exercise. 11. doi: 10.14198/jhse.2016.111.05 . hdl: 10045/61909 . ISSN   1988-5202.
  6. "Exposure, Aperture and Shutter Speed Explained | Photography Mad". www.photographymad.com. Retrieved 2019-05-13.
  7. "Optimizing flutter shutter to minimize camera blur". ScienceDaily. Retrieved 2019-05-13.
  8. "Optimizing flutter shutter to minimize camera blur". ScienceDaily. Retrieved 2019-05-13.
  9. "Coded Exposure Photography (Flutter Shutter Deblur, SIGGRAPH 2006)". web.media.mit.edu. Retrieved 2019-05-13.
  10. Tendero, Yohann; Osher, Stanley (2016-03-20). "On a mathematical theory of coded exposure". Research in the Mathematical Sciences. 3 (1): 4. doi: 10.1186/s40687-015-0051-8 . ISSN   2197-9847.
  11. Tendero, Yohann; Osher, Stanley (2016-03-20). "On a mathematical theory of coded exposure". Research in the Mathematical Sciences. 3 (1): 4. doi: 10.1186/s40687-015-0051-8 . ISSN   2197-9847.
  12. "Coded Exposure Photography (Flutter Shutter Deblur, SIGGRAPH 2006)". web.media.mit.edu. Retrieved 2019-05-14.
  13. Tsutake, Chihiro; Yoshida, Toshiyuki (2018). Reduction of Poisson noise in coded exposure photography. 25th IEEE International Conference on Image Processing. doi:10.1109/ICIP.2018.8451407.
  14. "The World's Fastest Camera Can Shoot 10 Trillion Frames Per Second". petapixel.com. 15 October 2018. Retrieved 2019-05-14.
  15. Holloway, J.; Sankaranarayanan, A. C.; Veeraraghavan, A.; Tambe, S. (2012). "Flutter Shutter Video Camera for compressive sensing of videos". 2012 IEEE International Conference on Computational Photography (ICCP). pp. 1–9. doi:10.1109/ICCPhot.2012.6215211. ISBN   978-1-4673-1662-0. S2CID   3819978.
  16. Holloway, J.; Sankaranarayanan, A. C.; Veeraraghavan, A.; Tambe, S. (2012). "Flutter Shutter Video Camera for compressive sensing of videos". 2012 IEEE International Conference on Computational Photography (ICCP). pp. 1–9. doi:10.1109/ICCPhot.2012.6215211. ISBN   978-1-4673-1662-0. S2CID   3819978.