Rolling shutter

Last updated
Animation showing the rolling shutter effect Rolling shutter effect animation.gif
Animation showing the rolling shutter effect
A de Havilland Canada Dash 8 Q-400 six-blade propeller, with severe rolling-shutter distortion from a Pixel 3 camera Propellor with rolling-shutter artifact.jpg
A de Havilland Canada Dash 8 Q-400 six-blade propeller, with severe rolling-shutter distortion from a Pixel 3 camera
Simulation of the rolling-shutter effect on a rotating propeller and a moving car
(click for SMIL animation) Rolling shutter SMIL.svg
Simulation of the rolling-shutter effect on a rotating propeller and a moving car
(click for SMIL animation)

Rolling shutter is a process of image capture in which a still picture (in a still camera) or each frame of a video (in a video camera) is captured not by taking a snapshot of the entire scene at a single instant in time but rather by scanning across the scene rapidly, vertically, horizontally or rotationally. Thus, not all parts of the image of the scene are recorded at the same instant – however, during playback, the entire image of the scene is displayed at once, as if it represents a single instant in time. This produces predictable distortions of fast-moving objects or rapid flashes of light, referred to as rolling shutter effect. This process in contrast with global shutter in which the entire frame is captured at the same instant.

Contents

The rolling shutter can be either mechanical or electronic. [1] [2] The advantage of this electronic rolling shutter is that the image sensor can continue to gather photons during the acquisition process, thus effectively increasing sensitivity. It is found on many digital still and video cameras using CMOS sensors. The effect is most noticeable when imaging extreme conditions of motion or the fast flashing of light. While some CMOS sensors use a global shutter, [3] the majority found in the consumer market use a rolling shutter.

CCDs (charge-coupled devices) are alternatives to CMOS sensors, which are generally more sensitive and more expensive.[ citation needed ] CCD-based cameras often use global shutters, which take a snapshot representing a “relative” single instant in time and therefore do not suffer from the motion artifacts caused by rolling shutters. [4]

Distortion effects

Rolling shutters can cause such effects as: [5]

The effects of a rolling shutter can prove difficult for visual effects filming. The process of matchmoving establishes perspective in a scene based on a single point in time, but this is difficult with a rolling shutter that provides multiple points in time within the same frame. Final results depend on the readout speed of the sensor and the nature of the scene being filmed; as a rule of thumb, higher-end cinema cameras will have faster readout speeds and therefore milder rolling shutter artifacts than low-end cameras.

Images and video that suffer from rolling shutter distortion can be improved by algorithms that do rolling shutter rectification, or rolling shutter compensation. How to do this is an active area of research. [5]

This effect can be used as a side channel attack to gain secret keys from certain smart card readers: The attacker films the power LED of the reader while the reader is performing a cryptographic operation, then analyzes the video footage to identify brief voltage fluctuations. Due to the effect of the rolling shutter, the footage will reveal fluctuations at a resolution several orders of magnitude greater than the frame rate of the video camera. With knowledge about the algorithm used and its implementation in the chip, the attacker can then derive the key. Analyzing video footage is equivalent to measuring power consumption with an oscilloscope, but less invasive. [6] [7]

See also

Notes

  1. "Electronic shuttering: Rolling vs Global shutter" (PDF). Motionvideoproducts. Archived from the original (PDF) on 2012-02-15. Retrieved 2011-12-22.
  2. "Shutter Operations for CCD and CMOS Image Sensors". Kodak Image Sensor Solutions. Archived from the original on 2012-03-29.
  3. "TrueSNAP Shutter Freezes Fast-Moving Objects" (PDF). Eric Fossum. 2013-11-13. Retrieved 2013-11-13.
  4. "To CCD or to CMOS, That is the Question | B&H Photo Video Pro Audio". Bhphotovideo.com. Archived from the original on 2011-07-21. Retrieved 2010-08-21.
  5. 1 2 Forssén, Per-Erik; Ringaby, Erik; Hedborg, Johan (17 June 2012). "Computer Vision on Rolling Shutter Cameras". Linköping University. Retrieved 22 July 2025.
  6. "Video-Based Cryptanalysis". Ben Nassi. Retrieved 2023-08-13.
  7. Power LED Attack - Computerphile , retrieved 2023-08-13