Bloom (shader effect)

Last updated
An example of bloom in a computer-generated image (from Elephants Dream). The light on the bright background bleeds on the darker areas, such as the walls and the characters. Elephants Dream - Emo and Proog.jpg
An example of bloom in a computer-generated image (from Elephants Dream ). The light on the bright background bleeds on the darker areas, such as the walls and the characters.
An example of bloom in a picture taken with a camera. Note the blue fringe that is particularly noticeable along the right edge of the window. HrdiBloomExample.jpg
An example of bloom in a picture taken with a camera. Note the blue fringe that is particularly noticeable along the right edge of the window.

Bloom (sometimes referred to as light bloom or glow) is a computer graphics effect used in video games, demos, and high-dynamic-range rendering (HDRR) to reproduce an imaging artifact of real-world cameras. The effect produces fringes (or feathers) of light extending from the borders of bright areas in an image, contributing to the illusion of an extremely bright light overwhelming the camera or eye capturing the scene. It became widely used in video games after an article on the technique was published by the authors of Tron 2.0 in 2004. [1]

Contents

Theory

There are two recognized potential causes of bloom.

Imperfect Focus

One physical basis of bloom is that, in the real world, lenses can never focus perfectly. Even a perfect lens will convolve the incoming image with an Airy disk (the diffraction pattern produced by passing a point light source through a circular aperture). [2] Under normal circumstances, these imperfections are not noticeable, but an intensely bright light source will cause the imperfections to become visible. As a result, the image of the bright light appears to bleed beyond its natural borders.

The Airy disc function falls off very quickly but has very wide tails (actually, infinitely wide tails). As long as the brightness of adjacent parts of the image are roughly in the same range, the effect of the blurring caused by the Airy disc is not particularly noticeable; but in parts of the image where very bright parts are adjacent to relatively darker parts, the tails of the Airy disc become visible and can extend far beyond the extent of the bright part of the image.

In HDRR images, the effect can be reproduced by convolving the image with a windowed kernel of an Airy disc (for very good lenses), or by applying Gaussian blur (to simulate the effect of a less perfect lens), before converting the image to fixed-range pixels. The effect cannot be fully reproduced in non-HDRR imaging systems, because the amount of bleed depends on how bright the bright part of the image is.

As an example, when a picture is taken indoors, the brightness of outdoor objects seen through a window may be 70 or 80 times brighter than objects inside the room. If exposure levels are set for objects inside the room, the bright image of the windows will bleed past the window frames when convolved with the Airy disc of the camera being used to produce the image.

CCD Sensor Saturation

Blooming in a CCD image Blooming ccd.jpg
Blooming in a CCD image

Bloom in digital cameras is caused by an overflow of charge in the photodiodes, which are the light-sensitive elements in the camera's image sensor. [3] When a photodiode is exposed to a very bright light source, the accumulated charge can spill over into adjacent pixels, creating a halo effect. This is known as "charge bleeding."

The bloom effect is more pronounced in cameras with smaller pixels, as there is less room for the charge to dissipate. It can also be exacerbated by high ISO settings, which increase the camera's sensitivity to light and can result in more charge accumulation.

While the bloom effect can be distracting in some images, it can also be used creatively to add a dreamy or otherworldly quality to photos.

Practical implementation

Current generation gaming systems are able to render 3D graphics using floating-point frame buffers, in order to produce HDR images. To produce the bloom effect, the linear HDRR image in the frame buffer is convolved with a convolution kernel in a post-processing step, before converting to RGB space. The convolution step usually requires the use of a large gaussian kernel that is not practical for realtime graphics, causing programmers to use approximation methods. [4]

Use in games

Some of the earliest games to use the bloom effect include the pre-rendered CGI game Riven (1997), [5] the voxel game Outcast (1999), [6] and the real-time 3D polygon games The Bouncer (2000) [7] and Ico (2001). [8] Bloom was later popularized within the game development community in 2004, when an article on the technique was published by the authors of Tron 2.0 . [1] Bloom lighting has been used in many games, modifications and game engines such as Quake Live , Cube 2: Sauerbraten and the Spring game engine.

The effect was popular in 7th-generation games, [9] which were released from 2005 through to the early 2010s. Several games from the period have received criticism for overuse of the technique. The heavy bloom lighting in RollerCoaster Tycoon 3 (2005) was described as "disgusting" at the time by GameSpot. [10] Gaming Bolt described the trend as a gimmick that had died with the generation, and criticised the heavy use of the technique in major releases of the time such as The Elder Scrolls IV: Oblivion (2006), the Xbox 360 port of Burnout Revenge (2006), and Twilight Princess (2006). Syndicate (2012) has also been described as featuring "eye-melting" bloom. [11] [12]

See also

Related Research Articles

<span class="mw-page-title-main">Charge-coupled device</span> Device for the movement of electrical charge

A charge-coupled device (CCD) is an integrated circuit containing an array of linked, or coupled, capacitors. Under the control of an external circuit, each capacitor can transfer its electric charge to a neighboring capacitor. CCD sensors are a major technology used in digital imaging.

<span class="mw-page-title-main">Pixel</span> Physical point in a raster image

In digital imaging, a pixel, pel, or picture element is the smallest addressable element in a raster image, or the smallest addressable element in a dot matrix display device. In most digital display devices, pixels are the smallest element that can be manipulated through software.

<span class="mw-page-title-main">Photodiode</span> Converts light into current

A photodiode is a light-sensitive semiconductor diode. It produces current when it absorbs photons.

<span class="mw-page-title-main">Bokeh</span> Aesthetic quality of blur in the out-of-focus parts of an image

In photography, bokeh is the aesthetic quality of the blur produced in out-of-focus parts of an image, caused by circles of confusion. Bokeh has also been defined as "the way the lens renders out-of-focus points of light". Differences in lens aberrations and aperture shape cause very different bokeh effects. Some lens designs blur the image in a way that is pleasing to the eye, while others produce distracting or unpleasant blurring. Photographers may deliberately use a shallow focus technique to create images with prominent out-of-focus regions, accentuating their lens's bokeh.

<span class="mw-page-title-main">Lens flare</span> Image artifact that scattered or flared light within a lens system produces

A lens flare happens when light is scattered or flared in a lens system, often in response to a bright light, producing a sometimes undesirable artifact in the image. This happens through light scattered by the imaging mechanism itself, for example through internal reflection and forward scatter from material imperfections in the lens. Lenses with large numbers of elements such as zooms tend to have more lens flare, as they contain a relatively large number of interfaces at which internal scattering may occur. These mechanisms differ from the focused image generation mechanism, which depends on rays from the refraction of light from the subject itself.

<span class="mw-page-title-main">Video camera</span> Camera used for electronic motion picture acquisition

A video camera is an optical instrument that captures videos. Video cameras were initially developed for the television industry but have since become widely used for a variety of other purposes.

<span class="mw-page-title-main">Airy disk</span> Diffraction pattern in optics

In optics, the Airy disk and Airy pattern are descriptions of the best-focused spot of light that a perfect lens with a circular aperture can make, limited by the diffraction of light. The Airy disk is of importance in physics, optics, and astronomy.

<span class="mw-page-title-main">Vignetting</span> Reduction of an images brightness or saturation toward the periphery compared to the image center

In photography and optics, vignetting is a reduction of an image's brightness or saturation toward the periphery compared to the image center. The word vignette, from the same root as vine, originally referred to a decorative border in a book. Later, the word came to be used for a photographic portrait that is clear at the center and fades off toward the edges. A similar effect is visible in photographs of projected images or videos off a projection screen, resulting in a so-called "hotspot" effect.

<span class="mw-page-title-main">Active shutter 3D system</span> Method of displaying stereoscopic 3D images

An active shutter 3D system is a technique of displaying stereoscopic 3D images. It works by only presenting the image intended for the left eye while blocking the right eye's view, then presenting the right-eye image while blocking the left eye, and repeating this so rapidly that the interruptions do not interfere with the perceived fusion of the two images into a single 3D image.

Optical resolution describes the ability of an imaging system to resolve detail, in the object that is being imaged. An imaging system may have many individual components, including one or more lenses, and/or recording and display components. Each of these contributes to the optical resolution of the system; the environment in which the imaging is done often is a further important factor.

<span class="mw-page-title-main">High-dynamic-range rendering</span> Rendering of computer graphics scenes by using lighting calculations done in high-dynamic-range

High-dynamic-range rendering, also known as high-dynamic-range lighting, is the rendering of computer graphics scenes by using lighting calculations done in high dynamic range (HDR). This allows preservation of details that may be lost due to limiting contrast ratios. Video games and computer-generated movies and special effects benefit from this as it creates more realistic scenes than with more simplistic lighting models.

<span class="mw-page-title-main">Image noise</span> Visible interference in an image

Image noise is random variation of brightness or color information in images, and is usually an aspect of electronic noise. It can be produced by the image sensor and circuitry of a scanner or digital camera. Image noise can also originate in film grain and in the unavoidable shot noise of an ideal photon detector. Image noise is an undesirable by-product of image capture that obscures the desired information. Typically the term “image noise” is used to refer to noise in 2D images, not 3D images.

<span class="mw-page-title-main">Image sensor</span> Device that converts images into electronic signals

An image sensor or imager is a sensor that detects and conveys information used to form an image. It does so by converting the variable attenuation of light waves into signals, small bursts of current that convey the information. The waves can be light or other electromagnetic radiation. Image sensors are used in electronic imaging devices of both analog and digital types, which include digital cameras, camera modules, camera phones, optical mouse devices, medical imaging equipment, night vision equipment such as thermal imaging devices, radar, sonar, and others. As technology changes, electronic and digital imaging tends to replace chemical and analog imaging.

The following are common definitions related to the machine vision field.

<span class="mw-page-title-main">Active-pixel sensor</span> Image sensor, consisting of an integrated circuit

An active-pixel sensor (APS) is an image sensor, which was invented by Peter J.W. Noble in 1968, where each pixel sensor unit cell has a photodetector and one or more active transistors. In a metal–oxide–semiconductor (MOS) active-pixel sensor, MOS field-effect transistors (MOSFETs) are used as amplifiers. There are different types of APS, including the early NMOS APS and the now much more common complementary MOS (CMOS) APS, also known as the CMOS sensor. CMOS sensors are used in digital camera technologies such as cell phone cameras, web cameras, most modern digital pocket cameras, most digital single-lens reflex cameras (DSLRs), mirrorless interchangeable-lens cameras (MILCs), and lensless imaging for cells.

The term post-processing is used in the video/film business for quality-improvement image processing methods used in video playback devices, such as stand-alone DVD-Video players; video playing software; and transcoding software. It is also commonly used in real-time 3D rendering to add additional effects.

<span class="mw-page-title-main">Image processor</span> Specialized digital signal processor used for image processing

An image processor, also known as an image processing engine, image processing unit (IPU), or image signal processor (ISP), is a type of media processor or specialized digital signal processor (DSP) used for image processing, in digital cameras or other devices. Image processors often employ parallel computing even with SIMD or MIMD technologies to increase speed and efficiency. The digital image processing engine can perform a range of tasks. To increase the system integration on embedded devices, often it is a system on a chip with multi-core processor architecture.

Screen space ambient occlusion (SSAO) is a computer graphics technique for efficiently approximating the ambient occlusion effect in real time. It was developed by Vladimir Kajalin while working at Crytek and was used for the first time in 2007 by the video game Crysis, also developed by Crytek.

<span class="mw-page-title-main">Image editing</span> Processes of altering images, digital or traditional photos, adding, pasting, cutting words

Image editing encompasses the processes of altering images, whether they are digital photographs, traditional photo-chemical photographs, or illustrations. Traditional analog image editing is known as photo retouching, using tools such as an airbrush to modify photographs or editing illustrations with any traditional art medium. Graphic software programs, which can be broadly grouped into vector graphics editors, raster graphics editors, and 3D modelers, are the primary tools with which a user may manipulate, enhance, and transform images. Many image editing programs are also used to render or create computer art from scratch. The term "image editing" usually refers only to the editing of 2D images, not 3D ones.

An angle-sensitive pixel (ASP) is a CMOS sensor with a sensitivity to incoming light that is sinusoidal in incident angle.

References

  1. 1 2 James, Greg; O'Rorke, John (26 May 2004). "Real-Time Glow". Game Developer/Gamasutra. Archived from the original on 26 Jan 2022. Retrieved 17 March 2022.
  2. "Airy disk". svi.nl. Archived from the original on 2007-05-07. Retrieved 2007-05-03.
  3. CCD Saturation and Blooming
  4. "How to do good bloom for HDR rendering". Harry Kalogirou. Archived from the original on 2006-08-18. Retrieved 2006-05-20.
  5. Forcade, Tim (February 1998). "Unraveling Riven". Computer Graphics World.
  6. "Doom to Dunia: A Visual History of 3D Game Engines – Page 5". Maximum PC. 2009-07-21. Archived from the original on February 8, 2015. Retrieved 2015-03-05.
  7. Massey, Tom (9 February 2015). "Ys: Memories of Celceta review". Eurogamer . Retrieved 25 February 2022.
  8. Mielke, James (2005-10-15). "Bittersweet Symphony". 1UP. Archived from the original on 2012-06-29. Retrieved 2008-10-07.
  9. "Bloom Disasters – The Quixotic Engineer".
  10. Ocampo, Jason (7 July 2005). "RollerCoaster Tycoon 3: Soaked! Review". GameSpot. Retrieved 17 March 2022.
  11. Houghton, David (8 March 2012). "56 eye-melting screens of the most hilariously over-the-top bloom lighting in video game history" . Retrieved 17 March 2022.
  12. Gallant, Matthew (18 July 2008). "Bloom Disasters - The Quixotic Engineer" . Retrieved 17 March 2022.