Cube mapping

The lower left image shows a scene with a viewpoint marked with a black dot. The upper image shows the net of the cube mapping as seen from that viewpoint, and the lower right image shows the cube superimposed on the original scene.

In computer graphics, cube mapping is a method of environment mapping that uses the six faces of a cube as the map shape. The environment is projected onto the sides of a cube and stored as six square textures, or unfolded into six regions of a single texture.

The cube map is generated by first rendering the scene six times from a viewpoint, with the views defined by a 90 degree view frustum representing each cube face. ^[1] Or if the environment is first considered to be projected onto a sphere, then each face of the cube is its Gnomonic projection.

In the majority of cases, cube mapping is preferred over the older method of sphere mapping because it eliminates many of the problems that are inherent in sphere mapping such as image distortion, viewpoint dependency, and computational inefficiency. Also, cube mapping provides a much larger capacity to support real-time rendering of reflections relative to sphere mapping because the combination of inefficiency and viewpoint dependency severely limits the ability of sphere mapping to be applied when there is a consistently changing viewpoint.

Variants of cube mapping are also commonly used in 360 video projection. ^[2]

History

Cube mapping was first proposed in 1986 by Ned Greene in his paper “Environment Mapping and Other Applications of World Projections”, ^[3] ten years after environment mapping was first put forward by Jim Blinn and Martin Newell. However, hardware limitations on the ability to access six texture images simultaneously made it infeasible to implement cube mapping without further technological developments. This problem was remedied in 1999 with the release of the Nvidia GeForce 256. Nvidia touted cube mapping in hardware as “a breakthrough image quality feature of GeForce 256 that ... will allow developers to create accurate, real-time reflections. Accelerated in hardware, cube environment mapping will free up the creativity of developers to use reflections and specular lighting effects to create interesting, immersive environments.” ^[4] Today, cube mapping is still used in a variety of graphical applications as a favored method of environment mapping.

Advantages

Cube mapping is preferred over other methods of environment mapping because of its relative simplicity. Also, cube mapping produces results that are similar to those obtained by ray tracing, but is much more computationally efficient – the moderate reduction in quality is compensated for by large gains in efficiency.

Pre-dating cube mapping, sphere mapping has many inherent flaws that made it impractical for most applications. Sphere mapping is view-dependent, meaning that a different texture is necessary for each viewpoint. Therefore, in applications where the viewpoint is mobile, it would be necessary to dynamically generate a new sphere mapping for each new viewpoint (or, to pre-generate a mapping for every viewpoint). Also, a texture mapped onto a sphere's surface must be stretched and compressed, and warping and distortion (particularly along the edge of the sphere) are a direct consequence of this. Although these image flaws can be reduced using certain tricks and techniques like “pre-stretching”, this just adds another layer of complexity to sphere mapping.

Paraboloid mapping provides some improvement on the limitations of sphere mapping, however it requires two rendering passes in addition to special image warping operations and more involved computation.

Conversely, cube mapping requires only a single render pass, and due to its simple nature, is very easy for developers to comprehend and generate. Also, cube mapping uses the entire resolution of the texture image, compared to sphere and paraboloid mappings, which also allows it to use lower resolution images to achieve the same quality. Although handling the seams of the cube map is a problem, algorithms have been developed to handle seam behavior and result in a seamless reflection.

Disadvantages

If a new object or new lighting is introduced into scene or if some object that is reflected in it is moving or changing in some manner, then the reflection changes and the cube map must be re-rendered. When the cube map is affixed to an object that moves through the scene then the cube map must also be re-rendered from that new position.^{[ citation needed ]}

Applications

Stable specular highlights

Computer-aided design (CAD) programs use specular highlights as visual cues to convey a sense of surface curvature when rendering 3D objects. However, many CAD programs exhibit problems in sampling specular highlights because the specular lighting computations are only performed at the vertices of the mesh used to represent the object, and interpolation is used to estimate lighting across the surface of the object. Problems occur when the mesh vertices are not dense enough, resulting in insufficient sampling of the specular lighting. This in turn results in highlights with brightness proportionate to the distance from mesh vertices, ultimately compromising the visual cues that indicate curvature. Unfortunately, this problem cannot be solved simply by creating a denser mesh, as this can greatly reduce the efficiency of object rendering.

Cube maps provide a fairly straightforward and efficient solution to rendering stable specular highlights. Multiple specular highlights can be encoded into a cube map texture, which can then be accessed by interpolating across the surface's reflection vector to supply coordinates. Relative to computing lighting at individual vertices, this method provides cleaner results that more accurately represent curvature. Another advantage to this method is that it scales well, as additional specular highlights can be encoded into the texture at no increase in the cost of rendering. However, this approach is limited in that the light sources must be either distant or infinite lights, although fortunately this is usually the case in CAD programs.

Skyboxes

Renders using cubemaps can look better in outdoor scenes. (Left is with a cubemap, right is with a basic sun light). Rendered in Blender Cycles.

Example of a texture that can be mapped to the faces of a cubic skybox, with faces labelled

Perhaps the most advanced application of cube mapping is to create pre-rendered panoramic sky images which are then rendered by the graphical engine as faces of a cube at practically infinite distance with the view point located in the center of the cube. The perspective projection of the cube faces done by the graphics engine undoes the effects of projecting the environment to create the cube map, so that the observer experiences an illusion of being surrounded by the scene which was used to generate the skybox. This technique has found a widespread use in video games since it allows designers to add complex (albeit not explorable) environments to a game at almost no performance cost.

Skylight illumination

Cube maps can be useful for modelling outdoor illumination accurately. Simply modelling sunlight as a single infinite light oversimplifies outdoor illumination and results in unrealistic lighting. Although plenty of light does come from the sun, the scattering of rays in the atmosphere causes the whole sky to act as a light source (often referred to as skylight illumination). However, by using a cube map the diffuse contribution from skylight illumination can be captured. Unlike environment maps where the reflection vector is used, this method accesses the cube map based on the surface normal vector to provide a fast approximation of the diffuse illumination from the skylight. The one downside to this method is that computing cube maps to properly represent a skylight is very complex; one recent process is computing the spherical harmonic basis that best represents the low frequency diffuse illumination from the cube map. However, a considerable amount of research has been done to effectively model skylight illumination.

Dynamic reflection

Cube-mapped reflections in action

Basic environment mapping uses a static cube map - although the object can be moved and distorted, the reflected environment stays consistent. However, a cube map texture can be consistently updated to represent a dynamically changing environment (for example, trees swaying in the wind). A simple yet costly way to generate dynamic reflections, involves building the cube maps at runtime for every frame. Although this is far less efficient than static mapping because of additional rendering steps, it can still be performed at interactive rates.

Unfortunately, this technique does not scale well when multiple reflective objects are present. A unique dynamic environment map is usually required for each reflective object. Also, further complications are added if reflective objects can reflect each other - dynamic cube maps can be recursively generated approximating the effects normally generated using raytracing.

Global illumination

An algorithm for global illumination computation at interactive rates using a cube-map data structure, was presented at ICCVG 2002.

Projection textures

Another application which found widespread use in video games is projective texture mapping. It relies on cube maps to project images of an environment onto the surrounding scene; for example, a point light source is tied to a cube map which is a panoramic image shot from inside a lantern cage or a window frame through which the light is filtering. This enables a game developer to achieve realistic lighting without having to complicate the scene geometry or resort to expensive real-time shadow volume computations.

Memory addressing

This illustration shows how a cube map is indexed and addressed.

A cube texture indexes six texture maps from 0 to 5 in order Positive X, Negative X, Positive Y, Negative Y, Positive Z, Negative Z. ^{[5] [6]} The images are stored with the origin at the lower left of the image. The Positive X and Y faces must reverse the Z coordinate and the Negative Z face must negate the X coordinate. If given the face, and texture coordinates ${\displaystyle (u,v)}$, the non-normalized vector ${\displaystyle (x,y,z)}$ can be computed by the function:

voidconvert_cube_uv_to_xyz(intindex,floatu,floatv,float*x,float*y,float*z){// convert range 0 to 1 to -1 to 1floatuc=2.0f*u-1.0f;floatvc=2.0f*v-1.0f;switch(index){case0:*x=1.0f;*y=vc;*z=-uc;break;// POSITIVE Xcase1:*x=-1.0f;*y=vc;*z=uc;break;// NEGATIVE Xcase2:*x=uc;*y=1.0f;*z=-vc;break;// POSITIVE Ycase3:*x=uc;*y=-1.0f;*z=vc;break;// NEGATIVE Ycase4:*x=uc;*y=vc;*z=1.0f;break;// POSITIVE Zcase5:*x=-uc;*y=vc;*z=-1.0f;break;// NEGATIVE Z}}

Likewise, a vector ${\displaystyle (x,y,z)}$ can be converted to the face index and texture coordinates ${\displaystyle (u,v)}$ with the function:

voidconvert_xyz_to_cube_uv(floatx,floaty,floatz,int*index,float*u,float*v){floatabsX=fabs(x);floatabsY=fabs(y);floatabsZ=fabs(z);intisXPositive=x>0?1:0;intisYPositive=y>0?1:0;intisZPositive=z>0?1:0;floatmaxAxis,uc,vc;// POSITIVE Xif(isXPositive&&absX>=absY&&absX>=absZ){// u (0 to 1) goes from +z to -z// v (0 to 1) goes from -y to +ymaxAxis=absX;uc=-z;vc=y;*index=0;}// NEGATIVE Xif(!isXPositive&&absX>=absY&&absX>=absZ){// u (0 to 1) goes from -z to +z// v (0 to 1) goes from -y to +ymaxAxis=absX;uc=z;vc=y;*index=1;}// POSITIVE Yif(isYPositive&&absY>=absX&&absY>=absZ){// u (0 to 1) goes from -x to +x// v (0 to 1) goes from +z to -zmaxAxis=absY;uc=x;vc=-z;*index=2;}// NEGATIVE Yif(!isYPositive&&absY>=absX&&absY>=absZ){// u (0 to 1) goes from -x to +x// v (0 to 1) goes from -z to +zmaxAxis=absY;uc=x;vc=z;*index=3;}// POSITIVE Zif(isZPositive&&absZ>=absX&&absZ>=absY){// u (0 to 1) goes from -x to +x// v (0 to 1) goes from -y to +ymaxAxis=absZ;uc=x;vc=y;*index=4;}// NEGATIVE Zif(!isZPositive&&absZ>=absX&&absZ>=absY){// u (0 to 1) goes from +x to -x// v (0 to 1) goes from -y to +ymaxAxis=absZ;uc=-x;vc=y;*index=5;}// Convert range from -1 to 1 to 0 to 1*u=0.5f*(uc/maxAxis+1.0f);*v=0.5f*(vc/maxAxis+1.0f);}

References

1. Fernando, R. & Kilgard M. J. (2003). The CG Tutorial: The Definitive Guide to Programmable Real-Time Graphics. (1st ed.). Addison-Wesley Longman Publishing Co., Inc. Boston, MA, USA. Chapter 7: Environment Mapping Techniques
2. stevewhims (2021-01-06). "Cubic Environment Mapping (Direct3D 9) - Win32 apps". learn.microsoft.com. Retrieved 2024-08-21.
3. Greene, N (1986). "Environment mapping and other applications of world projections". IEEE Comput. Graph. Appl. 6 (11): 21–29. doi:10.1109/MCG.1986.276658. S2CID   11301955.
4. Nvidia, Jan 2000. Technical Brief: Perfect Reflections and Specular Lighting Effects With Cube Environment Mapping Archived 2008-10-04 at the Wayback Machine
5. "Introduction To Textures in Direct3D 11 - Win32 apps | Microsoft Docs". 23 August 2019.
6. "Chapter 19. Image-Based Lighting".

See also

• Quadrilateralized spherical cube
• Spherical image projection