Polynomial texture mapping

Last updated

Polynomial texture mapping (PTM), also known as Reflectance Transformation Imaging (RTI), is a technique of imaging and interactively displaying objects under varying lighting conditions to reveal surface phenomena. The data acquisition method is Single Camera Multi Light (SCML). [1]

Contents

Origins

The method was originally developed by Tom Malzbender of HP Labs in order to generate enhanced 3D computer graphics and it has since been adopted for cultural heritage applications. [2]

Methodology

A series of images is captured in a darkened environment with the camera in a fixed position and the object lit from different angles (Single Camera Multi Light). Interactive software processes and combines the set of images to enable the user inspecting the object to control a virtual light source. [2] The virtual light source may be manipulated to simulate light from different angles and of different intensity or wavelengths to illuminate the surface of artefacts and reveal details. [2] [3] Open-source tools for processing the captured images and publishing the resulting relightable images on the web are freely available. [4]

Applications

Polynomial texture mapping may be used for detailed recording and documentation, 3D modeling, edge detection, and to aid the study of inscriptions, rock art [5] and other artefacts. [3] [6] It has been applied to hundreds of the Vindolanda tablets by the Centre for the Study of Ancient Documents at the University of Oxford in conjunction with the British Museum. [7] It has also been deployed, by Ben Altshuler of the Institute for Digital Archaeology, to scan the Philae obelisk at Kingston Lacy and the Parian Chronicle at the Ashmolean Museum; in both cases scans revealed significant, previously illegible text. [8] [9] [10] Method was also used for identifying microscopic worked antler from Star Carr and recording ancient rock art in Armenia. [11]

A 'dome' supporting twenty-four lights has been used to image paintings in the National Gallery and produce polynomial texture maps, providing information on condition phenomena for conservation purposes. [12] Studies of the technique at the National Gallery and Tate concluded that it is an effective tool for documenting changes in the condition of paintings, more easily repeatable than raking light photography, and therefore could be used to assess paintings during structural treatment and before and after loan. [13] Twelve dome-based systems built by the University of Southampton have been used to capture thousands of cuneiform tablets at various museums. [14] [15] [16]

The technique is now also finding uses in the field of forensic science, for example in imaging footprints, tyre marks, and indented writing.

See also

Related Research Articles

<span class="mw-page-title-main">Rendering (computer graphics)</span> Process of generating an image from a model

Rendering or image synthesis is the process of generating a photorealistic or non-photorealistic image from a 2D or 3D model by means of a computer program. The resulting image is referred to as the render. Multiple models can be defined in a scene file containing objects in a strictly defined language or data structure. The scene file contains geometry, viewpoint, texture, lighting, and shading information describing the virtual scene. The data contained in the scene file is then passed to a rendering program to be processed and output to a digital image or raster graphics image file. The term "rendering" is analogous to the concept of an artist's impression of a scene. The term "rendering" is also used to describe the process of calculating effects in a video editing program to produce the final video output.

<span class="mw-page-title-main">Texture mapping</span> Method of defining surface detail on a computer-generated graphic or 3D model

Texture mapping is a method for mapping a texture on a computer-generated graphic. Texture here can be high frequency detail, surface texture, or color.

<span class="mw-page-title-main">Normal mapping</span> Texture mapping technique

In 3D computer graphics, normal mapping, or Dot3 bump mapping, is a texture mapping technique used for faking the lighting of bumps and dents – an implementation of bump mapping. It is used to add details without using more polygons. A common use of this technique is to greatly enhance the appearance and details of a low polygon model by generating a normal map from a high polygon model or height map.

<span class="mw-page-title-main">Ray casting</span> Methodological basis for 3D CAD/CAM solid modeling and image rendering

Ray casting is the methodological basis for 3D CAD/CAM solid modeling and image rendering. It is essentially the same as ray tracing for computer graphics where virtual light rays are "cast" or "traced" on their path from the focal point of a camera through each pixel in the camera sensor to determine what is visible along the ray in the 3D scene. The term "Ray Casting" was introduced by Scott Roth while at the General Motors Research Labs from 1978–1980. His paper, "Ray Casting for Modeling Solids", describes modeled solid objects by combining primitive solids, such as blocks and cylinders, using the set operators union (+), intersection (&), and difference (-). The general idea of using these binary operators for solid modeling is largely due to Voelcker and Requicha's geometric modelling group at the University of Rochester. See solid modeling for a broad overview of solid modeling methods. This figure on the right shows a U-Joint modeled from cylinders and blocks in a binary tree using Roth's ray casting system in 1979.

<span class="mw-page-title-main">Real-time computer graphics</span> Sub-field of computer graphics

Real-time computer graphics or real-time rendering is the sub-field of computer graphics focused on producing and analyzing images in real time. The term can refer to anything from rendering an application's graphical user interface (GUI) to real-time image analysis, but is most often used in reference to interactive 3D computer graphics, typically using a graphics processing unit (GPU). One example of this concept is a video game that rapidly renders changing 3D environments to produce an illusion of motion.

<span class="mw-page-title-main">Subsurface scattering</span>

Subsurface scattering (SSS), also known as subsurface light transport (SSLT), is a mechanism of light transport in which light that penetrates the surface of a translucent object is scattered by interacting with the material and exits the surface at a different point. The light will generally penetrate the surface and be reflected a number of times at irregular angles inside the material before passing back out of the material at a different angle than it would have had if it had been reflected directly off the surface. Subsurface scattering is important for realistic 3D computer graphics, being necessary for the rendering of materials such as marble, skin, leaves, wax and milk. If subsurface scattering is not implemented, the material may look unnatural, like plastic or metal.

<span class="mw-page-title-main">Reflection mapping</span>

In computer graphics, environment mapping, or reflection mapping, is an efficient image-based lighting technique for approximating the appearance of a reflective surface by means of a precomputed texture. The texture is used to store the image of the distant environment surrounding the rendered object.

<span class="mw-page-title-main">3D scanning</span> Scanning of an object or environment to collect data on its shape

3D scanning is the process of analyzing a real-world object or environment to collect three dimensional data of its shape and possibly its appearance. The collected data can then be used to construct digital 3D models.

<span class="mw-page-title-main">Spectral imaging</span> Branch of spectroscopy and of photography

Spectral imaging is imaging that uses multiple bands across the electromagnetic spectrum. While an ordinary camera captures light across three wavelength bands in the visible spectrum, red, green, and blue (RGB), spectral imaging encompasses a wide variety of techniques that go beyond RGB. Spectral imaging may use the infrared, the visible spectrum, the ultraviolet, x-rays, or some combination of the above. It may include the acquisition of image data in visible and non-visible bands simultaneously, illumination from outside the visible range, or the use of optical filters to capture a specific spectral range. It is also possible to capture hundreds of wavelength bands for each pixel in an image.

<span class="mw-page-title-main">Shadow mapping</span> Method to draw shadows in computer graphic images

Shadow mapping or shadowing projection is a process by which shadows are added to 3D computer graphics. This concept was introduced by Lance Williams in 1978, in a paper entitled "Casting curved shadows on curved surfaces." Since then, it has been used both in pre-rendered and realtime scenes in many console and PC games.

<span class="mw-page-title-main">3D rendering</span> Process of converting 3D scenes into 2D images

3D rendering is the 3D computer graphics process of converting 3D models into 2D images on a computer. 3D renders may include photorealistic effects or non-photorealistic styles.

The following outline is provided as an overview of and topical guide to photography:

<span class="mw-page-title-main">Reflection (computer graphics)</span> Simulation of reflective surfaces

Reflection in computer graphics is used to render reflective objects like mirrors and shiny surfaces.

Range imaging is the name for a collection of techniques that are used to produce a 2D image showing the distance to points in a scene from a specific point, normally associated with some type of sensor device.

<span class="mw-page-title-main">Inpainting</span> Image conservation process

Inpainting is a conservation process where damaged, deteriorated, or missing parts of an artwork are filled in to present a complete image. This process is commonly used in image restoration. It can be applied to both physical and digital art mediums such as oil or acrylic paintings, chemical photographic prints, sculptures, or digital images and video.

<span class="mw-page-title-main">Computer graphics</span> Graphics created using computers

Computer graphics deals with generating images and art with the aid of computers. Today, computer graphics is a core technology in digital photography, film, video games, digital art, cell phone and computer displays, and many specialized applications. A great deal of specialized hardware and software has been developed, with the displays of most devices being driven by computer graphics hardware. It is a vast and recently developed area of computer science. The phrase was coined in 1960 by computer graphics researchers Verne Hudson and William Fetter of Boeing. It is often abbreviated as CG, or typically in the context of film as computer generated imagery (CGI). The non-artistic aspects of computer graphics are the subject of computer science research.

<span class="mw-page-title-main">Digital outcrop model</span> Digital 3D representation of the outcrop surface

A digital outcrop model (DOM), also called a virtual outcrop model, is a digital 3D representation of the outcrop surface, mostly in a form of textured polygon mesh.

This is a glossary of terms relating to computer graphics.

Cultural property imaging is a necessary part of long term preservation of cultural heritage. While the physical conditions of objects will change over time, imaging serves as a way to document and represent heritage in a moment in time of the life of the item. Different methods of imaging produce results that are applicable in various circumstances. Not every method is appropriate for every object, and not every object needs to be imaged by multiple methods. In addition to preservation and conservation-related concerns, imaging can also serve to enhance research and study of cultural heritage.

Digital archaeology is the application of information technology and digital media to archaeology. It includes the use of digital photography, 3D reconstruction, virtual reality, and geographical information systems, among other techniques. Computational archaeology, which covers computer-based analytical methods, can be considered a subfield of digital archaeology, as can virtual archaeology.

References

  1. Vanweddingen, Vincent; Hameeuw, Hendrik; Vandermeulen, Bruno; Vastenhoud, Chris; Watteeuw, Lieve; Lemmers, Frédéric; Van Der Perre, Athena; Konijn, Paul; Van Gool, Luc; Proesmans, Marc (2020). "Pixel+: Integrating and standardizing of various interactive pixel-based imagery". In Schelkens, Peter; Kozacki, Tomasz (eds.). Optics, Photonics and Digital Technologies for Imaging Applications VI. Proceedings of SPIE. Vol. 11353. p. 15. doi:10.1117/12.2555685. ISBN   9781510634787. S2CID   216318287.
  2. 1 2 3 "Archaeology and polynomial texture mapping". The Economist . 25 March 2010. Retrieved 8 March 2011.
  3. 1 2 "Polynomial texture mapping". University of Southampton . Retrieved 8 March 2011.
  4. "Reflectance Transformation Imaging (RTI) Tools". Visual Computing Lab - ISTI - CNR.
  5. Mourey, Jules Masson (January 2019). "First application of Reflectance Transformation Imaging (RTI) on Prehistoric Rock Engravings of the Monte Bego Region (Tende, Alpes-Maritimes, France)". International Newsletter on Rock Art (84): 24–30.{{cite journal}}: CS1 maint: date and year (link)
  6. "Polynomial texture mapping". University of Southampton . Retrieved 8 March 2011.
  7. Earl, Graeme (et al.) (2010). "Archaeological applications of polynomial texture mapping: analysis, conservation and representation". Journal of Archaeological Science. 37 (8): 1–11. Bibcode:2010JArSc..37.2040E. doi:10.1016/j.jas.2010.03.009 . Retrieved 8 March 2011.
  8. "The Parian Marble at The Ashmolean Museum". Institute for Digital Archaeology. Retrieved 24 September 2015.
  9. Altshuler, Ben F S; Mannack, Thomas (2014). "Shedding New Light on Ancient Objects". Arion: A Journal of Humanities and the Classics. 22 (1): 53–74. doi:10.2307/arion.22.1.0053. JSTOR   arion.22.1.0053. S2CID   171785310.
  10. "The Digital Marmor Parium Project at the University of Leipzig".
  11. Kennedy, Hannah. "Visual interpretation, survey and graphics: adding value to archaeology" (PDF). 2020: Yearbook and Directory: 17 via Chartered Institute for Archaeologists.
  12. MacDonald, Lindsay, ed. (2006). "Digital Imaging for Easel Paintings". Digital Heritage:Applying Digital Imaging to Cultural Heritage . Butterworth-Heinemann. pp.  525 ff. ISBN   978-0-7506-6183-6.
  13. Payne, Emma Marie (2012). "Imaging Techniques in Conservation" (PDF). Journal of Conservation and Museum Studies. 10 (2): 17–29. doi: 10.5334/jcms.1021201 .
  14. Reflectance transformation imaging systems for ancient documentary artefacts, British Computer Society, 2011, pp. 147–154, ISBN   9781906124885
  15. Artusi, Alessandro (2010), Reflectance Transformation Imaging (RTI) System for Ancient Documentary Artefacts, Eurographics Assoc., pp. 116–119, ISBN   9783905673760
  16. "Custom Imaging".