Photographic mosaic

Last updated
A photographic mosaic of the 1911 painting by Franz Marc, Blue Horse I Franz Marc Blue Horse 1911 Photomosaic.jpg
A photographic mosaic of the 1911 painting by Franz Marc, Blue Horse I
A photographic mosaic of a sea gull made from pictures of birds and other nature photos using hexagonal tiles Mosaicr seagull.jpg
A photographic mosaic of a sea gull made from pictures of birds and other nature photos using hexagonal tiles

A photographic mosaic or photomosaic is a picture (usually a photograph) that has been divided into tiled sections, usually equal sized, each of which is replaced with another photograph that matches the target photo. [1] When viewed at low magnifications, the individual pixels appear as the primary image, while close examination reveals that the image is in fact made up of many hundreds or thousands of smaller images. [1] Most of the time they are a computer-created type of montage.

Contents

There are two kinds of mosaic, depending on how the matching is done. In the simpler kind, each part of the target image is averaged down to a single color. Each of the library images is also reduced to a single color. Each part of the target image is then replaced with one from the library where these colors are as similar as possible. In effect, the target image is reduced in resolution (by downsampling), and then each of the resulting pixels is replaced with an image whose average color matches that pixel.

In the more advanced kind of photographic mosaic, the target image is not downsampled, and the matching is done by comparing each pixel in the rectangle to the corresponding pixel from each library image. The rectangle in the target is then replaced with the library image that minimizes the total difference. This requires much more computation than the simple kind, but the results can be much better since the pixel-by-pixel matching can preserve the resolution of the target image.

History

1993 Live from Bell Labs event poster Photo-mosaic-Joseph-Francis.jpg
1993 Live from Bell Labs event poster
Puzzle photographic mosaic of London Royal Albert Hall by Andrej Olejnik Andrej olejnik-albert-hall mosaic 2000.jpg
Puzzle photographic mosaic of London Royal Albert Hall by Andrej Olejnik

Artistic aspects

There is debate over whether Photomosaics are an art or mere technique. [4] The making of a photomosaic is sometimes parallelled and compared to forms of artistic appropriation, like literary assemblage. [5]

Artists such as David Hockney, Christopher Kates and Pep Ventosa have pioneered their own photographic mosaic techniques where multiple photographs are taken of a scene and then pieced together again to create a cohesive image.

Trademark and intellectual property of the concept

Robert Silvers, a Master's student at MIT, filed for a trademark on the term Photomosaic on September 3, 1996. This trademark was registered on August 12, 2003. [3]

Silvers also applied for a U.S. patent on the production of Photomosaics on January 2, 1997, which was granted as US 6137498   in October 2000 and has been assigned to Runaway Technology, Inc. Patent applications in other countries were also filed, and patents granted include EP 0852363  , JP 10269353  , CA 2226059  , and AU 723815B  . He is quoted as saying: "By being granted this patent in the United States and other countries, we can protect our proprietary innovations and continue to make unique artwork." [6] In September 2008, the Public Patent Foundation filed a formal request with the United States Patent and Trademark Office (USPTO) to review certain claims in the US 6137498   on photomosaics. The request was granted and a reexamination proceeding ensued. On August 31, 2010, the USPTO issued a Reexamination Certificate confirming the patentability of all claims in the patent which were amended to refer to shape matching (a feature that contributes to the high resolution of photomosaics).

There are a number of other commercial companies that create mosaics with photos. Since there has been no litigation of these patents, these companies must therefore either use processes that do not infringe on the particular claimed process, have licenses under the patents, or are infringing those patents but Runaway Technology has chosen not to bring infringement proceedings.

Silvers' patent may be regarded as a software patent, a subject over which there is a great deal of debate. For example, Article 52(2)(c) EPC states that "programs for computers as such" are not regarded as patentable inventions. Nevertheless, current practice relating to computer-implemented inventions under the EPC means that a process that provides a technical effect may be patented even if it is implemented by a computer.

The UK patent deriving from EP 0852363   became the subject of revocation proceedings in July 2006. [7] In September 2009, the UK Intellectual Property Office (UK-IPO) decided that the patent should not be revoked and terminated the proceeding. The European patents expired on 31 December 2017.

Video mosaic

Photographic mosaics are typically formed from a collection of still images. A more recent phenomenon, however, has been video mosaics which assemble video clips rather than still images to create a larger image. The closing credits of the 2005 PlayStation 2 game God of War , for example, incorporates a still image of the main character, Kratos, formed from a number of in-game videos.

The term "video mosaic" also describes a large still image made from adjacent frames of video, such as those from video shots of geographic features like roads or cities. A mosaic of the video's relevant frames replaces the full video, saving time and bandwidth, since the stills are much smaller.

See also

Notes

  1. 1 2 Cartwright (2007) p.102 quote: Photographic mosaic, also known as Photomosaic, a portmanteau of photo and mosaic, is a picture that is divided into small sections. When viewed as a whole, it appears to be one image, when in fact the image is made up of hundreds or even thousands of smaller images.
  2. Harmon, Leon D. (November 1973). "The Recognition of Faces". Scientific American. 229 (5): 70–82. Bibcode:1973SciAm.229e..70H. doi:10.1038/scientificamerican1173-70 . Retrieved 4 September 2023.
  3. 1 2 "Trademark information for Trademark 75159436". US Trademark Office. Retrieved 2007-08-16.
  4. Silvers (2000) quote: "More than anything else people ask me whether Photomosaics are an art or a science. l tell them that Photomosaics, like any art in formative stage, has elements of both."
  5. Menke (2008) p.232 quote: [In Rudyard Kipling's 1902 science-fiction short story "Wireless"] we recognize that the tale's marshalling of realistic particulars has also been a systematic importation of details from Keats's poetry and life history [...] The tale's elaborate descriptions were really Keats's pre-scriptions all along. As in a photomosaic image, the elements of the story that make it seem recognizable and real turn out to be chosen from an artificially constrained palette of appropriations; examined closely, each realistic detail reveals itself as a micro-quotation from that collection.
  6. Silvers, Robert. "Robert Silvers | Corporate | Patents". Runaway Technology, Inc. Retrieved November 12, 2011.
  7. Using the UK Patents Status Enquiry for EP0852363 provides full details on the current status of the patent.

Related Research Articles

<span class="mw-page-title-main">Photography</span> Art and practice of creating images by recording light

Photography is the art, application, and practice of creating images by recording light, either electronically by means of an image sensor, or chemically by means of a light-sensitive material such as photographic film. It is employed in many fields of science, manufacturing, and business, as well as its more direct uses for art, film and video production, recreational purposes, hobby, and mass communication.

<span class="mw-page-title-main">Pixel</span> Physical point in a raster image

In digital imaging, a pixel, pel, or picture element is the smallest addressable element in a raster image, or the smallest addressable element in a dot matrix display device. In most digital display devices, pixels are the smallest element that can be manipulated through software.

<span class="mw-page-title-main">Digital art</span> Collective term for art that is generated digitally with a computer

Digital art refers to any artistic work or practice that uses digital technology as part of the creative or presentation process. It can also refer to computational art that uses and engages with digital media.

<span class="mw-page-title-main">Tintype</span> Photographic process; direct positive image on metal

A tintype, also known as a melanotype or ferrotype, is a photograph made by creating a direct positive on a thin sheet of metal, colloquially called 'tin', coated with a dark lacquer or enamel and used as the support for the photographic emulsion. It was introduced in 1853 by Adolphe Alexandre Martin in Paris, like the daguerreotype was fourteen years before by Daguerre. The daguerreotype was established and most popular by now, though the primary competition for the tintype would have been the ambrotype, that shared the same collodion process, but on a glass support instead of metal. Both found unequivocal, if not exclusive, acceptance in North America. Tintypes enjoyed their widest use during the 1860s and 1870s, but lesser use of the medium persisted into 1930s and it has been revived as a novelty and fine art form in the 21st century. It has been described as the first "truly democratic" medium for mass portraiture.

<span class="mw-page-title-main">Compositing</span> Combining of visual elements from separate sources into single images

Compositing is the process or technique of combining visual elements from separate sources into single images, often to create the illusion that all those elements are parts of the same scene. Live-action shooting for compositing is variously called "chroma key", "blue screen", "green screen" and other names. Today, most, though not all, compositing is achieved through digital image manipulation. Pre-digital compositing techniques, however, go back as far as the trick films of Georges Méliès in the late 19th century, and some are still in use.

<span class="mw-page-title-main">History of photography</span>

The history of photography began with the discovery of two critical principles: The first is camera obscura image projection, the second is the discovery that some substances are visibly altered by exposure to light. There are no artifacts or descriptions that indicate any attempt to capture images with light sensitive materials prior to the 18th century.

<span class="mw-page-title-main">Image stitching</span> Combining multiple photographic images with overlapping fields of view

Image stitching or photo stitching is the process of combining multiple photographic images with overlapping fields of view to produce a segmented panorama or high-resolution image. Commonly performed through the use of computer software, most approaches to image stitching require nearly exact overlaps between images and identical exposures to produce seamless results, although some stitching algorithms actually benefit from differently exposed images by doing high-dynamic-range imaging in regions of overlap. Some digital cameras can stitch their photos internally.

<span class="mw-page-title-main">Charactron</span>

Charactron was a U.S. registered trademark of Consolidated Vultee Aircraft Corporation (Convair) for its shaped electron beam cathode ray tube. Charactron CRTs performed functions of both a display device and a read-only memory storing multiple characters and fonts. The similar Typotron was a U.S. registered trademark of Hughes Aircraft Corporation for its type of shaped electron beam storage tube with a direct-view bistable storage screen.

<span class="mw-page-title-main">Digital photography</span> Photography with a digital camera

Digital photography uses cameras containing arrays of electronic photodetectors interfaced to an analog-to-digital converter (ADC) to produce images focused by a lens, as opposed to an exposure on photographic film. The digitized image is stored as a computer file ready for further digital processing, viewing, electronic publishing, or digital printing. It is a form of digital imaging based on gathering visible light.

Leon D. Harmon was a researcher in mental/neural processing, particularly regarding vision, who worked at Bell Telephone Laboratories, Incorporated.

<span class="mw-page-title-main">Ken Knowlton</span> American computer graphics pioneer (1931–2022)

Kenneth Charles Knowlton was an American computer graphics pioneer, artist, mosaicist and portraitist. In 1963, while working at Bell Labs, he developed the BEFLIX programming language for creating bitmap computer-produced movies. In 1966, also at Bell Labs, he and Leon Harmon created the computer artwork Computer Nude .

A chromogenic print, also known as a C-print or C-type print, a silver halide print, or a dye coupler print, is a photographic print made from a color negative, transparency or digital image, and developed using a chromogenic process. They are composed of three layers of gelatin, each containing an emulsion of silver halide, which is used as a light-sensitive material, and a different dye coupler of subtractive color which together, when developed, form a full-color image.

<span class="mw-page-title-main">VR photography</span> Interactive panoramic photo viewing format

VR photography is the interactive viewing of panoramic photographs, generally encompassing a 360-degree circle or a spherical view. The results is known as VR photograph, 360-degree photo, photo sphere, or spherical photo, as well as interactive panorama or immersive panorama.

<span class="mw-page-title-main">Impressionist mosaics</span>

Unlike traditional mosaics which rely on differently colored material arranged in arbitrary configurations to make an image, impressionist mosaics are created using the natural flaws and marbling in the tiles to create the impression of an image. Depending on the definition, this may be limited to arranging square, homogeneously colored tiles in a grid-like, non-overlapped fashion.

<span class="mw-page-title-main">Image editing</span> Processes of altering images

Image editing encompasses the processes of altering images, whether they are digital photographs, traditional photo-chemical photographs, or illustrations. Traditional analog image editing is known as photo retouching, using tools such as an airbrush to modify photographs or editing illustrations with any traditional art medium. Graphic software programs, which can be broadly grouped into vector graphics editors, raster graphics editors, and 3D modelers, are the primary tools with which a user may manipulate, enhance, and transform images. Many image editing programs are also used to render or create computer art from scratch. The term "image editing" usually refers only to the editing of 2D images, not 3D ones.

<i>Lincoln in Dalivision</i> Painting by Salvador Dalí

Lincoln in Dalivision is a 1977 original limited edition lithograph created by Salvador Dalí. It is often considered one of the most counterfeited Dalí lithographs. Dalí authentication experts who have noted the counterfeiting issue with this work include Albert Field, Frank Hunter, Robert Descharnes and Bernard Ewell. Lee Catterall comments in his book The Great Dalí Art Fraud & other deceptions, "The painting most commonly reproduced for such fraudulent purposes was Lincoln in Dalivision, 'prints' of which Los Angeles art appraiser Dena Hall testified in the Hawaii trial have become as commonplace as 'pancakes at the pancake house.'"

<span class="mw-page-title-main">Pixel Camera</span> Camera application developed by Google for Pixel devices

Pixel Camera, formerly Google Camera, is a camera phone application developed by Google for the Android operating system. Development for the application began in 2011 at the Google X research incubator led by Marc Levoy, which was developing image fusion technology for Google Glass. It was publicly released for Android 4.4+ on the Google Play on April 16, 2014. It was initially supported on all devices running Android 4.4 KitKat and higher, but became only officially supported on Google Pixel devices in the following years. The app was renamed Pixel Camera in October 2023, with the launch of the Pixel 8 and Pixel 8 Pro.

<i>Dalis Mustache</i> 1954 book by Salvador Dalí

Dali's Mustache is an absurdist humorous book by the surrealist artist Salvador Dalí (1904–1989) and his friend, the photographer Philippe Halsman (1906–1979). The first edition was published in October 1954 in New York; slightly modified French editions followed in the 1980s and 1990s.

References