OpenRAW

Last updated
OpenRAW logo OpenRAW badge square 128 white.png
OpenRAW logo

OpenRAW was an initiative to raise awareness of a serious problem with top-end digital photography and to help solve that problem. The problem concerns long-term access and viewing of the raw images often used by professional and experienced amateur photographers. OpenRAW's solution (also their motto) was "Digital Image Preservation Through Open Documentation". [1]

Contents

This initiative was primarily an international (non-political) advocacy and lobby activity directed at companies making digital cameras and those developing software to support those cameras. It also had the aim of raising awareness of the problem among photographers. Its resources included a website with a discussion forum, [1] and many registered supporters, including individuals, [2] companies, [3] and professional organizations. [4]

Formation

Early in 2005, Juergen Specht [5] and the members of his mailing list D1scussion began to identify concerns about the difficulties associated with the proprietary RAW files introduced by camera makers. [6]

The background to these concerns, described at Raw image format (Drawbacks), Digital Negative (Objectives), and dcraw (Motivation), is that the photographs from top-end digital cameras are often contained within files whose specifications are formally known only to the camera manufacturers. Not only does this require extra software development by many companies after the launch of most new camera models, but there is a major risk that future software products will not be able to render photographs from decades earlier.

As the seriousness of the issue was quickly realized, this team founded an initiative called OpenRAW, with the goal of encouraging image preservation and ensuring that the creators of the images retained the choice of how their images are processed. [6]

OpenRAW was launched worldwide via a press release [7] on 25 April 2005. [8] There were positive reactions worldwide: for example at DPReview; [9] many others in English; [10] [11] [12] [13] [14] [15] [16] some in German; [17] [18] [19] and in Japanese. [20]

Achievements

Raising awareness

The OpenRAW initiative identified the seriousness of this problem, articulated it in a way that photographers understood, [8] summarized the solution with their "motto", and created a (non-commercial) global brand ("OpenRAW") which encapsulated all of these. The team were not the first to understand these problems, and didn't claim to be. They were primarily photographers, [5] [21] [22] (rather than companies with commercial interests in cameras or image processing products, or archivists), with the advantage that they spoke to other photographers in their own language, rather than, for example, the language of archivists. [23]

The OpenRAW initiative raised awareness, or crystallized vague awareness, of these problems with many photographers and organizations worldwide. [24]

Camera manufacturers were made aware of the disquiet about their policies. One of them, Sony, responded with a letter held on the OpenRAW website, [25] while others didn't respond when asked. [13] There is no evidence that any of them changed their policies as a result of the OpenRAW initiative. [6]

Supporters worldwide

At OpenRAW's peak there were over 1600 registered individual supporters from across the world, writing in English but sometimes as a second language. [2] Nearly thirty software and hardware companies registered their support, [3] thirty "photographic resources" were supporters, [26] and so were five professional organisations. [4]

Its influence was wider than these numbers would indicate. When it conducted a survey (in English) in 2006, [27] more than 19,200 photographers worldwide responded to it. (From North America, 46%; Europe, 43%; Asia, 5%; Australia, 4%; Africa, 1%; South America, 1%). [24] [28] [29] Twenty photography associations, forums, listservs, and other resources worldwide supported the survey. [30]

What these supporters typically have in common was the conviction that people and organizations should reliably be able to access and view their photographs well into the future, and that this requires open documentation of the formats of the files used. [3] [4] [26] While popular image file formats such as JPEG are openly documented, most raw image formats, often used by professional and experienced amateur photographers, are not.

Resources created

The OpenRAW website, especially the non-forum parts identified above, represent views of many companies and organizations other than camera makers. [1]

The results of the survey continue to be available as a resource, but must be read with caution because it was conducted in 2006.

Another resource, often cited on the web and still pertinent, is an article "The RAW Flaw", [31] [32] [33] jointly authored by Michael Reichmann (of The Luminous Landscape [22] ) and Juergen Specht (leader of the founding group of OpenRAW), and published on each website. Permission is given for the text to be copied and republished, with translation if desired, and there are examples in various countries and languages, especially of the "Act Now" call for action: in China (in English); [34] in French; [35] different versions in Spanish; [36] [37] in Danish; [38] and in Italian. [39]

Limitation

Summary of the problem

The problem identified by the sources identified above can be summarized as: "there is an ever increasing number of undocumented raw file formats". The final paragraph in "The RAW Flaw" on The Luminous Landscape website is: [31]

"Finally, consider the problems of digital asset management and the cataloging of files. ... The various asset management programs can't hope to keep up with the ever increasing number of proprietary formats. And as time passes and these programs are enhanced, what are the chances that they will still be able to read your older RAW files?"

And it summarizes the solution as:

"The Solution? There really is only one solution – the adoption by the camera industry of...
A. Public documentation of RAW formats; past, present and future
or, more likely...
B. Adoption of a universal RAW format"

Stance from launch, April 2005

From April 2005, OpenRAW continued to pursue its goal of open documentation of proprietary formats rather than creation of a "universal" file format.

"We want camera manufacturers to publicly document their RAW image formats - past, present, and future. ... Many have suggested (and Adobe has created) a common, open file format for RAW image files for all camera makers to use as a solution to the RAW problem. A common, openly documented RAW format would fulfill many of the goals of OpenRAW, but is likely to face significant resistance from manufacturers who feel their "creativity" and ability to innovate would be constrained. Open documentation of all RAW file formats by manufacturers is the quickest and most satisfactory way for OpenRAW's goals to be reached."

The phrase "(and Adobe has created)" above refers to Adobe's DNG (Digital Negative Format), launched 7 months before OpenRAW. DNG was designed (among other things) as an archival raw image format and has a published specification.

Stance from April 2006

From April 2006, OpenRAW's stance was opposed to DNG and language supporting DNG initiative was removed from "The RAW Problem" article. [40] An article "Notes on the future of Open RAW formats, and a look at DNG" said "DNG is not the answer". [41] Opposition was present in the forum. [42] In an interview, a founder of OpenRAW said "No, DNG is unfortunately not a solution." [43]

Rather than advocating for the creation of an open file format (such as DNG), [44] [45] OpenRAW was seeking specifications for the various proprietary file formats. This stance continued as DNG became better established while camera makers showed no signs of publishing documentation for their raw file formats.

Status in 2011

Status of OpenRAW initiative

The OpenRAW Mailing List was closed to new members in April 2006. [46]

The OpenRAW website became inactive in August 2009, but the last post was a year earlier. [47] By May 2011 a new home page summarized the history of OpenRAW, saying:

"While the final goal of "Open Documentation" has not yet been reached, the OpenRAW initiative and the survey results have triggered the ongoing development of an "Open" RAW standard which is in the final stages of becoming a reality."
"OpenRAW had a lot of impact on the world of photography and it continues to aim at improving the situation for photographers and their photographs for years to come."

Status of cameras and camera makers

Niche and some smaller camera makers use DNG as a raw image format, and so conform to OpenRAW's requirement by using an openly documented non-proprietary format. [31]

The larger camera makers, such as Canon, Nikon, Olympus, and Sony, continue to use raw image formats that are not openly documented, and so still cause the problems identified by OpenRAW. A variety of DNG converters enables the undocumented proprietary formats used by the larger camera makers to be manually converted to DNG.

Professional image archivists and conservationists

Increasingly, professional archivists and conservationists, working for respectable organizations, variously suggest or recommend DNG for archival purposes. [48] [49] [50] [51] [52] [53] [54] [55] [56] [57] [58]

See also

Related Research Articles

Digital camera Camera that captures photographs or video in digital format

A digital camera is a camera that captures photographs in digital memory. Most cameras produced today are digital, largely replacing those that capture images on photographic film. Digital cameras are now widely incorporated into mobile devices like smartphones with the same or more capabilities and features of dedicated cameras. While there are still dedicated digital cameras, many more cameras are now incorporated into mobile devices like smartphones. High-end, high-definition dedicated cameras are still commonly used by professionals and those who desire to take higher-quality photographs.

Exif Metadata standard in digital images

Exchangeable image file format is a standard that specifies formats for images, sound, and ancillary tags used by digital cameras, scanners and other systems handling image and sound files recorded by digital cameras. The specification uses the following existing encoding formats with the addition of specific metadata tags: JPEG lossy coding for compressed image files, TIFF Rev. 6.0 for uncompressed image files, and RIFF WAV for audio files. It does not support JPEG 2000 or GIF encoded images.

A digital image is an image composed of picture elements, also known as pixels, each with finite, discrete quantities of numeric representation for its intensity or gray level that is an output from its two-dimensional functions fed as input by its spatial coordinates denoted with x, y on the x-axis and y-axis, respectively. Depending on whether the image resolution is fixed, it may be of vector or raster type. By itself, the term "digital image" usually refers to raster images or bitmapped images.

Digital Negative (DNG) is a patented, open, lossless raw image format developed by Adobe and used for digital photography. Adobe's license allows use without cost on the condition that the licensee prominently displays text saying it is licensed from Adobe in source and documentation, and that the license may be revoked if the licensee brings any patent action against Adobe or its affiliates related to the reading or writing of files that comply with the DNG Specification. It was launched on September 27, 2004. The launch was accompanied by the first version of the DNG specification, plus various products, including a free-of-charge DNG converter utility. All Adobe photo manipulation software released since the launch supports DNG.

Sigma SD10

The Sigma SD10 is a digital single-lens reflex camera (DSLR) manufactured by the Sigma Corporation of Japan. It was announced on October 27, 2003, and is an evolution of the previous SD9 model, addressing many of the shortcomings of that camera. The Sigma SD10 cameras are unique in the digital DSLR field in using full-color sensor technology, and in that they only produce raw format images that require post-processing on a computer.

digiKam Free image organizer

digiKam is a free and open-source image organizer and tag editor written in C++ using the KDE Applications.

The Extensible Metadata Platform (XMP) is an ISO standard, originally created by Adobe Systems Inc., for the creation, processing and interchange of standardized and custom metadata for digital documents and data sets.

A camera raw image file contains minimally processed data from the image sensor of either a digital camera, a motion picture film scanner, or other image scanner. Raw files are named so because they are not yet processed and therefore are not ready to be printed or edited with a bitmap graphics editor. Normally, the image is processed by a raw converter in a wide-gamut internal color space where precise adjustments can be made before conversion to a "positive" file format such as TIFF or JPEG for storage, printing, or further manipulation. There are dozens of raw formats in use by different manufacturers of digital image capture equipment.

Kodak EasyShare P880

The EasyShare P880 was a bridge digital camera from Kodak. It was announced on August 2, 2005, within the Performance series. Its siblings are the P850 and the P712. The P880 possesses the largest optical sensor of all three models, with a size of 1/1.8 inches. Distinguishing features include wide-angle coverage of 24 mm, an on screen histogram display, and manual focus-by-wire. In terms of the Kodak product line and price the Performance series are the most sophisticated EasyShare cameras, just below the considerably more expensive Kodak professional DCS pro SLR digital cameras that were discontinued in May 2005.

Digital photography Photography with a digital camera

Digital photography uses cameras containing arrays of electronic photodetectors interfaced to an analog-to-digital converter (ADC) to produce images focused by a lens, as opposed to an exposure on photographic film. The digitized image is stored as a computer file ready for further digital processing, viewing, electronic publishing, or digital printing.

Exposing to the right Photographic technique

In digital photography, exposing to the right (ETTR) is the technique of adjusting the exposure of an image as high as possible at base ISO to collect the maximum amount of light and thus get the optimum performance out of the digital image sensor.

Tag Image File Format/Electronic Photography (TIFF/EP) is a digital image file format standard – ISO 12234-2, titled "Electronic still-picture imaging – Removable memory – Part 2: TIFF/EP image data format". This is different from the Tagged Image File Format, which is a standard administered by Adobe currently called "TIFF, Revision 6.0 Final – June 3, 1992".

Forensic photography Art of producing an accurate reproduction of a crime scene

Forensic photography may refer to the visual documentation of different aspects that can be found at a crime scene. It may include the documentation of the crime scene, or physical evidence that is either found at a crime scene or already processed in a laboratory. Forensic photography differs from other variations of photography because crime scene photographers usually have a very specific purpose for capturing each image. As a result, the quality of forensic documentation may determine the result of an investigation, in that with the absence of good documentation, investigators may find it impossible to conclude what did or did not happen.

dcraw

dcraw is an open-source computer program which is able to read numerous raw image format files, typically produced by mid-range and high-end digital cameras. dcraw converts these images into the standard TIFF and PPM image formats. This conversion is sometimes referred to as developing a raw image since it renders raw image sensor data into a viewable form.

Windows Imaging Component (WIC) is a COM-based imaging codec framework introduced in Windows Vista for working with and processing digital images and image metadata.

Sidecar files, also known as buddy files or connected files, are computer files that store data which is not supported by the format of a source file.

CinemaDNG is the result of an Adobe-led initiative to define an industry-wide open file format for digital cinema files. CinemaDNG caters for sets of movie clips, each of which is a sequence of raw video images, accompanied by audio and metadata. CinemaDNG supports stereoscopic cameras and multiple audio channels. CinemaDNG specifies directory structures containing one or more video clips, and specifies requirements and constraints for the open format files,, within those directories, that contain the content of those clips.

Exposure fusion

In image processing, computer graphics, and photography, exposure fusion is a technique for blending multiple exposures of the same scene (bracketing) into a single image. As in high dynamic range imaging, the goal is to capture a scene with a higher dynamic range than the camera is capable of capturing with a single exposure.

Michael H. Reichmann, better known by his monogram MR, was a Canadian landscape, travel and street fine-arts photographer, as well as videographer, author, blogger, workshopper, independent technical consultant, camera tester, software developer and entrepreneur.

References

  1. 1 2 3 "Original OpenRAW website".
  2. 1 2 "Individuals supporting OpenRAW".
  3. 1 2 3 "Software Companies & Developers supporting OpenRAW".
  4. 1 2 3 "Organizations supporting OpenRAW".
  5. 1 2 Juergen Specht. "Juergen Specht - Photographs: Photos by a German Photographer living in Tokyo, Japan".
  6. 1 2 3 "Welcome to OpenRAW (latest home page)". Archived from the original on 2010-02-08.
  7. Juergen Specht (2005-04-25). "For Immediate Release — OpenRAW Web Site Launched".
  8. 1 2 Larry Strunk (2006-03-15). "About OpenRAW".
  9. "OpenRAW launches website".
  10. "OPENRAW Launches Web Site".
  11. "Image Preservation Through Open Documentation". 2005-04-25.
  12. Declan McCullagh (2005-04-25). "Photographers ask camera makers to open up".
  13. 1 2 Declan McCullagh (2005-04-25). "Photographers ask camera makers to open up".
  14. "OpenRAW Web Site Launched". 2005-04-27.
  15. Seb Chan (2005-05-02). "An open standard for the camera RAW format has just launched".
  16. Andy Goetze (2005-06-21). "Leave Your Wife, Sign Up For OpenRAW".
  17. Andreas Donath (2005-04-26). "Freie Rohdaten von Digitalkameras: OpenRAW-Website eröffnet" (in German).
  18. "OpenRAW: Fotografen aller Länder, vereinigt Euch!" (in German). 2005-04-26.
  19. "OpenRAW fordert offengelegte RAW-Spezifikationen" (in German). 2005-04-25.
  20. "OpenRAW (as a GIF)" (in Japanese). 2005-05-12.
  21. Calvin Jones. "Calvin Jones Photography".
  22. 1 2 Reichmann, Michael. "The Luminous Landscape".
  23. Chris Rusbridge (2008-07-29). ""Digital Preservation" term considered harmful?".
  24. 1 2 Juergen Specht (2006-04-24). "Survey Press Release".
  25. Yasuo Takagi, Sony CS Center Service Quality Department (July 2006). "Sony responds to 2006 RAW Survey report".
  26. 1 2 "Photographic Resources supporting OpenRAW".
  27. "The Original Survey Page (now nonfunctional)".
  28. Calvin Jones (2006-04-25). "The 2006 RAW Survey".
  29. Calvin Jones; Juergen Specht (2006-04-29). "2006 Raw Survey Results" (PDF).
  30. Juergen Specht; Calvin Jones. "OpenRAW home page". Archived from the original on 2006-04-02.
  31. 1 2 3 Reichmann, Michael; Specht, Juergen (May 2005). "The RAW Flaw (at The Luminous Landscape)". Archived from the original on 2010-01-08. Retrieved 2011-10-11.
  32. Reichmann, Michael; Specht, Juergen (May 2005). "The RAW Flaw (at The Luminous Landscape)". Archived from the original (DOC) on 2012-09-20.
  33. Reichmann, Michael; Specht, Juergen (May 2005). "The RAW Flaw (at The Luminous Landscape)" (PDF). Archived from the original (PDF) on 2011-01-06.
  34. "Raw Flaw - Please Support". 2005-05-25.
  35. Volker Gilbert (2005-05-23). "OpenRaw lance une campagne pour le RAW libre" (in French and English).
  36. "Lo malo del RAW" (in Spanish). 2006-06-01.
  37. "El problema del Raw" (in Spanish). 2005-05-24.
  38. "Open RAW - skriv til din kamerafabrikant" (in Danish and English). 2005-05-25.
  39. "OpenRAW - Act now! Petizione per un formato RAW libero!" (in Italian). 2005-05-25.
  40. "The RAW Problem". Archived from the original on 2006-04-11.
  41. Stuart Nixon (2006-04-03). "Notes on the future of Open RAW formats, and a look at DNG". Archived from the original on 2006-04-21.
  42. (various) (2007-02-03). "Converting current RAW images to Open RAW".
  43. Javier García Diz. "RAW format, the captive photo".
  44. vivosz (2007-10-23). "On workflows, openRaw and DNG".
  45. Abhay Sharma, PhD (November 2006). "Digital Photos (see end)". Archived from the original on 2006-12-06.
  46. Juergen Specht (2006-04-02). "OpenRAW Mailing List".
  47. "OpenRAW home page". Archived from the original on 2010-02-08.
  48. Planning for US Library of Congress Collections: Preferences in Summary
  49. dpBestflow: Raw File Formats
  50. universal photographic digital imaging guidelines (UPDIG): File formats - the raw file issue
  51. Archaeology Data Service / Digital Antiquity: Guides to Good Practice - Section 3 Archiving Raster Images - File Formats
  52. University of Connecticut: "Raw as Archival Still Image Format: A Consideration" by Michael J. Bennett and F. Barry Wheeler
  53. Inter-University Consortium for Political and Social Research: Obsolescence - File Formats and Software
  54. JISC Digital Media - Still Images: Choosing a File Format for Digital Still Images - File formats for master archive
  55. International Digital Enterprise Alliance, Digital Image Submission Criteria (DISC) Guidelines & Specifications 2007 (PDF) [ permanent dead link ]
  56. The J. Paul Getty Museum - Department of Photographs: Rapid Capture Backlog Project - Presentation Archived 2012-06-10 at the Wayback Machine
  57. American Institute for Conservation - Electronic Media Group: Digital Image File Formats
  58. Archives Association of British Columbia: Born Digital Photographs: Acquisition and Preservation Strategies (Rosaleen Hill) [ permanent dead link ]