DxOMark

Last updated

DXOMARK
DXOMARK logo.svg
Logo
Type of site
Professional benchmarking ratings for digital camera systems, camera lenses, photography equipment, and smartphone camera systems
Available in2 languages
List of languages
English, Chinese
Headquarters92100 Boulogne-Billancourt, Paris, France [1]
Area servedWorldwide
Owner DXOMARK Image Labs SAS
EditorLars Rehm (editor-in-chief)
Key peopleFréderic Guichard (CEO) Marie Frécénon (CFO)
Industry photography
Products Smartphone and digital camera ratings
Services Consulting, scientific benchmarking
URL www.dxomark.com
CommercialYes
RegistrationNone
Launched2008;16 years ago (2008) [2]
Current statusActive
Content licence
Copyright

DXOMARK is a commercial website described as "an independent benchmark that scientifically assesses smartphones, lenses and cameras". [2] [3] Founded in 2008, DxOMark was originally owned by DxO Labs, [4] a French engineering and consulting company, which is headquartered in Boulogne-Billancourt, Paris, France. [1] [4] [2] [5] DXOMARK Image Labs was separated from DxO Labs in September 2017, and was later re-branded to DXOMARK in 2019. [6] [7] DXOMARK is now a wholly independent privately-owned company. [6]

Contents

DXOMARK scores are used in many independent news publications and specialist media sites. [2]

DXOMARK rating systems

The score(s) awarded by DXOMARK are based upon a comprehensive and highly-documented, but commercially secret methodology. An overall 'headline' (v) score is awarded, but that is based upon an aggregated overview of a number of other very specific and detailed test attributes, although the actual weighting of those individual attributes is unknown. [4] DXOMARK themselves stress that "the overall score is not a weighted sum of the sub-scores. It is a proprietary and confidential mapping of sub-scores into a combined score". DXOMARK also highlight that they consult directly with the equipment manufacturers, with the objective of helping them make better cameras. [4]

In respect of specific score figures, it is not clear what headroom or ceiling level is available to the DXOMARK scoring system. [4] Some early high performers might have suggested an upper limit of 100 points, [4] yet later high performers are awarded scores in excess of 100. It is also important to note that the DXOMARK score is not based on any averages. [4]

Camera sensor rating

The DXOMARK Sensor Score measures several important image quality metrics of the RAW image [8] captured by the camera's sensor. [9] The overall score is a confidential combination of three sub-scores: [9] [10]

Another metric, the Perceptual MegaPixel (P-MPix), defined as 'the unit of a sharpness measurement', is used to rate the resolution a camera produces when paired to a particular lens. [11] DXOMARK claims that P-MPix is a more accurate and relevant value for photographers to consider than alternate measures of sharpness when evaluating camera and lens image quality. [11] [12] [13] [14] [15] [ unreliable source ] As of December 2015, the Canon EF 300mm f/2.8L IS II USM lens mounted on a Canon EOS 5DS R has the highest measured P-MPix (45 P-MPix), followed by the Carl Zeiss APO Sonnar T* 2/135 ZE (41 P-MPix on Canon EOS 5DS R and 36 P-MPix on Nikon D800E). [16]

Camera lens rating

The DXOMARK Lens Score provides ratings for camera lenses, as tested using its proprietary tool-set in combination with various camera models. [8] [10] [17] As with the DxOMark Sensor Score, the DXOMARK Lens Score is an aggregation of five separate sub-scores; namely: sharpness, distortion, vignetting, transmission, and chromatic aberration. [17]

Smartphone camera rating

As smartphones began to overtake point-and-shoot cameras, [18] DXOMARK began testing smartphones and other mobile devices in 2011, and introduced DXOMARK Mobile [7] in 2012. [19] [20] [21] A major update was made in September 2017, adding tests designed to stress the capabilities of current-model smartphones, including those with dual lenses; such as lower-light shooting, telephoto zoom, depth effect, and bokeh. [5] [19] [20] [22] In September 2019, the DXOMARK Mobile score was renamed DXOMARK Camera. [7] [19] [23]

DXOMARK Camera Overall Score is the headline number reported for each tested device, and consists of a proprietary combination of DXOMARK Camera Photo, and DXOMARK Camera Video category scores.

DXOMARK's Camera Photo score is a proprietary combination of nine category sub-scores: [23]

DXOMARK's Camera Video score includes six of the same sub-scores as DXOMARK's Mobile Photo score (Exposure, Colour, Auto-focus, Texture, Noise, and Artifacts), along with Stabilisation.

DXOMARK's tests are conducted by the company's technical staff under a variety of lighting conditions; ranging from low-light 1 Lux, to bright daylight outdoors. [22] Sub-scores are combined using a proprietary and confidential mapping into an overall score. Tests are also confined to default modes, except for Zoom and Bokeh, which has caused reviewers to be cautious when using them. [4]

Selfie-camera rating

On 22 January 2019, DXOMARK started to release the results of a new metric; testing the front-facing 'selfie' cameras on smartphones. [19] [26] [27] These new standalone DXOMARK Selfie tests are undertaken for both Photo and Video, though the 'headline' DXOMARK Selfie score will combine both. [27] For DXOMARK Selfie Photo, there are sub-scores for Exposure, Colour, Focus, Texture, Noise, Artifacts, Flash, and Bokeh. For DXOMARK Selfie Video, sub-scores include Exposure, Colour, Focus, Texture, Noise, Artifacts, and Stabilisation. [27]

Smartphone audio rating

On 10 October 2019, DXOMARK introduced a new Audio benchmark for smartphones. [28] Phones are tested for playback using their internal speakers, and for recording using their built-in microphones. [29] DXOMARK Audio tested categories include: [28] [29]

For recording only: [28] [29]

Smartphone display ratings

In October 2020, DXOMARK introduced a rating system for mobile device displays (screens). DXOMARK Display tests over 400 measurements, and more than 20 hours of laboratory evaluations and real-life scenarios. The result includes six sub-scores: Readability, Colour, Video, Motion, Touch, and Artifacts. [30]

Wireless speaker ratings

In November 2020, DXOMARK introduced a rating system, DXOMARK Sound, for wireless speakers, based on factors including both lab tests using sound-level meters and calibrated microphones, as well as 20 hours of perceptual assessment. Customized music clips, created by DXOMARK in collaboration with professional musicians and recording studios, include those in the styles of jazz, hip-hop, classical, pop, rock, Latin, electronic, and alternative genres. [31]

Battery ratings

DXOMARK started smartphone battery testing on 10 May 2021. DXOMARK's battery test protocol is based on 70 measurements and takes 150 hours to test. [32]

Comparison tool

Users of the DXOMARK website can select several devices of the same class, and have the website display a comparison of their test scores and graphical versions of the actual test data. [10] [33]

Analyzer

Analyzer is a suite of software tools published by DXOMARK, that includes test targets and test equipment. It is used by camera companies, as well as press publications and websites; [34] to test sensors, lenses, and standalone cameras, as well as mobile devices with cameras. Testing can be performed on both RAW and JPEG images, as well as video. Analyzer is also the analysis engine behind dxomark.com [8] [34] [35] Results can be displayed either numerically or graphically. [36] Originally introduced by DxO Labs, Analyzer is now a product of DxOMark, which has been separated from DxO. [6] [37]

Analyzer includes modules for testing optics, sensors, stabilisation, video, timing, and 3D features. [38]

Usage in industry

DXOMARK ratings are often used by the press to describe the image quality characteristics of their cameras and mobile devices. [4] [39] [40] [41] High DXOMARK Camera ratings have also been featured as hallmarks of quality in vendor announcements [42] and marketing materials, [43] although reviewers are careful to note that the ratings only reflect image quality. [44] [45] [46] DXOMARK also provides consulting services to hardware manufacturers, related to image quality. [47] [48]

See also

Related Research Articles

<span class="mw-page-title-main">Pixel</span> Physical point in a raster image

In digital imaging, a pixel, pel, or picture element is the smallest addressable element in a raster image, or the smallest addressable element in a dot matrix display device. In most digital display devices, pixels are the smallest element that can be manipulated through software.

<span class="mw-page-title-main">DxO Labs</span> French photography software company

DxO Labs is a privately owned photography software company. It was founded in 2003 by Jérôme Ménière, former CEO of Vision-IQ. The company's headquarters are in Paris, France.

<span class="mw-page-title-main">Nikon D3200</span> Camera model

The Nikon D3200 is a 24.2-megapixel DX format DSLR Nikon F-mount camera officially launched by Nikon on April 19, 2012. It is marketed as an entry-level DSLR camera for beginners and experienced DSLR hobbyists who are ready for more advanced specs and performance.

Google Pixel is a brand of portable consumer electronic devices developed by Google that run either ChromeOS or the Android operating system. The main line of Pixel products consist of Android-powered smartphones, which have been produced since October 2016 as the replacement of the older Nexus, and of which the Pixel 8 and 8 Pro are the current models. The Pixel brand also includes laptop and tablet computers, as well as several accessories, and was originally introduced in February 2013 with the Chromebook Pixel.

The Perceptual MegaPixel (P-MP) is a proprietary ranking of lens-camera combinations, created by DxO Labs. It is intended to express the resolution of which a combination of camera and lens is capable. Complete scientific or technical documentation of the process used to compute P-MP values has never been published, and P-MP measurements have never been made without the cooperation of DxO Labs. The name of the measurement is a trade mark.

<span class="mw-page-title-main">Olympus OM-D E-M1</span> Digital camera model

The Olympus OM-D E-M1 Micro Four Thirds is Olympus' compact mirrorless interchangeable-lens camera introduced on September 10, 2013. It has built-in on sensor phase detection.

<span class="mw-page-title-main">Samsung Galaxy Note 8</span> Android phablet developed by Samsung Electronics

The Samsung Galaxy Note 8 is an Android-based smartphone phablet designed, developed, produced and marketed by Samsung Electronics. The successor to the discontinued Samsung Galaxy Note 7, Samsung Galaxy Note Fan Edition and Samsung Galaxy Note 5, it was unveiled on 23 August 2017 and became available on 15 September 2017.

iPhone 8 Smartphones produced by Apple starting in 2017

The iPhone 8 and iPhone 8 Plus are smartphones designed, developed, and marketed by Apple Inc. They are the eleventh generation of the iPhone. The iPhone 8 was released on September 22, 2017, succeeding the iPhone 7 and iPhone 7 Plus respectively.

<span class="mw-page-title-main">Huawei P20</span> Android-based smartphone by Huawei

Huawei P20 and Huawei P20 Pro are Android smartphones manufactured by Huawei. Unveiled 27 March 2018, they succeed the Huawei P10 in the company's P series line.

<span class="mw-page-title-main">Pixel 3</span> 2018 Android smartphone designed by Google

The Pixel 3 and Pixel 3 XL are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as the successors to the Pixel 2 and Pixel 2 XL. They were officially announced on October 9, 2018 at the Made by Google event and released in the United States on October 18. On October 15, 2019, they were succeeded by the Pixel 4 and Pixel 4 XL.

<span class="mw-page-title-main">HTC U12+</span> Android smartphone

The HTC U12+ is an Android smartphone manufactured and sold by HTC as part of the HTC U series. It was announced on 23 May 2018 and succeeds the HTC U11 and HTC U11+ smartphones.

<span class="mw-page-title-main">Xiaomi Pocophone F1</span> 2018 smartphone by Xiaomi

The Xiaomi Pocophone F1 is a smartphone developed by Xiaomi Inc, a Chinese electronics company based in Beijing. It was announced on 22 August 2018 in New Delhi, India. Though part of Xiaomi's line of mid-range devices, it is equipped with high-end specifications. The device is available globally in limited numbers, except for India where it enjoys wide availability. The Pocophone was often considered to be a flagship model of the Redmi line of 2019, although officially marketed as a separate and distinct model.

<span class="mw-page-title-main">Samsung Galaxy S10</span> 2019 flagship smartphones by Samsung Electronics

The Samsung Galaxy S10 is a line of Android-based smartphones manufactured, released and marketed by Samsung Electronics as part of the Samsung Galaxy S series. The Galaxy S10 series is the tenth generation of the Samsung Galaxy S, its flagship line of phones next to the Note models, which is also the 10th anniversary of the Galaxy S. Unveiled during the "Samsung Galaxy Unpacked 2019" press event held on 20 February 2019, the devices started shipping in certain regions such as Australia and the United States on 6 March 2019, and internationally on 8 March 2019.

<span class="mw-page-title-main">Huawei Pura series</span> Smartphone series by Huawei

The Huawei Pura series is a line of high-end and medium-range HarmonyOS smartphones produced by Huawei. The P series was formerly marketed as part of Huawei's larger Ascend brand, and some models were called P smart.

<span class="mw-page-title-main">LG V40 ThinQ</span>

The LG V40 ThinQ, commonly referred to as the LG V40, is an Android phablet manufactured by LG Electronics as part of the LG V series. It was announced on October 3, 2018 and is the successor to the previous devices in the LG V series, namely the LG V30, LG V30S ThinQ, and LG V35 ThinQ. The LG V40 released primarily in the United States on October 18, 2018.

<span class="mw-page-title-main">Nokia 9 PureView</span> Android smartphone

The Nokia 9 PureView is a Nokia-branded flagship penta-camera smartphone developed by HMD Global. It was introduced at the 2019 Mobile World Congress (MWC) in Barcelona, Spain as a successor to the Nokia 8 Sirocco. It alludes to Nokia's previous camera-centric PureView devices, which ended with the Lumia 950 and 950 XL. Like most of HMD's Nokia smartphones of the time, the 9 PureView is part of the Android One program.

The Pixel 3a and Pixel 3a XL are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as mid-range variants of the Pixel 3 and Pixel 3 XL. They were officially announced on May 7, 2019 at Google I/O, seven months after the announcement of the original Pixel 3 lineup, and were released on the same day. On August 3, 2020, it was succeeded by the Pixel 4a.

<span class="mw-page-title-main">Pixel 4</span> 2019 Android smartphones designed by Google

The Pixel 4 and Pixel 4 XL are a pair of Android smartphones designed, developed, and marketed by Google as part of the Google Pixel product line. They collectively serve as the successors to the Pixel 3 and Pixel 3 XL. They were officially announced on October 15, 2019 at the Made by Google event and released in the United States on October 24, 2019. On September 30, 2020, they were succeeded by the Pixel 5.

<span class="mw-page-title-main">Huawei P40</span> High-end Android smartphone line by Huawei

Huawei P40 is a line of high-end Android-based smartphones manufactured by Huawei. Unveiled on 26 March 2020, they succeed the Huawei P30 in the company's P series line.

<span class="mw-page-title-main">Xiaomi Mi 10 Ultra</span> Smartphones manufactured by Xiaomi

The Xiaomi Mi 10 Ultra is an Android-based high-end smartphone developed by Xiaomi Inc. announced on 11 August 2020 as a celebration of Xiaomi's 10th anniversary. Unlike the Mi 10 and Mi 10 Pro, Mi 10 Ultra is only available on the Chinese market.

References

Citations
  1. 1 2 "Contact us". www.DxOMark.com. DxOMark. Retrieved 4 October 2020.
  2. 1 2 3 4 "What is DxOMark?". www.DxOMark.com. DxOMark. Retrieved 13 October 2020.
  3. ↑ "Honor ranks #2 in the world of smartphone cameras – That's according to camera specialists DxOMark". Esquire Middle East – the Region's Best Men's Magazine. Esquire Middle East – Hearst Communications, Inc. 24 July 2019. Retrieved 4 October 2020.
  4. 1 2 3 4 5 6 7 8 9 "What is a DXOMark score?". www.PCWorld.idg.com.au. PC World Australia – IDG Communications. 20 March 2018. Archived from the original on 1 June 2020. Retrieved 14 October 2020.
  5. 1 2 "DxOMark unveils expanded mobile benchmark suite". Smart-Chimps.co.uk. Smart Chimps. 12 September 2017. Retrieved 4 October 2020.
  6. 1 2 3 "DxOMark splits from DxO Labs, is now an independent privately-owned company". www.DPReview.com. Digital Photography Review. 8 January 2018. Retrieved 13 October 2020.
  7. 1 2 3 "DxOMark: Huawei Mate 30 Pro camera score will be announced today". www.Gearbest.com. Gearbest blog. 26 September 2019. Archived from the original on 29 September 2019. Retrieved 13 October 2020.
  8. 1 2 3 "Lens reviews explained". www.DPReview.com. Digital Photography Review. 30 October 2012. Retrieved 12 November 2020.
  9. 1 2 "Sensors Database – DxOMark". www.DxOMark.com. DxOMark. Retrieved 13 October 2020.
  10. 1 2 3 "A simple guide to the DXOMARK numbers". DaystarVisions.com. Daystar Visions. 2015. Retrieved 13 October 2020.
  11. 1 2 "DxOMark reviews > looking for new photo gear? DXOMARK's Perceptual Megapixel can help you". www.DxOMark.com. DxO Labs. 17 December 2012. Archived from the original on 14 August 2013. Retrieved 23 August 2016.
  12. ↑ "Perceptual Megapixel: lens sharpness boiled down to a single number". PetaPixel.com. PetaPixel blog. 17 December 2012. Retrieved 13 October 2020.
  13. ↑ "DxOMark introduces the 'Perceptual Megapixel'". TimGrey.com. Tim Grey's blog – thoughts on photography, digital imaging, and travel. 6 January 2013. Archived from the original on 27 August 2013. Retrieved 23 August 2016.
  14. ↑ "DxO Labs tries making sense of camera lens sharpness". www.CNET.com. CNET – CBS Interactive Inc. 17 December 2012. Retrieved 13 October 2020.
  15. ↑ "DxOMark scores lens sharpness with Perceptual Megapixel". www.Photo.net. Photo.net Photography forums. 20 December 2012. Retrieved 13 October 2020.
  16. ↑ "Lenses > Camera Lens Ratings > Optical Metric Scores > camera lens ratings by DXOMARK". www.DxOMark.com. DxO Labs. Archived from the original on 20 November 2013. Retrieved 13 October 2020.
  17. 1 2 "Lenses Database – DXOMARK". www.DxOMark.com. DxOMark. Retrieved 13 October 2020.
  18. ↑ Daisuke Wakabayashi (30 July 2013). "The point-and-shoot camera faces its existential moment; as more users opt for smartphones, companies wonder what's next" . www.WSJ.com. The Wall Street Journal – Dow Jones & Company, Inc.
  19. 1 2 3 4 5 6 "Introducing our new Wide and Night scores". www.DxOMark.com. DxOMark. 18 September 2019. Retrieved 13 October 2020.
  20. 1 2 "DxOMark revamps its mobile testing for the phone cameras of 2017; new testing method will take into account dual cameras, selfie performance, and other recent trends". www.AndroidCentral.com. Android Central – Future US, Inc. 12 September 2017. Retrieved 13 October 2020.
  21. ↑ Lexy Savvides (10 October 2012). "Smartphones outperforming high-end compact cameras". www.CNET.com.au. CNET Australia – CBS Interactive. Archived from the original on 24 February 2014. Retrieved 15 February 2014.
  22. 1 2 3 4 5 "DxOMark adds bokeh and zoom to new smartphone camera scoring scale; DxOMark's testing protocol for scoring smartphone cameras adds zoom, bokeh". www.DigitalTrends.com. Digital Trends – Designtechnica Corporation. 12 September 2017. Retrieved 13 October 2020.
  23. 1 2 3 4 Monckton, Paul (24 September 2019). "iPhone 11's best camera features now part of DxOMark tests". Forbes . Archived from the original on 27 November 2020. Retrieved 13 October 2020.{{cite web}}: CS1 maint: bot: original URL status unknown (link)
  24. 1 2 "DxOMark adds Wide and Night scores to its tests, [Samsung Galaxy] Note 10+ tops recalculated results". www.GSMArena.com. GSM Arena. 18 September 2019. Retrieved 13 October 2020.
  25. ↑ "DxOMark test shows superiority of Apple's cameras". www.DigitalInformationWorld.com. Digital Information World. 22 October 2020. Retrieved 12 November 2020.
  26. ↑ "Here are the best selfie cameras on the market, according to DxOMark". www.DigitalTrends.com. Digital Trends – Designtechnica Corporation. 22 January 2019. Retrieved 14 October 2020.
  27. 1 2 3 Monckton, Paul (22 January 2019). "How DxOMark's new test ranks selfie cameras". Forbes . Archived from the original on 7 November 2020. Retrieved 14 October 2020.{{cite web}}: CS1 maint: bot: original URL status unknown (link)
  28. 1 2 3 Lovejoy, Ben (10 October 2019). "DxOMark audio testing begins, with interesting results for iPhones - finds iPhone 11 Pro Max worse than iPhone XS Max". 9to5Mac.com. 9to5Mac blog. Archived from the original on 24 October 2020. Retrieved 14 October 2020.{{cite web}}: CS1 maint: bot: original URL status unknown (link)
  29. 1 2 3 Mehta, Ivan (10 October 2019). "DxOMark launches audio ranking to test recording and playback quality of phones". TheNextWeb.com. Plugged | The Next Web . Retrieved 14 October 2020.
  30. ↑ "DXOMARK introduces new score for smartphone display and expands smartphone rear-camera testing". Markets.BusinessInsider.com. Markets Insider – Insider Inc. and finanzen.net GmbH. 21 October 2020. Retrieved 12 November 2020.
  31. ↑ "DXOMark announces new benchmark for the sound quality of wireless speakers". www.TechRadar.com. TechRadar – Future Publishing Limited. 4 November 2020. Retrieved 12 November 2020.
  32. ↑ "Introducing the DXOMARK Battery protocol". DXOMARK. 10 May 2021. Retrieved 10 May 2021.
  33. ↑ "How do I use DxOMark?". Northrup.photo. Tony & Chelsea Northrup. 30 June 2015. Retrieved 14 October 2020.
  34. 1 2 "Popular Photography: how we test". www.PopPhoto.com. Popular Photography – Bonnier Corporation. 2 February 2013. Retrieved 13 November 2020.
  35. ↑ "Publication Partagée". www.ChassImages.com (in French). Chasseur d’Images. Archived from the original on 4 March 2016. Retrieved 8 November 2015.
  36. ↑ "How we test lenses". www.SLRgear.com. SLR Gear!. Archived from the original on 27 November 2020. Retrieved 8 November 2015.
  37. ↑ "DxO Analyzer". corp.DxOMark.com. DxOMark. Retrieved 9 March 2018.
  38. ↑ "DxO Analyzer 5". www.PhotographyBlog.com. Photography Blog. 19 October 2012. Retrieved 11 November 2015.
  39. ↑ "HTC 10 gets the same DXOMark score as Galaxy S7". www.AndroidCentral.com. Android Central. 12 April 2016. Retrieved 23 August 2016.
  40. ↑ "Leading camera lab report: Samsung Galaxy S7 Edge named new smartphone camera champion". news.Samsung.com. Samsung Newsroom. 18 March 2016. Retrieved 23 August 2016.
  41. ↑ "How Google hopes its Pixel camera will win over iPhone fans". www.CNET.com. CNET . Retrieved 13 November 2016.
  42. ↑ "8 times Google savagely burned Apple during the Pixel announcement". www.MacWorld.com. Mac World . Retrieved 13 November 2016.
  43. ↑ "Google Pixel 2 and Pixel 2 XL". www.VerizonWireless.com. Verizon Wireless . Retrieved 8 March 2018.
  44. ↑ Bagnell, Juan Carlos (4 October 2016). "Google Pixel: a great DxOMark score doesn't mean 'the best smartphone camera'". PocketNow.com. Archived from the original on 4 September 2018. Retrieved 13 November 2016.
  45. ↑ "Who is hiding behind DxOMark scores?". www.AndroidPit.com. Android PIT. Archived from the original on 30 August 2017. Retrieved 15 June 2017.
  46. ↑ "Google's new Pixel 2 phone cameras are highly rated". Fortune.com. Fortune. 4 October 2017. Retrieved 5 October 2017.
  47. ↑ "DxOMark scores shouldn't be your definitive camera rating system". www.AndroidAuthority.com. Android Authority. 9 October 2017. Retrieved 10 October 2017.
  48. ↑ "A summary of MKBHD's explanation of DxOMark ratings". ResourceMagOnline.com. Resource. October 2017. Retrieved 17 October 2017.
Further reading
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.