Metacritic

Last updated

Metacritic
Metacritic logo.svg
Type of site
Review aggregator
Owner CBS Interactive
URL www.metacritic.com
Alexa rankDecrease Positive.svg 2,415 (September 2020) [1]
CommercialYes
RegistrationFree/subscription
LaunchedJanuary 2001;19 years ago (2001-01)
Current statusActive
OCLC  number 911795326

Metacritic is a website that aggregates reviews of films, TV shows, music albums, video games and formerly, books. For each product, the scores from each review are averaged (a weighted average). Metacritic was created by Jason Dietz, Marc Doyle, and Julie Doyle Roberts in 1999. The site provides an excerpt from each review and hyperlinks to its source. A color of green, yellow or red summarizes the critics' recommendations. It is regarded as the foremost online review aggregation site for the video game industry. [2] [3]

Contents

Metacritic's scoring converts each review into a percentage, either mathematically from the mark given, or what the site decides subjectively from a qualitative review. Before being averaged, the scores are weighted according to the critic's fame, stature, and volume of reviews. The website won two Webby Awards for excellence as an aggregation website. Criticism has focused on the assessment system, the assignment of scores to reviews that do not include ratings, alleged third-party attempts to influence the scores, and lack of staff oversight of user reviews.

History

The original logo for Metacritic Metacritic logo original.svg
The original logo for Metacritic

Metacritic was launched in January 2001 [4] by Marc Doyle, his sister Julie Doyle Roberts, and a classmate from the University of Southern California law school, Jason Dietz, after two years of developing the site. Rotten Tomatoes was already compiling movie reviews, but Doyle, Roberts and Dietz saw an opportunity to cover a broader range of media. They sold Metacritic to CNET in 2005. [5] CNET and Metacritic were later acquired by the CBS Corporation. [6]

Influence

Metacritic has been used by businesses to predict future sales. In 2007, Nick Wingfield of The Wall Street Journal wrote that Metacritic "influence[s] the sales of games and the stocks of video game publishers". He explains its influence as coming from the higher cost of buying video games than music or movie tickets. Many executives say that low scores "can hurt the long-term sales potential". Wingfield wrote that Wall Street pays attention to Metacritic and GameRankings because the sites typically post scores before sales data are publicly available, citing the respective rapid rise and fall in company values after BioShock and Spider-Man 3 were released. [5] In an interview with The Guardian , Marc Doyle cited two major publishers that "conducted comprehensive statistical surveys through which they've been able to draw a correlation between high metascores and stronger sales" in certain genres. He claimed that an increasing number of businesses and financial analysts use Metacritic as "an early indicator of a game's potential sales and, by extension, the publisher's stock price". [7] However, a 2015 study analyzing over 88 Xbox 360 and 80 PS3 games from 2012 found that Metacritic scores did not impact actual sales. [8]

Controversially, the website has been used by game publishers as a means of determining whether a game's developer receives additional royalties. One notable example is the 2010 game Fallout: New Vegas , which received an average Metascore of 84—one point too short of Bethesda's, the game's publisher, 85-point requirement. As a result, its developer, Obsidian Entertainment, received no additional bonus. Columnists took issue with the company's use of Metacritic, with one suggesting that this makes game critics ultimately accountable for deciding the developer's profits and another pointing out that a Metascore of 84 is not significantly lower than 85. The latter also pointed out the impressive sales of five million sold units and US$300 million in revenue, and also noted a series of Obsidian's layoffs in 2011 and 2012. [9] [10]

On the other hand, the website has been used by columnists and commentators as a general reference for critical reception, [11] and by publishers as a tool of improving their products. Along with other executives, in 2008, John Riccitiello, then CEO of Electronic Arts, showed Wall Street analysts a chart illustrating a downward trend in the average critical ratings of the company's games. He took the ratings seriously and stressed the need for the company to bounce back. [12] Also in 2008, Microsoft used Metacritic averages to delist underperforming Xbox Live Arcade games. [13] [14]

Metascores

Scores are weighted averages. Certain publications are given more significance "because of their stature". [5] Metacritic has said that it will not reveal the relative weight assigned to each reviewer. [15]

Games Editor Marc Doyle was interviewed in 2008 by Keith Stuart of The Guardian to "get a look behind the metascoring process". Stuart wrote: "The metascore phenomenon, namely Metacritic and GameRankings, have become an enormously important element of online games journalism over the past few years". [7] Doyle said that because video games lead to a greater investment of time and money, gamers are more informed about reviews than are fans of film or music; they want to know "whether that hotly anticipated title is going to deliver". [7]

Score index [16]
IndicationVideo gamesFilms/television/music
Universal acclaim90–10081–100
Generally favorable reviews75–8961–80
Mixed or average reviews50–7440–60
Generally unfavorable reviews20–4920–39
Overwhelming dislike0–19

In June 2018, Metacritic established the "Must-See" label for a movie that "achieves a Metascore of 81 or higher and has been reviewed by a minimum of 15 professional critics". [17] In September 2018, it added the "Must-Play" certification for video games attaining a score of 90% or more, and a minimum number of 15 reviews from industry professionals. [18] [19]

Reception

Metacritic received mixed reviews from website critics, commentators, and columnists alike. Its efficacy has been analyzed, with conclusions finding it to be generally useful [20] or unreliable and biased. [21] The website won two annual Webby Awards for excellence in the "Guides/Ratings/Reviews" category, in 2010 and 2015. [22] [23]

Criticism

Metacritic has been criticized for converting all scoring systems into a single quantitative percentage-based scale. For example, an "A" score equates to the value of 100, an "F" the value of zero, and a "B–" the value of 67. [7] Joe Dodson, former editor at Game Revolution, criticized Metacritic and similar sites for turning reviews into scores that he found to be too low. [5] Doyle defended the grading system, believing that every scale should be converted directly to that of the website, with its lowest possible score being 0 and the highest 100. [7] Further criticism was directed to the website's refusal to publicize how it aggregates scores. [8]

According to Doyle, publishers often try to persuade him to exclude reviews they feel are unfair, but he said that once a publication is included, he refuses to omit any of its reviews. [5] A Washington Post review of Uncharted 4 was assigned with a rating of 40/100 by Metacritic; this was the only negative review of the game. [24] Readers who disapproved of the review petitioned Metacritic to remove the Post as a trusted source. [25] As a result of its perceived negative influence on the industry, several reviewing sites, including Kotaku and Eurogamer , have dropped numerical reviews that would appear in Metacritic, instead favoring a qualitative assessment of a game. [26] [27] Kotaku also highlighted a practice alleged to be used by some publishers who use Metacritic scores as a way to leverage more favorable terms for the publisher or deny developers bonuses should they not reach a certain score. Doyle countered this by saying "Metacritic has absolutely nothing to do with how the industry uses our numbers... Metacritic has always been about educating the gamer. We're using product reviews as a tool to help them make the most of their time and money." [28]

Metacritic has also been criticized for how it handles banning users and their reviews, with no notice or formal process for appeal. [29] Critics and developers have pointed out that a product can suffer from rating manipulation by users, as by garnering low ratings that purposely damage its reputation or by receiving high ratings from throwaway accounts to make it appear more popular than it actually is. [30] [31] Signal Studios president and creative director Douglas Albright described the website as having no standards. [32]

See also

Related Research Articles

Entertainment Software Rating Board North American self-regulatory organization that assigns age and content ratings for video games

The Entertainment Software Rating Board (ESRB) is an American self-regulatory organization that assigns age and content ratings to consumer video games. The ESRB was established in 1994 by the Entertainment Software Association, in response to criticism of controversial video games with excessively violent or sexual content, particularly after the 1993 congressional hearings following the releases of Mortal Kombat and Night Trap for home consoles. The industry, pressured with potential government oversight of video game ratings from these hearings, established both the IDSA and the ESRB within it to create a voluntary ratings system based on the Motion Picture Association of America film rating system with additional considerations for video game interactivity.

Steam (service) Video game digital distribution service

Steam is a video game digital distribution service by Valve. It was launched as a standalone software client in September 2003 as a way for Valve to provide automatic updates for their games, and expanded to include games from third-party publishers. Steam has also expanded into an online web-based and mobile digital storefront. Steam offers digital rights management (DRM), server hosting, video streaming, and social networking services. It also provides the user with installation and automatic updating of games, and community features such as friends lists and groups, cloud storage, and in-game voice and chat functionality.

<i>RollerCoaster Tycoon 3</i> theme park simulation video game

RollerCoaster Tycoon 3 is a construction and management simulation video game. It is the third installment in the RollerCoaster Tycoon series, first released on November 2, 2004; in North America. RollerCoaster Tycoon 3 places players in charge of managing amusement parks; rides can be built or demolished, terrain and scenery can be adjusted, and prices can be controlled to keep visitors or "peeps" happy.

<i>Big Rigs: Over the Road Racing</i> 2003 racing video game

Big Rigs: Over the Road Racing is a 2003 racing video game developed by Stellar Stone and published by GameMill Publishing. The player controls a semi-trailer truck and races a stationary opponent through checkpoints on US truck routes. Stellar Stone, based in California, outsourced the game's development to Ukraine, and the game was released on November 20, 2003, in a pre-alpha state. Due to a multitude of bugs and lack of proper gameplay, Big Rigs was received very negatively, became the worst-rated game on review aggregator websites Metacritic and GameRankings, and has been frequently cited as one of the worst video games of all time by gaming publications. The game has also attracted a cult following since its release.

Super Smash Bros. is a series of crossover fighting video games published by Nintendo, and primarily features characters from various Nintendo franchises. The series was created by Masahiro Sakurai, who has directed every game in the series. The gameplay objective differs from that of traditional fighters in that the aim is to knock opponents off the stage instead of depleting life bars.

CBS Interactive Inc. is an American media company and is a subsidiary of the CBS Entertainment Group division of ViacomCBS. It is an online content network for information and entertainment. Its websites cover news, sports, entertainment, technology, and business. It is headed by Marc DeBevoise.

Tony Hawk's is a skateboarding video game series published by Activision and endorsed by the American professional skateboarder of the same name. The series was primarily developed for home consoles by Neversoft from launch to 2007, until Activision transferred the franchise to Robomodo in 2008, who developed the franchise until 2015 when Activision and Hawk's license expired, leaving the future of the series uncertain. In 2020, the series returned under Activision with a remake of the original two games in the series, with development handled by Vicarious Visions. The series has spawned a total of 19 games.

PlatinumGames Japanese video game company

PlatinumGames Inc. is a Japanese video game developer that was founded in October 2007 as result of a merger between two companies, Seeds Inc. and Odd Inc. Shinji Mikami, Atsushi Inaba, and Hideki Kamiya founded Seeds Inc. after the closure of Capcom's Clover Studio, while Odd Inc. was founded by Tatsuya Minami. A year after the studio was founded, video game publisher Sega announced that it would be publishing four unique properties developed by the company: MadWorld, Infinite Space, Bayonetta, and Vanquish. Their partnership later extended to include Anarchy Reigns. Most of these games were met with positive reception. Over the years, PlatinumGames had developed an expertise in action games and one of their key philosophies was that the team would not follow conventional game design concepts.

<i>Red Dead Redemption</i> 2010 action-adventure game

Red Dead Redemption is a 2010 action-adventure game developed by Rockstar San Diego and published by Rockstar Games. A spiritual successor to 2004's Red Dead Revolver, it is the second game in the Red Dead series. Red Dead Redemption is set during the decline of the American frontier in the year 1911 and follows John Marston, a former outlaw whose wife and son are taken hostage by the government in ransom for his services as a hired gun. Having no other choice, Marston sets out to bring three members of his former gang to justice.

A review aggregator is a system that collects reviews of products and services. This system stores the reviews and uses them for purposes such as supporting a website where users can view the reviews, selling information to third parties about consumer tendencies, and creating databases for companies to learn about their actual and potential customers. The system enables users to easily compare many different reviews of the same work. Many of these systems calculate an approximate average assessment, usually based on assigning a numeric value to each review related to its degree of positive rating of the work.

Uncharted is an action-adventure game series developed by Naughty Dog and published by Sony Interactive Entertainment for PlayStation consoles. The main series of games follows Nathan Drake, a treasure hunter who travels across the world to uncover various historical mysteries.

The Coalition (company) Xbox Game Studios developer, known for the Gears of War series

The Coalition is a Canadian video game developer and a studio of Xbox Game Studios based in Vancouver. The Coalition is best known for developing games in the Gears of War series after the franchise's acquisition by Xbox Game Studios from Epic Games.

<i>Souls</i> (series) Action role-playing video game series

Souls is a series of action role-playing games developed by FromSoftware. The series began with the release of Demon's Souls for the PlayStation 3 in 2009, and was followed by Dark Souls and its sequels, Dark Souls II and Dark Souls III, in the 2010s. The series' creator, Hidetaka Miyazaki, served as director for each of them with the exceptions of Dark Souls II and the externally developed Demon's Souls remake.

OpenCritic video game review aggregator

OpenCritic is a review aggregation website for video games. OpenCritic lists reviews from critics across multiple video game publications for the games listed on the site. The website then generates a numeric score by averaging all of the numeric reviews. Several other metrics are also available, such as the percentage of critics that recommend the game and its relative ranking across all games on OpenCritic.

<i>Death Stranding</i> 2019 video game

Death Stranding is an action game developed by Kojima Productions. It is the first game from director Hideo Kojima and Kojima Productions after their split from Konami in 2015. It was released by Sony Interactive Entertainment for the PlayStation 4 in November 2019 and by 505 Games for Windows in July 2020.

<i>The Last of Us Part II</i> 2020 action-adventure game

The Last of Us Part II is a 2020 action-adventure game developed by Naughty Dog and published by Sony Interactive Entertainment for the PlayStation 4. Set five years after The Last of Us (2013), players control two characters in a post-apocalyptic United States whose lives intertwine: Ellie, who sets out for revenge after suffering a tragedy, and Abby, a soldier who becomes involved in a conflict with a cult. The game is played from the third-person perspective. Players can use firearms, improvised weapons, and stealth to fight human enemies and cannibalistic creatures.

A review bomb is an Internet phenomenon in which large groups of people leave negative user reviews online for a published work, most commonly a video game or a theatrical film, in an attempt to harm the sales or popularity of a product, particularly to draw attention to an issue with the product or its vendor. While a review bomb may be a result of consumers criticizing the poor quality of the product, it can also be associated with perceived political and cultural issues around the product, its vendor, or related works. This is often done to draw wider and mainstream attention to that issue, especially if the vendor does not have an open communications channel or seems unresponsive to direct feedback, but may also as a means of mass-driven coercion or simply a result of trolling. Review bombing is a similar practice to and shares characteristics of vote brigading and cancel culture.

<i>Harry Potter</i> video games Licensed video games based on the Harry Potter novels

The Harry Potter video games are a series of video games based on the Harry Potter franchise originally created by J.K. Rowling. Many of the Harry Potter inspired video games are tie-ins to the novels and films of the same name. The main series features a video game for every novel, as well as two for the finale. There are multiple distinct versions for individual games.

<i>Bayonetta</i> (series) video game series

Bayonetta is a hack and slash video game series developed by PlatinumGames. The franchise was introduced in 2009 with Bayonetta. A sequel, Bayonetta 2, followed in 2014; Bayonetta 3 is in development. All three games star the titular character as its protagonist.

References

  1. "metacritic.com Competitive Analysis, Marketing Mix and Traffic - Alexa". Alexa Internet . Retrieved October 1, 2020.
  2. Leack, Jonathan (September 25, 2015). "OpenCritic's Gamer-Centric Style Is Everything Metacritic Should Have Been". Game Revolution . Archived from the original on September 27, 2015. Retrieved September 12, 2019.
  3. Rose, Mike (July 10, 2012). "Metacritic is here to stay, but can we fix it?". Gamasutra . Archived from the original on September 15, 2018. Retrieved September 12, 2019.
  4. "Metacritic: The History". Metacritic. CBS Interactive. Archived from the original on September 5, 2018. Retrieved September 5, 2018.
  5. 1 2 3 4 5 Wingfield, Nick (September 20, 2007). "High Scores Matter To Game Makers, Too". The Wall Street Journal . Archived from the original on February 15, 2015. Retrieved February 15, 2008.
  6. "Columbia Journalism Review - CJR's guide to what the major media companies own". Columbia Journalism Review . Archived from the original on April 17, 2016. Retrieved November 28, 2011.
  7. 1 2 3 4 5 Doyle, Marc (January 17, 2008). "Interview: the science and art of Metacritic". The Guardian (Interview). Interviewed by Stuart, Keith. Archived from the original on October 6, 2014. Retrieved February 15, 2008.
  8. 1 2 Khan, Imad (December 11, 2015). "Do Metacritic scores affect game sales?". The Daily Dot . Archived from the original on April 12, 2019. Retrieved September 12, 2019.
  9. MacDonald, Keza (July 16, 2012). "Is Metacritic Ruining The Games Industry?". IGN . Archived from the original on February 11, 2020. Retrieved September 8, 2019.
  10. Orland, Kyle (March 15, 2012). "Why linking developer bonuses to Metacritic scores should come to an end". Ars Technica . Archived from the original on December 17, 2019. Retrieved September 12, 2019.
  11. Gilbert, Ben (May 9, 2019). "The 10 best Pokémon games of all time, according to critics". Business Insider . Archived from the original on September 27, 2019. Retrieved September 8, 2019.
  12. Hillis, Scott (February 21, 2008). "Game scoring site wields industry clout". Reuters . Archived from the original on February 7, 2020. Retrieved September 8, 2019.
  13. Remo, Chris (May 22, 2008). "Microsoft To Delist Low-Ranking XBLA Titles, Raise Size Limit". Gamasutra . Archived from the original on May 25, 2008. Retrieved May 22, 2008.
  14. Keiser, Joe (May 22, 2008). "EXCLUSIVE INTERVIEW: MS to Delist XBLA Titles". Next Generation. p. 1. Archived from the original on January 24, 2012. Retrieved May 29, 2008.
  15. "Frequently Asked Questions". Metacritic. CBS Interactive. Archived from the original on August 13, 2015. Retrieved July 29, 2015.
  16. "How We Create the Metascore Magic". Metacritic. CBS Interactive. Archived from the original on September 28, 2015. Retrieved May 13, 2012.
  17. "New on Metacritic: Must-See Movies". Metacritic. CBS Interactive. June 11, 2018. Archived from the original on October 18, 2018. Retrieved October 16, 2018.
  18. Leonard, Matt (September 12, 2018). "Metacritic Adds 'Must-Play' Label to Highly Reviewed Games". Game Revolution . Archived from the original on February 27, 2020. Retrieved September 9, 2019.
  19. "New on Metacritic: Must-Play Games". Metacritic. CBS Interactive. September 12, 2018. Archived from the original on September 14, 2018. Retrieved April 24, 2020.
  20. Grubb, Jeff (August 7, 2013). "Metacritic works: Why the review-aggregation site is important for the average consumer". VentureBeat . Archived from the original on February 26, 2020. Retrieved September 7, 2019.
  21. Spector, Warren (May 13, 2013). "Defining Success: Why Metacritic Should Be Irrelevant". GamesIndustry.biz . Archived from the original on January 30, 2020. Retrieved September 7, 2019.
  22. "2010 Webby Award Winner". International Academy of Digital Arts and Sciences. 2010. Archived from the original on February 26, 2020. Retrieved September 6, 2019.
  23. "2015 Webby Award Winner". International Academy of Digital Arts and Sciences. 2015. Archived from the original on January 1, 2020. Retrieved September 6, 2019.
  24. "Uncharted 4: A Thief's End for Playstation 4 Reviews". Metacritic. CBS Interactive. Archived from the original on August 13, 2018. Retrieved August 6, 2018.
  25. Schreier, Jason (May 16, 2016). "Reviewer Targeted For Giving Uncharted 4 Negative Review". Kotaku. Archived from the original on May 16, 2016. Retrieved May 16, 2016.
  26. Tolito, Stephan (January 30, 2012). "How We Will Review Games". Kotaku. Archived from the original on February 10, 2015. Retrieved February 10, 2015.
  27. Welsh, Oli (February 10, 2015). "Eurogamer has dropped review scores". Eurogamer. Archived from the original on February 10, 2015. Retrieved February 10, 2015.
  28. Schreier, Jason (August 8, 2015). "Metacritic Matters: How Review Scores Hurt Video Games". Kotaku. Archived from the original on November 18, 2019. Retrieved November 27, 2019.
  29. "Metacritic bans 'bombing' user reviewers". ComputerAndVideoGames.com. September 23, 2011. Archived from the original on September 24, 2011. Retrieved September 23, 2011.
  30. Glennon, Jen (June 24, 2020). "Metacritic has a review bombing problem. Here are 6 ways to fix it". Inverse . Retrieved June 28, 2020.
  31. Valentine, Rebekah (February 21, 2020). "Kunai becomes the latest title review bombed on Metacritic by a single person". GamesIndustry.biz . Archived from the original on June 29, 2020. Retrieved June 28, 2020.
  32. Klepek, Patrick (September 22, 2011). "Metacritic Finds, Bans Group of Users Unfairly Scoring Games". Giant Bomb . Archived from the original on March 8, 2014. Retrieved September 22, 2011.