Steam Spy

Last updated
Steam Spy
Steamspy logo.png
Type of site
Video game sales tracking
OwnerSergey Galyonkin
Created bySergey Galyonkin
URL www.steamspy.com
LaunchedApril 2015;8 years ago (2015-04)

Steam Spy is a website created by Sergey Galyonkin and launched in April 2015. The site uses an application programming interface (API) to the Steam software distribution service owned by Valve to estimate the number of sales of software titles offered on the service. Estimates are made based on the API polling user profiles from Steam to determine what software titles (primarily video games) they own and using statistics to estimate overall sales. Software developers have reported that Galyonkin's algorithms can provide sales numbers that are accurate to within 10%, though Galyonkin cautions against using his estimates in financial projections and other business-critical decisions. Due to changes in Steam's privacy features in April 2018, Galyonkin had anticipated he would need to shut down the service due to the inability to estimate accurate numbers from other sources, but later that month revealed a new algorithm using publicly available data, which, while having a larger number of outliers, he still believes has reasonable accuracy for use.

Contents

Concept and history

Tracking of video game sales is of strong interest to the video game industry, but does not have the robustness of other industries, such as television with the Nielsen ratings system or music with Billboard charts. [1] Though Circana does track retail and digital sales of video games, access to this data requires payment and it does not typically break down distribution of sales on various platforms. [1] Sites like VGChartz have attempted to collect more detailed sales figures based on external data, but there have been reported problems with how this data is aggregated. [1] Valve's Steam client is the largest outlet for digital sales of games for Microsoft Windows, OS X, and Linux platforms. Normally, sales of video games and other software offered by Steam are kept confidential between Valve and the publishers and developers of the titles; developers and publishers are free to offer these numbers to the public if they desired. Valve does offer statistics on the most bought and played games, but otherwise does not provide any sales figures publicly. [1] Galyonkin noted that whereas the film industry receives funding from financing companies which are more open about sharing their financial results, funding within the video game comes from a variety of non-traditional sources, leading to the market being coy to report on the sales of a game. [2]

The idea for Steam Spy originally came from a similar approach used by Kyle Orland and the website Ars Technica for their "Steam Gauge" feature starting in April 2014. Steam Gauge uses the Steam API to access publicly available user profiles to obtain a list of games that that user owns. At the time of its creation there were over 170 million Steam accounts, making the task of polling the entire list of games impractical. Instead, they opted to poll between 80,000 and 90,000 each day as to collect the game lists, and then used sampling statistics to estimate the total ownership of each game. [1] Ars Technica estimated at its onset that the margin of error was within 0.33%. [1]

The site's founder, Sergey Galyonkin Sergey Galyonkin.jpg
The site's founder, Sergey Galyonkin

Galyonkin was inspired by Steam Gauge to create Steam Spy. At the time, Galyonkin was a Senior Analyst at Wargaming. [2] Steam Spy uses the same approach of sampling a small percentage of Steam accounts, approximately 100,000 to 150,000 per day with a rolling sampling approach. The collected data is processed nightly to create visualizations used on the site, and thus offers historical trends for games as well. [3] As with Steam Gauge, Galyonkin notes that Steam Spy is subject to similar sampling errors, so that data for newly released games or for games with low sales will not likely have accurate estimates of numbers. [3] The polling approach is also prone to promotions that Valve runs, such as when a game is offered for free over a weekend; during this time, the game will appear owned on every Steam profile, and will artificially bump up the sales numbers. [3] Galyonkin's method also polls the amount of time that each profile has played a particular game, allowing him to collect estimated playtime statistics on a per-game basis. [4]

As of September 2016, Galyonkin continues to operate the site and has plans for several major features, alongside his current position as Head of Publishing for Eastern Europe for Epic Games. [2]

However, in April 2018, Valve announced a change to Steam's privacy policies, giving users the ability to hide games, friend lists, and other elements of their provide as a means to aid in user privacy. Galyonkin announced that with this change, specifically in that the default settings for all users would hide these profile elements, he would be unable to collect the necessary data needed to run Steam Spy, and plans to shut down the service. [5] Galyonkin has available other data sources to pull estimates from, but he did not feel that they provide the same type of accuracy that he felt his approach with Steam Spy could meet; while he will use these sources for personal research as well as for his role at Epic Games, he does not plan to publish the results in depth. Galyonkin plans to maintain the archives of Steam Spy indefinitely. [6] The change in Steam's privacy settings came around the time of heightened awareness of personal data security, including the Facebook–Cambridge Analytica data scandal and the pending enforcement of the European Union's General Data Protection Regulation, and brought Steam's privacy settings inline with those offered by game console services. While journalists and game developers believed that the changes in Steam were for the best, they feared that the closure of Steam Spy would have a significant impact on independent game developers, who had used the service to gauge potential market and sales projections. [7] [8]

Later in April 2018, Galyonkin reported that he had returned to some earlier algorithms he had developed which used other publicly available data to serve as a possible replacement. He tested the algorithm on 70 games with most estimates he calculated coming within 10% of known sales figures, but he also observed there were more outliers, making this algorithm less accurate than his previous one, but still sufficient for market research purposes. Golyonkin plans to refine this algorithm and use it to continue operating Steam Spy. [9]

In December 2018, Epic Games announced their plans to start a similar storefront as Steam, the Epic Games Store. Galyonkin stated shortly after the announcement that he had been working with Epic for some years to help them develop the store, using the information and analysis he gained in running Steam Spy to help establish some of the features and policies that the Epic Games Store will use, such as providing developers with as much sales data they reasonably can. Galyonkin will still continue to operate Steam Spy. [10]

Impact

Galyonkin says that his estimates of sales have been confirmed as close with several developers. [3] Gamasutra says that developers that they have spoken to also agree that the numbers from Steam Spy are "in the right ballpark". [11] Several developers speaking to PCGamesN stated that Steam Spy is accurate to within 10% of actual sales figures for games with more than a few thousand sales, while the accuracy drops for low-selling titles; Galyonkin himself says data for games under 30,000 sales should be considered suspect. [12] Dave Gilbert of Wadjet Eye Games noted that developers should take caution towards using Steam Spy's data for financial projections as the analysis does not factor in the cost of the game when purchased or obtained, as it can fluctuate due to sales, gifts, developer promotions, and other situations. [13] An undisclosed video game publisher, speaking to Gamasutra , praised Steam Spy as a go-to tool used frequently in their industry to track trends, stating that "each game of ours tracks, broadly speaking, within its stated margin of error". [2] Galyonkin does warn of the accuracy of Steam Spy data, equating it to the accuracy of political surveys but believes it is sufficiently accurate for general analysis of trends and broad distributions. [14] The forementioned undisclosed publisher noted that Steam Spy data should never be used in isolation to make critical development or publishing decisions. [2]

Prior to August 2016, Galyonkin honored all requests from developers and publishers to remove games from his tracking system; examples include Kerbal Space Program and all games published by Paradox Interactive. [15] When Paradox had requested the removal in June 2016, Paradox's Shams Jorjani noted that they had seen "flawed" business plans from developers seeking their publisher support based solely on ownership data published by Steam Spy, prompting their request. [16] However, in August 2016, Galyonkin reversed this choice, retroactively reincluding the stats from games previously removed. Galyonkin opted for this when Techland requested him to remove their games from the site, prompting him to reassert that his site was meant to be a polling tool for game developers and not capture accurate sales data, and that "removing several important independent games from the service will hurt everyone else while not necessarily benefitting the publishers of the removed games". [16] Galyonkin noted there was no legal requirement for him to hide this otherwise-public and non-confidential data, and felt no developer was harmed for revealing this information. [2] One developer from a Latin American company did tell Gamasutra that they were concerned about Steam Spy's reporting of the high sales from their game, as it would potentially lead for their offices to become a target for theft in their region. [2]

Steam Spy has been used to help quantify certain trends in video game buying behaviors by both Galyonkin and other sources. For example, when Valve introduced the ability to allow buyers to request a refund for any game within certain time constraints in mid-2015, Galyonkin observed that most games received a small increase in sales, proposing that the refund policy enabled users to be more open to try games. [17] Galyonkin also observed that games using the Steam Early access program typically had their largest sales at the point of release for Early Access as opposed to on their completed release. [14] Galyonkin's data also shows that, based on a two-week period in August 2015, that Steam users spend the most time playing games published by Valve, specifically Dota 2 , Counter-Strike: Global Offensive , and Team Fortress 2 . [4] Galyonkin is able to track the number of concurrent players for a game over time, allowing him to determine a "Hype Factor" and "Surprise Factor" for games based on how much their player base shrunk or grew, respectively, after release, and correlate that to sales estimates. [18]

In June 2018, Valve has said they are also looking to provide tools similar to Steam Spy to be provided directly by APIs to others but with more accurate reporting as to make it better than Steam Spy. [19]

Mascot

The mascot for Steam Spy was created by Denis Galanin. [20]

Related Research Articles

<span class="mw-page-title-main">Valve Corporation</span> American video game company

Valve Corporation, also known as Valve Software, is an American video game developer, publisher, and digital distribution company headquartered in Bellevue, Washington. It is the developer of the software distribution platform Steam and the game franchises Half-Life, Counter-Strike, Portal, Day of Defeat, Team Fortress, Left 4 Dead, and Dota.

<span class="mw-page-title-main">Entertainment Software Rating Board</span> North American self-regulatory organization

The Entertainment Software Rating Board (ESRB) is a self-regulatory organization that assigns age and content ratings to consumer video games in the United States and Canada. The ESRB was established in 1994 by the Entertainment Software Association, in response to criticism of controversial video games with excessively violent or sexual content, particularly after the 1993 congressional hearings following the releases of Mortal Kombat and Night Trap for home consoles and Doom for home computers. The industry, pressured with potential government oversight of video game ratings from these hearings, established both the IDSA and the ESRB within it to create a voluntary rating system based on the Motion Picture Association of America film rating system with additional considerations for video game interactivity.

<span class="mw-page-title-main">Epic Games</span> American video game company

Epic Games, Inc. is an American video game and software developer and publisher based in Cary, North Carolina. The company was founded by Tim Sweeney as Potomac Computer Systems in 1991, originally located in his parents' house in Potomac, Maryland. Following its first commercial video game release, ZZT (1991), the company became Epic MegaGames, Inc. in early 1992 and brought on Mark Rein, who has been its vice president since. After moving the headquarters to Cary in 1999, the studio changed its name to Epic Games.

<span class="mw-page-title-main">Steam (service)</span> Video game digital distribution service

Steam is a video game digital distribution service and storefront developed by Valve Corporation. It was launched as a software client in September 2003 to provide game updates automatically for Valve's games, and expanded to distributing third-party titles in late 2005. Steam offers various features, like game server matchmaking with Valve Anti-Cheat measures, social networking, and game streaming services. Steam client's functions include game update automation, cloud storage for game progress, and community features such as direct messaging, in-game overlay functions and a virtual collectable marketplace.

<span class="mw-page-title-main">Indie game</span> Class of video game, generally independently published

An indie game, short for independent video game, is a video game typically created by individuals or smaller development teams without the financial and technical support of a large game publisher, in contrast to most "AAA" (triple-A) games. Because of their independence and freedom to develop, indie games often focus on innovation, experimental gameplay, and taking risks not usually afforded in AAA games. Indie games tend to be sold through digital distribution channels rather than at retail due to a lack of publisher support. The term is synonymous with that of independent music or independent film in those respective mediums.

<i>Garrys Mod</i> 2006 video game

Garry's Mod is a 2006 sandbox game developed by Facepunch Studios and published by Valve. The base game mode of Garry's Mod has no set objectives and provides the player with a world in which to freely manipulate objects. Other game modes, notably Trouble in Terrorist Town and Prop Hunt, are created by other developers as mods and are installed separately, by means such as the Steam Workshop. Garry's Mod was created by Garry Newman as a mod for Valve's Source game engine and released in December 2004, before being expanded into a standalone release that was published by Valve in November 2006. Ports of the original Windows version for Mac OS X and Linux followed in September 2010 and June 2013, respectively. As of September 2021, Garry's Mod has sold more than 20 million copies. A successor, Sandbox, has been in development since 2015.

<span class="mw-page-title-main">GOG.com</span> Digital video game distribution platform

GOG.com is a digital distribution platform for video games and films. It is operated by GOG sp. z o.o., a wholly owned subsidiary of CD Projekt based in Warsaw, Poland. GOG.com delivers DRM-free video games through its digital platform for Microsoft Windows, macOS and Linux.

Humble Bundle, Inc. is a digital storefront for video games, which grew out of its original offering of Humble Bundles, collections of games sold at a price determined by the purchaser and with a portion of the price going towards charity and the rest split between the game developers. Humble Bundle continues to offer these limited-time bundles, but have expanded to include a greater and more persistent storefront. The Humble Bundle concept was initially run by Wolfire Games in 2010, but by its second bundle, the Humble Bundle company was spun out to manage the promotion, payments, and distribution of the bundles. In October 2017, the company was acquired by Ziff Davis through its IGN Entertainment subsidiary.

In the video game industry, digital distribution is the process of delivering video game content as digital information, without the exchange or purchase of new physical media such as ROM cartridges, magnetic storage, optical discs and flash memory cards. This process has existed since the early 1980s, but it was only with network advancements in bandwidth capabilities in the early 2000s that digital distribution became more prominent as a method of selling games. Currently, the process is dominated by online distribution over broadband Internet.

<span class="mw-page-title-main">Potato Sack</span> Alternate reality game

The Potato Sack is the name of an alternate reality game (ARG) created by Valve and the developers of thirteen independent video games to promote the release of Valve's game Portal 2, in April 2011. Valve president Gabe Newell envisioned the game as a "Cross Game Design Event" in December 2010, and allowed the developers free rein to design the game using Valve's Portal intellectual property. The game, requiring players to find and solve a number of puzzles hidden within updates of the thirteen games, led to the opportunity for players to release Portal 2 about 10 hours earlier than its planned release by playing games under the pretense of powering up GLaDOS, the sentient computer antagonist from the Portal series. The ARG's theme of potatoes is based on plot elements within Portal 2, specifically that for part of the game, GLaDOS's personality module is run off a potato battery.

<span class="mw-page-title-main">SteamOS</span> Linux distribution by Valve

SteamOS is a Linux distribution developed by Valve. It incorporates Valve's popular namesake Steam video game storefront and is the primary operating system for Steam Machines and the Steam Deck. SteamOS is open source with some closed source components.

Early access, also known as alpha access, alpha founding, paid alpha, or game preview, is a funding model in the video game industry by which consumers can purchase and play a game in the various pre-release development cycles, such as pre-alpha, alpha, and/or beta, while the developer is able to use those funds to continue further development on the game. Those that pay to participate typically help to debug the game, provide feedback and suggestions, may have access to special materials in the game. The early-access approach is a common way to obtain funding for indie games, and may also be used along with other funding mechanisms, including crowdfunding. Many crowdfunding projects promise to offer access to alpha and/or beta versions of the game as development progresses; however, unlike some of these projects which solicit funds but do not yet have a playable game, all early access games offer an immediately playable version of the unfinished game to players.

<span class="mw-page-title-main">Denuvo</span> Anti-tamper software

Denuvo Anti-Tamper is an anti-tamper and digital rights management (DRM) system developed by the Austrian company Denuvo Software Solutions GmbH. The company was formed from a management buyout of DigitalWorks, the developer of SecuROM, and began developing the software in 2014. It was introduced with FIFA 15 in September. In addition to Denuvo Anti-Tamper, Denuvo Software Solutions has developed the anti-cheat system Denuvo Anti-Cheat and Nintendo Switch Emulator Protection, which prevents Nintendo Switch games from being emulated. The company was acquired by Irdeto in January 2018.

<span class="mw-page-title-main">HTC Vive</span> Virtual reality headset

HTC Vive is a line of virtual and mixed reality headsets produced by HTC Corporation. The brand currently encompasses headsets designed for use with personal computers as well as standalone headsets such as the Vive Focus line, Vive Flow glasses, and the Vive Elite XR mixed reality headset.

<span class="mw-page-title-main">Cross-platform play</span> Ability of players using different video game systems to play with each other simultaneously

In video games with online gaming functionality, also called cross-compatible play, cross-platform play, crossplay, or cross-play describes the ability of players using different video game hardware to play with each other simultaneously. It is commonly applied to the ability for players using a game on a specific video game console to play alongside a player on a different hardware platform such as another console or a computer. A related concept is cross-save, where the player's progress in a game is stored in separate servers, and can be continued in the game but on a different hardware platform.

A review bomb is an Internet phenomenon in which a large number of people or a few people with multiple accounts post negative user reviews online in an attempt to harm the sales or popularity of a product, a service, or a business. While a large number of negative reviews may simply be the result of a large number of customers independently criticizing something for poor quality, a review bomb may also be driven by a desire to draw attention to perceived political or cultural issues, perhaps especially if the vendor seems unresponsive or inaccessible to direct feedback. Review bombing also typically takes place over a short period of time and meant to disrupt established ratings that a product already has at review sites, sometimes backed by campaigns organized through online message boards. It may be used as a mass-movement-driven coercion tactic, as a form of protest, or may simply be a form of trolling. Review bombing is a similar practice to vote brigading.

Video games that include elements that use blockchain technologies, including cryptocurrencies and non-fungible tokens (NFTs), allow players to buy, sell, or trade in-game items with other players. The game publisher takes a fee from each transaction as a form of monetization. A subset of these games are also known as play-to-earn games because they include systems that allow players to earn cryptocurrency through gameplay. Blockchain games have existed since 2017, gaining more widespread attention from the video game industry in 2021. Several AAA publishers have expressed intent to include this technology in the future. Players, developers, and game companies have criticized the use of blockchain technology in video games for being exploitative, environmentally unsustainable, and unnecessary.

<span class="mw-page-title-main">Epic Games Store</span> Digital video game storefront

The Epic Games Store is a video game digital distribution service and storefront operated by Epic Games. It launched in December 2018 as a software client, for Microsoft Windows and macOS, and online storefront. The service provides friends list management, game matchmaking, and other features. Epic Games has further plans to expand the feature set of the storefront but it does not plan to add as many features as other digital distribution platforms, such as discussion boards or user reviews, instead using existing social media platforms to support these.

<i>Epic Games v. Apple</i> 2020 U.S. lawsuit

Epic Games v. Apple is a lawsuit brought by Epic Games against Apple in August 2020 in the United States District Court for the Northern District of California, related to Apple's practices in the iOS App Store. Epic Games specifically had challenged Apple's restrictions on apps from having other in-app purchasing methods outside of the one offered by the App Store. Epic Games' founder Tim Sweeney had previously challenged the 30% revenue cut that Apple takes on each purchase made in the App Store, and with their game Fortnite, wanted to either bypass Apple or have Apple take less of a cut. Epic implemented changes in Fortnite intentionally on August 13, 2020, to bypass the App Store payment system, prompting Apple to block the game from the App Store and leading to Epic filing its lawsuit. Apple filed a countersuit, asserting Epic purposely breached its terms of contract with Apple to goad it into action, and defended itself from Epic's suit.

<span class="mw-page-title-main">Steam Deck</span> Handheld gaming computer by Valve

The Steam Deck is a handheld gaming computer developed by Valve and released on February 25, 2022. The device uses Valve's Linux distribution SteamOS, which incorporates the namesake Steam storefront. SteamOS uses Valve's Proton compatibility layer, allowing users to run Windows applications and games. In addition to handheld use, the Steam Deck can be connected to a TV or monitor through a docking station and be used like a desktop computer or home video game console. In desktop mode, users can install Linux-based third-party applications.

References

  1. 1 2 3 4 5 6 Orland, Kyle (April 15, 2014). "Introducing Steam Gauge: Ars reveals Steam's most popular games". Ars Technica . Retrieved September 1, 2015.
  2. 1 2 3 4 5 6 7 Parkin, Simon (September 2, 2016). "Steam Spy and the specter of game sales transparency". Gamasutra . Retrieved September 2, 2016.
  3. 1 2 3 4 Hall, Charlie (April 3, 2015). "Steam Spy scrapes Steam user accounts to estimate sales data". Polygon . Retrieved September 1, 2015.
  4. 1 2 Hussain, Tamoor (August 13, 2015). "Steam Users Spend Most Time Playing Dota, Counter-Strike, Team Fortress 2". GameSpot . Retrieved September 2, 2015.
  5. Machovich, Sam (April 10, 2018). "Steam Spy announces it's shutting down, blames Valve's new privacy settings". Ars Technica . Retrieved April 10, 2018.
  6. Bratt, Chriss (April 11, 2018). "Why Steam Spy has to close, from the creator himself". Eurogamer . Retrieved April 11, 2018.
  7. Hall, Charlie (April 11, 2018). "Steam tweaks privacy settings, will soon let you be invisible while online". Polygon . Retrieved April 11, 2018.
  8. Grayson, Nathan (April 11, 2018). "Game Developers Mourn (And Celebrate) The End Of Steam Spy". Kotaku . Archived from the original on April 11, 2018. Retrieved April 11, 2018.
  9. Bailey, Dustin (April 27, 2018). "Steam Spy lives, but its new form is "not very accurate"". PCGamesN . Retrieved April 27, 2018.
  10. Grayson, Nathan (December 5, 2018). "The Guy Behind Steam Spy Has Been Working On Epic's Store For Years". Kotaku . Retrieved December 6, 2018.
  11. Nutt, Christian (June 19, 2015). "Steam Spy creator analyzes the platform, shares his data". Gamasutra . Retrieved September 1, 2015.
  12. Barrett, Ben (February 14, 2017). "What do developers and publishers really think of Steam Spy?". PCGamesN . Retrieved February 14, 2017.
  13. Wawro, Alex (April 6, 2015). "The risks of using Steam Spy to evaluate a dev's performance". Gamasutra . Retrieved September 1, 2015.
  14. 1 2 Galyonkin, Sergey (August 15, 2015). "How To Be Successful On Steam". Making Games. Retrieved September 1, 2015.
  15. Wawro, Alex (June 2, 2016). "Paradox games removed from Steam Spy tracker at company's request". Gamasutra . Retrieved June 2, 2016.
  16. 1 2 Frank, Allegra (August 26, 2016). "Steam Spy restores removed sales data despite developers' requests". Polygon . Retrieved August 26, 2016.
  17. Orland, Kyle (June 11, 2015). "Developers express worry, appreciation for Steam's new return policy". Ars Technica . Retrieved September 2, 2015.
  18. Good, Owen (August 27, 2016). "No Man's Sky, Firewatch make Steam Spy's ranking of the year's most-hyped games". Polygon . Retrieved September 2, 2016.
  19. Bailey, Dustin (June 28, 2018). "Valve plans to replace Steam Spy with "something better"". PCGamesN . Retrieved June 29, 2018.
  20. "About Steam Spy". steamspy.com.