Playtest

Last updated

A playtest is the process by which a game designer tests a new game for bugs and design flaws before releasing it to market. Playtests can be run "open", "closed", "beta", or otherwise, and are very common with board games, collectible card games, puzzle hunts, role-playing games, and video games, for which they have become an established part of the quality control process. An individual involved in testing a game is referred to as a playtester.

Contents

An open playtest could be considered open to anyone who wishes to join, or it may refer to game designers recruiting testers from outside the design group. Prospective testers usually must complete a survey or provide their contact information in order to be considered for participation. A closed playtest is an internal testing process not available to the public. Beta testing normally refers to the final stages of testing just before going to market with a product, and is often run semi-open with a limited form of the game in order to find any last-minute problems. With all forms of playtesting it is not unusual for participants to be required to sign a non-disclosure agreement, in order to protect the game designer's copyrights.

The word 'playtest' is also commonly used in unofficial situations where a game is being tested by a group of players for their own private use, or to denote a situation where a new strategy or game mechanic is being tested. Playtesting is a part of usability test in the process of game development. [1]

Video games

In the video game industry, playtesting refers specifically to the process of exposing a game in development (or some specific parts of it) to its intended audience, to identify potential design flaws and gather feedback. Playtests are also used to help ensure that a product will be commercially viable upon release, by providing a way for consumers to play the game and provide their opinions. Playtesting should not be confused with quality assurance (QA) testing, in which professional testers look for and report specific software bugs to be fixed by the development team.

The first user research employee in the video game industry was Carol Kantor, who was employed by Atari, Inc. in 1976. Prior to this, the company had evaluated their games primarily via coin-collection data, however playtesting became a core method by which Atari evaluated the commercial viability of new games. [2]

The Boston Globe described playtesting as "what everyone says is the least favorite part of the game-building operation".[ citation needed ] Steve Meretzky of Infocom said that "the first part of debugging is exciting; it's the first feedback. Somebody is actually playing your game. But by the end, you get sick of the little problems. You have spent three months inventing the game, and now you have to spend just as much time cleaning it up". [3] The requirements for a person to be considered for participation in a playtest vary. Some playtests are open to anyone willing to volunteer, while others specifically target professional gamers and journalists. Some playtests also try to evaluate the game's appeal to players with different levels of experience by selecting players with varying exposure to the game's genre.

An example of a video game that made extensive use of open playtesting is Minecraft, which was made available for purchase in its pre-alpha stages. This both helped to financially support the game and provide feedback and bug testing during its early stages. Playtesting began even before the game features included multiplayer or the ability to save games. [4] Mojang continues to make use of playtesting with Minecraft through weekly development releases, allowing players to experiment with unfinished additions to the game and provide feedback on them.

Some games make use of playtesting with only part of their content, leaving other important sections unexposed to the public. StarCraft II: Heart of the Swarm was tested in this manner; its playtest only included the multiplayer portion of the game, while the single-player campaign was not revealed. [5] Heart of the Swarm is also an example of a playtest where average players are not being considered for entry; the initial wave of testers are only being selected from the ranks of professional SCII gamers and from the media.

The open-source video game engine remake OpenRA, which recreates the early Command & Conquer games, publishes playtests to the public during the release process so that a broader range of testers can verify that new features don't introduce critical errors such as desync problems in the lockstep protocol and unwanted side effects on the gameplay can be balanced out prior to the next stable release. [6]

Team Fortress 2 uses a method of playtesting whereby players that purchased the game can participate in an open beta. The beta is nearly identical to the actual game itself, but includes items that are on their way to being released in the full game. The purpose of this beta is to test those items before their release, to ensure that they are balanced and fair; in this way, the game is constantly being playtested despite the fact that it has been released. [7]

Valve does not often make use of open playtesting, in keeping with the company's tradition of tightly controlling what information they release to the public. However, both Dota 2 and Counter-Strike: Global Offensive were openly playtested, with beta invites being distributed to (and in some cases by) volunteers. Valve also has a general beta signup form on their website; [8] this survey is intended to recruit testers both in the Seattle/Bellevue area and from other locations, to test new games and gaming hardware that Valve is developing. [9] [10]

Role-playing games

Due to the nature of pen-and-paper RPGs as opposed to video games, RPG playtests tend to focus more on ensuring that the game's mechanics are balanced and that the game flows smoothly in play. It is also more typical to see feedback from players cause game mechanics to be adjusted or altered, as it is usually easier to make such changes with an RPG than it would be with a video game.

An example of a role-playing game that was heavily playtested is the 5th edition of Dungeons & Dragons. For this game, Wizards of the Coast (WotC) used an open playtest with volunteers from their online community to evaluate the game as it was being developed. [11] [12] New playtest packets were distributed to the testers as WotC revised the game. WotC focused heavily on the results of this testing owing to the mixed reactions that the 4th edition rules received, [13] showcasing another advantage of playtesting: helping to ensure that the final product will be a commercial success. The process produced feedback to WotC regarding which aspects of the game needed modifications or redesigns. [14] [15]

While D&D's 4th edition did see some playtesting, this was mainly restricted to classes added after the game's initial release, such as the monk and the bard. The playtest documents were released through the online Dragon Magazine, and were originally available for both subscribers and non-subscribers. [16]

Fantasy Flight Games is running a playtest of the first installment of their new Star Wars RPG. This playtest is similar to Minecraft's in that the players must purchase the beta rules from Fantasy Flight before playing; the rules are not being released freely to the public. [17] Updates made to the rules are released in PDF format on their website, but there is no word on whether playtesters will get a copy of the actual final draft.

Paizo Publishing ran a completely open playtest through the alpha and beta stages of their Pathfinder Roleplaying Game in 2008 and 2009, releasing the rules as free PDF's (and also in print for the beta version) on their web store. [18] Anyone could join the playtest by downloading the documents, running games using them, and posting their feedback on the Paizo message boards. This playtest, which was active for over a year, is the longest-running open playtest in RPG history to date, [19] as well as being one of the largest due to its unrestricted nature.

Board games

In the board game industry, playtesting applies both to feedback gathered during the early design process as well as late stage exposure to the target audience by a game's publisher. Major types of boardgame testing include local testing — where a designer, developer, or publisher representative moderates the test in person, and remote testing, where groups receive copies of the game or files to assemble their own version. [20]

Wizards of the Coast ran a public playtest of their new Dungeon Command miniatures game. In this case, they used the feedback generated on the rules to improve the game but also used feedback on the playtest itself to improve logistics on the D&D Next playtest. [21]

Steve Jackson Games uses Munchkin players from the area around their offices to test new cards and expansions, as well as distributing playtest packages at conventions. According to the SJG website, this is done "so we [the developers] can observe carefully which cards work well, which jokes aren't as funny as we thought, and so on." [22]

Other games

The playtest concept has been carried over into a full-fledged sport. Jim Foster, inventor and founder of the Arena Football League, tested his concept of indoor football in a special one-time game in 1986. This game was organized at the behest of NBC in order to test the viability of the game's concept. [23] The Rockford Metros and the Chicago Politicians played the game in Rockford, Illinois. The test proved successful, and four teams began the league's first season the following year.

Disadvantages

The most dangerous risks with playtesting is that the playtest version of the game could be released over the internet, particularly if it is a video game or something presented in an electronic format. There are ways to prevent this; for example, requiring all players to log-on to the game's servers before it will launch, or implementing other forms of DRM.

Even if the game itself is not leaked, details regarding its gameplay still may be. It is likely that over the course of an open playtest, even one where testers signed NDAs, that some details will be leaked onto the web. This is a major risk for companies wishing to preserve secrecy, particularly in nations where there are no way to prevent leaks from occurring.

See also

Related Research Articles

<i>Dungeons & Dragons</i> Fantasy role-playing game

Dungeons & Dragons is a fantasy tabletop role-playing game (RPG) originally created and designed by Gary Gygax and Dave Arneson. The game was first published in 1974 by Tactical Studies Rules, Inc. (TSR). It has been published by Wizards of the Coast, now a subsidiary of Hasbro, since 1997. The game was derived from miniature wargames, with a variation of the 1971 game Chainmail serving as the initial rule system. D&D's publication is commonly recognized as the beginning of modern role-playing games and the role-playing game industry, and also deeply influenced video games, especially the role-playing video game genre.

<span class="mw-page-title-main">Wizards of the Coast</span> American game publisher

Wizards of the Coast LLC is an American publisher of games, primarily based on fantasy and science fiction themes, and formerly an operator of retail stores for games. It is currently a subsidiary of Hasbro, which acquired the company in 1999. During a February 2021 reorganization at Hasbro, Wizards of the Coast became the lead part of the new "Wizards & Digital" division.

<span class="mw-page-title-main">Monte Cook</span> American writer and game designer

Monte Cook is an American professional tabletop role-playing game designer and writer, best known for his work on Dungeons & Dragons.

Open gaming is a movement within the tabletop role-playing game (RPG) industry with superficial similarities to the open source software movement. The key aspect is that copyright holders license their works under public copyright licenses that permit others to make copies or create derivative works of the game.

<i>Players Handbook</i> Series of Dungeons & Dragons player rulebooks

The Player's Handbook is the name given to one of the core rulebooks in every edition of the fantasy role-playing game Dungeons & Dragons (D&D). It does not contain the complete set of rules for the game, and only includes rules for use by players of the game. Additional rules, for use by Dungeon Masters (DMs), who referee the game, can be found in the Dungeon Master's Guide. Many optional rules, such as those governing extremely high-level players, and some of the more obscure spells, are found in other sources.

<i>Dungeon Masters Guide</i> Role-playing game rulebook

The Dungeon Master's Guide is a book of rules for the fantasy role-playing game Dungeons & Dragons. The Dungeon Master's Guide contains rules concerning the arbitration and administration of a game, and is intended for use by the game's Dungeon Master.

The Open Game License (OGL) is a public copyright license by Wizards of the Coast that may be used by tabletop role-playing game developers to grant permission to modify, copy, and redistribute some of the content designed for their games, notably game mechanics. However, they must share-alike copies and derivative works.

<span class="mw-page-title-main">Owlbear</span> Fictional monster from Dungeons & Dragons

An owlbear is a fictional creature originally created for the Dungeons & Dragons fantasy role-playing game. An owlbear is depicted as a cross between a bear and an owl, which "hugs" like a bear and attacks with its beak. Inspired by a plastic toy made in Hong Kong, Gary Gygax created the owlbear and introduced the creature to the game in the 1975 Greyhawk supplement; the creature has since appeared in every subsequent edition of the game. Owlbears, or similar beasts, also appear in several other fantasy role-playing games, video games and other media.

<i>Unearthed Arcana</i> AD&D supplement by Gary Gygax

Unearthed Arcana is the title shared by two hardback books published for different editions of the Dungeons & Dragons fantasy role-playing game. Both were designed as supplements to the core rulebooks, containing material that expanded upon other rules.

<span class="mw-page-title-main">Rob Heinsoo</span> American game designer (born 1964)

Rob Heinsoo is an American tabletop game designer. He has been designing and contributing to professional role-playing games, card games, and board games since 1994. Heinsoo was the lead designer on the 4th Edition of Dungeons & Dragons (2008), and is co-designer of the 13th Age roleplaying game along with Jonathan Tweet. He has also designed and contributed to role playing, miniatures and card games, and a computer game.

<span class="mw-page-title-main">Mike Mearls</span> American game designer

Michael Mearls is an American writer and designer of fantasy role-playing games (RPGs) and related fiction. He was the senior manager for the Dungeons & Dragons research and design team. He co-led design for the 5th edition of the game. He also worked on the Castle Ravenloft board game, and various compendium books for 3rd, 4th, and 5th editions Dungeons & Dragons.

<i>Pathfinder Roleplaying Game</i> Tabletop role-playing game

The Pathfinder Roleplaying Game is a fantasy role-playing game (RPG) that was published in 2009 by Paizo Publishing. The first edition extends and modifies the System Reference Document (SRD) based on the revised 3rd edition Dungeons & Dragons (D&D) published by Wizards of the Coast under the Open Game License (OGL) and is intended to be backward-compatible with that edition.

Andy Collins is a game designer whose writing credits include numerous books for the Dungeons & Dragons fantasy role-playing game.

<span class="mw-page-title-main">Ray Winninger</span> Game designer

Ray Winninger is a game designer who has worked on a number of roleplaying games, including the Dungeons & Dragons fantasy roleplaying game. He is the former Executive Producer for the Wizards of the Coast Dungeons & Dragons studio.

<span class="mw-page-title-main">Tabletop role-playing game</span> Form of role-playing game using speech

A tabletop role-playing game, also known as a pen-and-paper role-playing game, is a classification for a role-playing game (RPG) in which the participants describe their characters' actions through speech. Participants determine the actions of their characters based on their characterization, and the actions succeed or fail according to a set formal system of rules and guidelines. Within the rules, players have the freedom to improvise; their choices shape the direction and outcome of the game.

Jesse Decker is an author, designer, and editor of roleplaying game material.

The artificer is a playable character class in the Dungeons & Dragons (D&D) fantasy role-playing game. The Artificer first appeared as a full class in the 3.5 edition of D&D and was introduced in the Eberron campaign setting. The artificer is a unique base class that reflects many of the core themes of Eberron.

<span class="mw-page-title-main">D&D Beyond</span> Official digital toolset and game companion for Dungeons & Dragons fifth edition

D&D Beyond (DDB) is the official digital toolset and game companion for Dungeons & Dragons fifth edition. DDB hosts online versions of the official Dungeons & Dragons fifth edition books, including rulebooks, adventures, and other supplements; it also provides digital tools like a character builder and digital character sheet, monster and spell listings that can be sorted and filtered, an encounter builder, and an interactive overlay Twitch Extension. In addition to the official D&D content available to purchase, it also provides the ability to create and add custom homebrew content.

References

  1. Yáñez-Gómez, Rosa; Cascado-Caballero, Daniel; Sevillano, José-Luis (February 2017). "Academic methods for usability evaluation of serious games: a systematic review". Multimedia Tools and Applications. 76 (4): 5755–5784. doi:10.1007/s11042-016-3845-9. hdl: 11441/74400 . ISSN   1380-7501. S2CID   254833872.
  2. Marie, Meagan (2018). Women in Gaming: 100 Professionals of Play. Dorling Kindersley. p. 16. ISBN   978-0241395066.
  3. Dyer, Richard (1984-05-06). "Masters of the Game". The Boston Globe. Archived from the original on 1997-06-07.
  4. Persson, Marcus. "Minecraft.net goes live and you can save your levels". The Word of Notch.
  5. "Heart Of The Swarm Beta Now Live". Battle.net.
  6. OpenRA wiki: Development Process, GitHub
  7. "Team Fortress 2 Beta". Team Fortress Wiki.
  8. "Valve Playtester Survey". Valve. Retrieved 14 October 2012.
  9. "Valve Playtester Survey (Introduction)". Valve. Retrieved 14 October 2012.
  10. Petitte, Omri (10 October 2012). "Valve seeks playtesters for game projects and hardware prototypes". PC Gamer. Retrieved 14 October 2012.
  11. Gilsdorf, Ethan (January 9, 2012). "Players Roll the Dice for Dungeons & Dragons Remake". New York Times . p. 2. Retrieved January 9, 2012.
  12. Mearls, Mike (January 9, 2012). "Charting the Course for D&D: Your Voice, Your Game". Wizards of the Coast. Archived from the original on January 12, 2012. Retrieved January 9, 2012.
  13. Dungeons & Dragons Roleplaying Game Official Home Page - Article (News on D&D Next)
  14. Mearls, Mike. "Playtest: First Round Overview". Wizards of the Coast. Archived from the original on May 30, 2012. Retrieved 11 October 2012.
  15. Mearls, Mike. "Playtest Update". Wizards of the Coast. Archived from the original on July 2, 2012. Retrieved 11 October 2012.
  16. Heinsoo, Rob. "The Monk". Dragon #375. Wizards of the Coast. Archived from the original on December 12, 2009. Retrieved 18 October 2012.
  17. "Join the Beta and Be Among the First to Play". Fantasy Flight Games. Retrieved 11 October 2012.
  18. Bulmahn, Jason. "Welcome to the Beta Playtest". Paiso Publishing. Retrieved 11 October 2012.
  19. Pathfinder RPG (Atomic Array 029). Retrieved 14 August 2009.
  20. "Playtesters: What They Do & Why They're Important to Making Great Games". Renegade Game Studios. Retrieved 28 November 2019.
  21. Dupuis, Chris. "Dungeon Command - Follow the Leader". Wizards of the Coast. Archived from the original on July 2, 2012. Retrieved 11 October 2012.
  22. "Playtesting for Steve Jackson Games". Steve Jackson Games. Retrieved 11 October 2012.
  23. "A good idea...on paper". The Florida Times-Union. May 12, 2001. Archived from the original on June 23, 2012. Retrieved 2009-08-06.

Further reading