Skill-based matchmaking

Last updated

Skill-based matchmaking (SBMM), also referred to as matchmaking ranking, is a form of matchmaking dependent on the relative skill level of the players involved.

Contents

History

A common rating system in chess is the Elo rating system, developed by Arpad Elo. Former International Chess Federation president Florencio Campomanes described it as an "inseparable partner to high-level chess". [1] In 2006, Microsoft researchers proposed a skill-based rating system using Bayesian inference and deployed it on the Xbox Live network, then one of the largest deployments of a Bayesian inference algorithm. [2] The researchers were displeased with the ranking system in the beta of Halo 2 (2004). [3] By the time Halo 2 launched, it was using TrueSkill. [4]

The term skill-based matchmaking first appeared in a 2008 interview with game designer John Carmack in which he emphasized its importance in Quake Live (2010). Upon setting up an account with id Software, the game will ask the player for their skill level and judge accordingly depending on their performance from that point forward. [5] The presence—or lack thereof—of skill-based matchmaking became a point of contention. During the development of Dota 2 (2013), Valve Software believed that the barrier to entry could be solved with, among other things, skill-based matchmaking through its Steamworks service; [6] when Call of Duty: Black Ops (2010) developer Treyarch was asked why the game wouldn't include skill-based matchmaking unlike Halo 3 (2007), multiplayer design director David Vonderhaar said that speed was "more important than anything else". [7]

Description

Team-based, competitive games such as League of Legends (2009), Counter-Strike: Global Offensive (2012), Dota 2 (2013), and Overwatch (2016) benefit from skill-based matchmaking. In contrast, Call of Duty: Black Ops II (2012)—a game that primarily focuses on single-player accomplishments—does not benefit from skill-based matchmaking. [8] Treyarch, who developed Call of Duty: Black Ops II, consciously queued players exclusively using ping and latency, in a subversion of industry standards at the time. [9]

Queues

In skill-based matchmaking, queue design focuses on how to divide parties into appropriate skill groups. In contrast to StarCraft II (2010), which focuses on player-on-player action, Blizzard Entertainment's Heroes of the Storm (2015) is a team-based game. The Heroes of the Storm matchmaker aims to have players win at least half of the games that they play. The game's matchmaker also aims to pair coordinated teams with other coordinated teams in order to avoid an unfair communication advantage. [10] According to game director Ben Brode, Hearthstone (2014) maintains a separate pool of new players. Players remain in the pool until they win ten games or obtain two legendary minions.

Player rating model

The skill rating of a player is their ability to win a match based on aggregate data. Various models have emerged to achieve this. Mark Glickman implemented skill volatility into the Glicko rating system. [11] In 2008, researchers at Microsoft extended TrueSkill for two-player games by describing a number for a player's ability to force draws. [12] Variability in map, character, and server effects have been considered in at least two research papers. [13] [14] In 2016, two Cornell University graduates modeled skill rating as a vector of numbers, showing "substantial intransitivity". [15]

Reception

Skill-based matchmaking is a controversial practice. In Call of Duty: Warzone (2020), streamers of the game often seek out "bot lobbies"—lobbies with less-skilled players. The Washington Post compared the practice to "LeBron James looking to join pickup games at the local YMCA". Call of Duty: Warzone players who have spoken out against the game's use of skill-based matchmaking include 100 Thieves CEO Nadeshot, former professional Counter-Strike: Global Offensive player Shroud, and 100 Thieves co-owner CouRage. Competitive Call of Duty: Warzone player HusKerrs wrote that high-skilled players must "sweat or try hard" in order to create engaging content. [16] Streamer TimTheTatman refused to stream Call of Duty: Modern Warfare 2 (2022) upon discovering that it would implement skill-based matchmaking. [17]

In February 2023, Destiny 2 (2017) introduced skill-based matchmaking. Higher-skilled players subsequently discovered a way to enter lobbies with lower-skilled players, resulting in outcry from the community. [18]

Related Research Articles

<span class="mw-page-title-main">Elo rating system</span> Method for calculating relative skill levels of players

The Elo rating system is a method for calculating the relative skill levels of players in zero-sum games such as chess. It is named after its creator Arpad Elo, a Hungarian-American physics professor.

<span class="mw-page-title-main">United States Chess Federation</span> US governing body for chess competition

The United States Chess Federation is the governing body for chess competition in the United States and represents the U.S. in FIDE, the World Chess Federation. US Chess administers the official national rating system, awards national titles, sanctions over twenty national championships annually, and publishes two magazines: Chess Life and Chess Life for Kids. The USCF was founded and incorporated in Illinois in 1939, from the merger of two older chess organizations. It is a 501(c)(3) non-profit organization headquartered in St. Louis, Missouri. Its membership as of 2020 as COVID hit was 97,000; as of 2024 the membership was 112,000.

<span class="mw-page-title-main">Online game</span> Video game played over the Internet

An online game is a video game that is either partially or primarily played through the Internet or any other computer network available. Online games are ubiquitous on modern gaming platforms, including PCs, consoles and mobile devices, and span many genres, including first-person shooters, strategy games, and massively multiplayer online role-playing games (MMORPG). In 2019, revenue in the online games segment reached $16.9 billion, with $4.2 billion generated by China and $3.5 billion in the United States. Since the 2010s, a common trend among online games has been to operate them as games as a service, using monetization schemes such as loot boxes and battle passes as purchasable items atop freely-offered games. Unlike purchased retail games, online games have the problem of not being permanently playable, as they require special servers in order to function.

The Glicko rating system and Glicko-2 rating system are methods of assessing a player's strength in zero-sum two-player games. The Glicko rating system was invented by Mark Glickman in 1995 as an improvement on the Elo rating system and initially intended for the primary use as a chess rating system. Glickman's principal contribution to measurement is "ratings reliability", called RD, for ratings deviation.

Call of Duty, also referred to as (COD), is a video game series and media franchise published by Activision, starting in 2003. The games were first developed by Infinity Ward, then by Treyarch and Sledgehammer Games. Several spin-off and handheld games were made by other developers. The most recent title, Call of Duty: Modern Warfare III, was released on November 10, 2023.

TrueSkill is a skill-based ranking system developed by Microsoft for use with video game matchmaking on the Xbox network. Unlike the popular Elo rating system, which was initially designed for chess, TrueSkill is designed to support games with more than two players. In 2018, Microsoft published details about an extended version of TrueSkill, named TrueSkill2.

A chess rating system is a system used in chess to estimate the strength of a player, based on their performance versus other players. They are used by organizations such as FIDE, the US Chess Federation, International Correspondence Chess Federation, and the English Chess Federation. Most of the systems are used to recalculate ratings after a tournament or match but some are used to recalculate ratings after individual games. Popular online chess sites such as chess.com, Lichess, and Internet Chess Club also implement rating systems. In almost all systems, a higher number indicates a stronger player. In general, players' ratings go up if they perform better than expected and down if they perform worse than expected. The magnitude of the change depends on the rating of their opponents. The Elo rating system is currently the most widely used. The Elo-like ratings systems have been adopted in many other contexts, such as other games like Go, in online competitive gaming, and in dating apps.

<span class="mw-page-title-main">IW (game engine)</span> Game engine developed by Infinity Ward

The IW engine is a game engine created and developed by Infinity Ward for the Call of Duty series. The engine was originally based on id Tech 3. Aside from Infinity Ward, the engine is also used by other Activision studios working on the series, including primary lead developers Treyarch and Sledgehammer Games, and support studios like Beenox, High Moon Studios, and Raven Software.

<i>Dota 2</i> 2013 video game

Dota 2 is a 2013 multiplayer online battle arena (MOBA) video game by Valve. The game is a sequel to Defense of the Ancients (DotA), a community-created mod for Blizzard Entertainment's Warcraft III: Reign of Chaos. Dota 2 is played in matches between two teams of five players, with each team occupying and defending their own separate base on the map. Each of the ten players independently controls a powerful character known as a "hero" that all have unique abilities and differing styles of play. During a match players collect experience points and items for their heroes to defeat the opposing team's heroes in player versus player combat. A team wins by being the first to destroy the other team's "Ancient", a large structure located within their base.

In multiplayer video games, matchmaking is the process of connecting players together for online play sessions.

<i>Halo 5: Guardians</i> 2015 video game

Halo 5: Guardians is a 2015 first-person shooter video game developed by 343 Industries, published by Microsoft Studios, and released worldwide for the Xbox One game console on October 27, 2015. The plot follows two fireteams of human supersoldiers: Blue Team, led by Master Chief, and Fireteam Osiris, led by Spartan Locke. When Blue Team goes absent without leave to track down the artificial intelligence construct Cortana, Master Chief's loyalty is called into question and Fireteam Osiris is sent to retrieve him.

<i>Vainglory</i> (video game) Multiplayer online battle arena video game

Vainglory is a free-to-play video game with in-game purchases, developed and published by Super Evil Megacorp for iOS, Android and PC. The game is a version of the MOBA wherein two opposing teams of three or five players fight to destroy the enemy by controlling the path between the bases, which is lined by turrets and guarded by AI-controlled enemy creatures called minions. Off the path, players battle for control points that provide resources. The game was released for iOS on November 16, 2014, after being soft-launched for over half a year, with the Android version being released on July 2, 2015. A Mac and Microsoft Windows version of the game was released in July 2018. Through cross-platform play, players on all four platforms can play together simultaneously.

Elo hell is a video gaming term used in MOBAs and other multiplayer online games with competitive modes. It refers to portions of the matchmaking ranking spectrum where individual matches are of poor quality, and are often determined by factors such as poor team coordination which are perceived to be outside the individual player's control. This ostensibly makes it difficult for skilled players to "climb" up the matchmaking ranking, due to the difficulty of consistently winning games under these conditions. Its existence in various games has been debated, and some game developers have called it an illusion caused by cognitive bias.

<i>Call of Duty: Modern Warfare</i> (2019 video game) 2019 video game reboot

Call of Duty: Modern Warfare is a 2019 first-person shooter video game developed by Infinity Ward and published by Activision. Serving as the sixteenth overall installment in the Call of Duty series, as well as a reboot of the Modern Warfare sub-series, it was released on October 25, 2019, for Microsoft Windows, PlayStation 4, and Xbox One.

<i>Dota Underlords</i> 2020 video game

Dota Underlords is a 2020 auto battler game developed and published by Valve. The game is based on a popular Dota 2 community-created game mode called Dota Auto Chess, which was released in January 2019. Dota Underlords first released in early access in June 2019 before officially releasing on February 25, 2020, for Android, iOS, macOS, Linux, and Windows. The game is free to play and features cross-platform play.

<i>Call of Duty: Warzone</i> 2020 video game

Call of Duty: Warzone was a free-to-play battle royale video game developed by Raven Software and Infinity Ward and published by Activision. The game was released on March 10, 2020, for PlayStation 4, Windows, and Xbox One as a part of 2019's Call of Duty: Modern Warfare and was subsequently connected to 2020's Call of Duty: Black Ops Cold War and 2021's Call of Duty: Vanguard, but did not require purchase of any of the aforementioned titles. Warzone allowed online multiplayer combat among 150 players and featured both cross-platform play and cross-platform progression between the three aforementioned titles.

<i>Call of Duty: Black Ops Cold War</i> 2020 video game

Call of Duty: Black Ops Cold War is a 2020 first-person shooter game developed by Treyarch and Raven Software and published by Activision. It is the sixth installment in the Black Ops sub-series and the seventeenth installment in the overall Call of Duty series, serving as a direct narrative continuation of 2010's Call of Duty: Black Ops. The game was released on November 13, 2020, for PlayStation 4, PlayStation 5, Windows, Xbox One, and Xbox Series X/S.

<i>Call of Duty: Modern Warfare II</i> (2022 video game) 2022 video game

Call of Duty: Modern Warfare II is a 2022 first-person shooter video game developed by Infinity Ward and published by Activision. It is a sequel to the 2019 reboot game, and serves as the nineteenth installment in the overall Call of Duty series. It was released on October 28, 2022, for PlayStation 4, PlayStation 5, Windows, Xbox One, and Xbox Series X/S.

Boosting is a method by which low-ranked players in online multiplayer games, such as first-person shooters and massively multiplayer online role-playing games (MMORPGs), hire more skilled players to artificially increase their gaming account rank or winning positions. Boosting is rarely allowed as part of a game's terms of service, and while legal in most countries, boosted accounts are sometimes banned or reset if detected. In South Korea, it was declared a criminal offense in 2018, leading various companies to tighten their policies on it. The act of boosting negatively impacts game balance by allowing unskilled players to lower the quality of high-ranking play, making the game less viable and enjoyable. However, the extent of the crackdown on boosting has been debated, with some calling it not severe enough to merit criminal penalties.

<i>Chess Ultra</i> 2017 video game

Chess Ultra is a chess video game developed and published by Ripstone for the PlayStation 4, Windows, and Xbox One in June 2017. A Switch port was released a few months later. It is the second chess game by Ripstone after Pure Chess (2012). Chess Ultra is the first in-house developed game by Ripstone.

References

Citations

  1. ↑ Elo 1986, p. x.
  2. ↑ Herbrich, Minka & Graepel 2007, p. 7.
  3. ↑ Perry, Douglass (October 28, 2005). "Live in the Next Generation: The TrueSkill System". IGN . Retrieved June 1, 2023.
  4. ↑ Makedonski, Brett (October 31, 2014). "Master Chief Collection's multiplayer ranking system is just like Halo 2's". Destructoid . Retrieved June 1, 2023.
  5. ↑ Chan, Norman (June 24, 2008). "Carmack frees Quake". GamesRadar+ . Retrieved June 1, 2023.
  6. ↑ Biessener, Adam (October 13, 2010). "Valve's New Game Announced, Detailed: Dota 2". Game Informer . Retrieved June 1, 2023.
  7. ↑ Grant, Christopher (September 3, 2010). "Call of Duty: Black Ops multiplayer takes aim at cheaters, looks to recruit more players". Engadget . Retrieved June 1, 2023.
  8. ↑ Zook 2019, p. 36.
  9. ↑ Petitte, Omri (October 26, 2012). "Call of Duty: Black Ops 2 uses ping and latency "exclusively" for multiplayer matchmaking". PC Gamer . Retrieved June 1, 2023.
  10. ↑ Valenta, Nate (August 8, 2014). "Matchmaking Design in Heroes of the Storm". Blizzard Entertainment . Retrieved June 1, 2023.
  11. ↑ Glickman 2001, p. 673-689.
  12. ↑ Dangauthier et al. 2008, p. 931-938.
  13. ↑ Menke, Reese & Martinez 2006, p. 1.
  14. ↑ Chen et al. 2016, p. 1.
  15. ↑ Chen & Joachims 2016, p. 1.
  16. ↑ Davison, Ethan (May 27, 2022). "Video game developers want fair online games. Some players really don't". The Washington Post . Retrieved June 1, 2023.
  17. ↑ Winslow, Levi (October 27, 2022). "Call Of Duty: Modern Warfare 2 Fans Can't Believe They Have To Play In Fair Matches". Kotaku . Retrieved June 1, 2023.
  18. ↑ Kelly, Paul (February 15, 2023). "Destiny 2 PvP exploit sees skill-based matchmaking completely negated". PCGamesN . Retrieved June 1, 2023.

Works cited

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.