Computer poker player

Last updated

A computer poker player is a computer program designed to play the game of poker (generally the Texas hold 'em version), against human opponents or other computer opponents. It is commonly referred to as pokerbot or just simply bot. As of 2019, computers can beat any human player in poker. [1] [2] [3]

Contents

On the Internet

These bots or computer programs are used often in online poker situations as either legitimate opponents for humans players or a form of cheating. As of 2020, all use of Real-Time Assistance (RTA) or automated bots is considered cheating by all online poker sites, although the level of enforcement from site operators varies considerably. [ citation needed ]

Player bots

Use of player bots or computer assistance while playing online poker is prohibited by most, if not all, online sites. Actions taken for breaches are a permanent ban and confiscation of winnings. [ citation needed ] One kind of bot can interface with the poker client (in other words, play by itself as an auto player) without the help of its human operator. Real-Time Assistance (RTA) is another method of using computer programs. RTA is when a human player uses program called a “solver” such as PioSOLVER or PokerSnowie, [4] running on a different computer, [5] to make their decisions.

The issue of unfair advantage is twofold. For one, bots can play for many hours at a time without human weaknesses such as fatigue and can endure the natural variances of the game without being influenced by human emotion (or "tilt"). Secondly, since 2019, the computer program Pluribus (poker bot) is successful enough at reading bluffs, calculating odds, and adjusting to strategy that it consistently beats professional poker players at 6-player no-limit Hold’em. [6] [7] [8]

House enforcement

While the terms and conditions of poker sites generally forbid the use of bots, the level of enforcement depends on the site operator. Some will seek out and ban bot users through the utilization of a variety of software tools. The poker client can be programmed to try to detect bots although this is controversial in its own right as it might be seen as tantamount to embedding spyware in the client software.[ citation needed ] Another method is to use CAPTCHAs at random intervals during play to catch automated bots, although isn’t effective against Real-Time Assistance.

House bots

“House bots” can pose a conflict of interest. By the strictest definition, a house bot is an automated player operated by the online poker room itself. These type of bots would be the equivalent of brick and mortar shills.

Both brick and mortar casino shills and online house bots are not supposed to have access to any information that is not also available to any other player in the hand. The problem is that in an online setting the house has no way to prove their bots are not receiving sensitive information from the card server. This is further exacerbated by the ease with which clandestine information sharing can be accomplished in a digital environment. It is essentially impossible even for the house to prove that they do not control some players.

Artificial Intelligence

Like in the games of chess, Go (game), and many other games, artificial intelligence systems beat even the best humans at poker. [9] [10] Poker is a game of imperfect information (because some cards in play are concealed) thus making it harder for anyone (including a computer) to deduce the final outcome of the hand. Because of this lack of information, the computer's programmers used to have to implement systems based on the Bayes theorem, Nash equilibrium, Monte Carlo simulation or neural networks, all of which are imperfect techniques. Pluribus, however, perfected poker by only looking ahead a few moves to determine what action to take, rather than attempting to evaluate all moves until the end of the game.

Older AIs like PokerSnowie and Claudico were created by allowing the computer to determine the best possible strategy by letting it play itself an enormous number of times. For years, this was the approach to poker AI, as opposed to attempting to make a computer that plays like a human. This resulted in odd bet sizing and a much different strategy than humans are used to seeing.

Methods were first developed to approximate perfect poker strategy from the game theory perspective in the heads-up (two player) game, and then for the multi-player game. Perfect strategy has multiple meanings in this context. From a game-theoretic optimal point of view, a perfect strategy is one that cannot expect to lose to any other player's strategy; however, optimal strategy can vary in the presence of sub-optimal players who have weaknesses that can be exploited. In this case, a perfect strategy is one that correctly or closely models those weaknesses and takes advantage of them to make a profit, such as those explained above.

AI broke through to superhuman performance in poker during the 2010s, with the following timeline. In 2015, computers solved heads-up limit hold'em via Cepheus. Around 2018, Libratus demonstrated superhuman ability in heads-up no-limit hold'em. In 2019, Pluribus (a newer version of Libratus) [11] demonstrated superhuman ability at six-player no-limit hold'em, the most commonly played single variety of poker in the world. [12] In 2021, Microsoft released the older poker-playing program, Libratus, commercially, which then beat four professional poker players in a 20-day long poker competition at Rivers Casino. [13]

Research groups

Neo Poker Laboratory

Neo Poker Lab was an established science team focused on the research of poker artificial intelligence. For several years it developed and applied state-of-the-art algorithms and procedures like regret minimization and gradient search equilibrium approximation, decision trees, recursive search methods as well as expert algorithms to solve a variety of problems related to the game of poker. Neo Poker Lab’s website, https://www.neopokerlab.com is no longer running.

The University of Auckland Game AI Group

Until 2017, a team from the University of Auckland consisted of a small number of scientists who employ case-based reasoning to create and enhance Texas Hold’em poker agents. The group applied different AI techniques to a number of games including participation in the commercial projects Small Worlds and Civilization (video game).

Computer Poker Research Group (University of Alberta, Canada)

Until 2019, a large amount of the research into computer poker players was being performed at the University of Alberta by the Computer Poker Research Group, led by Dr. Michael Bowling. The group developed the agents Poki, PsOpti, Hyperborean and Polaris. Poki has been licensed for the entertainment game STACKED featuring Canadian poker player Daniel Negreanu. PsOpti was available under the name "SparBot" in the poker training program "Poker Academy". The series of Hyperborean programs have competed in the Annual Computer Poker Competition, most recently taking three gold medals out of six events in the 2012 competition. The same line of research also produced Polaris, which played against human professionals in 2007 and 2008, and became the first computer poker program to win a meaningful poker competition.

In January 2015, an article in Science [14] by Michael Bowling, Neil Burch, Michael Johanson, and Oskari Tammelin claimed that their poker bot Cepheus had "essentially weakly solved" the game of heads-up limit Texas hold 'em. [15] [16] [17]

School of Computer Science from Carnegie Mellon University

T. Sandholm and A. Gilpin from Carnegie Mellon University started poker AI research in 2004 beginning with unbeatable agent for 3-card game called Rhode-Island Hold 'em. Next step was GS1 which outperformed the best commercially available poker bots. In 2006, poker agents from this group started participating in annual computer competitions. "At some point we will have a program better than the best human players" – claimed Sandholm, whose bot, Claudico, faced off against four human opponents in 2015.

In 2017 the program's software, Libratus, faced off against four professional poker players. By the end of the experiment the four human players had lost a combined $1.8 million of simulated money to Libratus. [18]

In 2019, Libratus was replaced by the final version called Pluribus (poker bot).

Historic contests

ICCM 2004 PokerBot competition

One of the earliest no-limit poker bot competitions was organized in 2004 by International Conference on Cognitive Modelling. [19] The tournament hosted five bots from various universities from around the world. The winner was Ace Gruber, from University of Toronto. [20]

ACM competitions

The Association for Computing Machinery (ACM) used to host competitions where the competitors submit a piece of software capable of playing poker on their specific platform. The event hosts conducted the contests by operating the software and reporting the results.[ citation needed ]

The 2005 World Series of Poker Robots

In the summer 2005, the online poker room Golden Palace hosted a promotional tournament in Las Vegas, at the old Binions, with a $100k giveaway prize. It was billed as the 2005 World Series of Poker Robots. The tournament was bots only with no entry fee. The bot developers were computer scientists from six nationalities who traveled at their own expense. The host platform was Poker Academy. The event also featured a demonstration heads-up event with Phil Laak.

University of Alberta's Man V Machine experiments

In the summer 2007, the University of Alberta hosted a highly specialized heads-up tournament between humans and their Polaris bot, at the AAAI conference in Vancouver, BC, Canada. The host platform was written by the University of Alberta. There was a $50k maximum giveaway purse with special rules to motivate the humans to play well. The humans paid no entry fee. The unique tournament featured four duplicate style sessions of 500 hands each. The humans won by a narrow margin.

In the summer of 2008, the University of Alberta and the poker coaching website Stoxpoker ran a second tournament during the World Series of Poker in Las Vegas. The tournament had six duplicate sessions of 500 hands each, and the human players were Heads-Up Limit specialists. Polaris won the tournament with 3 wins, 2 losses and a draw. The results of the tournament, including the hand histories from the matches, are available on the competition website.

The 2015 Brains vs AI competition by Rivers Casino, CMU and Microsoft

From April–May 2015, Carnegie Mellon University Sandholm's bot, Claudico, faced off against four human opponents, in a series of no-limit Texas Hold'em matches. [21] [22] Finally, after playing 80,000 hands, humans were up by a combined total of $732,713. But even though humans technically won, scientists considered the win as statistically insignificant (rather, a statistical tie) when that $732,713 is compared to the total betting amount of $170,000,000 ($170 million). However, some have determined this claim to be disingenuous. [23] Statistically insignificant here means that the programmers of Claudico can not say with 95% confidence (a 95% confidence interval) that humans are better than the computer program. However, it is a statistically significant win on a 90% confidence interval. This means that the human players are somewhere between a 10 to 1 and 20 to 1 favorite. [24]

The way the tournament was structured was in two sets of two players each. In each of the two sets, the players got the opposite cards. Meaning if the computer has As9c (Ace of Spades & Nine of Clubs) and the human has Jh8d on one computer, the other of the two players in the set will have As9c up against the computer's Jh8d. However, even with the human players winning more than the computer—not all of the players were positive in their head-to-head match ups.

The totals for each of the players winnings were as follows:

The Annual Computer Poker Competition

From 2006 to 2018, the Annual Computer Poker Competition ran a series of competitions for poker programs. Since 2010, three types of poker were played: Heads-Up Limit Texas Hold'em, Heads-Up No-Limit Texas Hold'em, and 3-player Limit Texas Hold'em. Within each event, two winners are named: the agent that wins the most matches (Bankroll Instant Run-off), and the agent that wins the most money (Total Bankroll). These winners are often not the same agent, as Bankroll Instant Run-off rewards robust players, and Total Bankroll rewards players that are good at exploiting the other agents' mistakes. The competition was motivated by scientific research, and there was an emphasis on ensuring that all of the results are statistically significant by running millions of hands of poker. The 2012 competition had the same formats with more than 70 million hands played to eliminate luck factor.

Some researchers developed web application where people could play and assess quality of the AI. So as of December 2012 the following top groups and individual researchers’ agents could be found:

Results

2010 [26]
Heads-up Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. PULPO (Marv Andersen, UK)
2. Hyperborean-TBR (University of Alberta, Canada)
3. Sartre (University of Auckland, New Zealand)
1. Rockhopper (David Lin, USA)
2. GGValuta (Mihai Ciucu, Romania)
3. Hyperborean-IRO (University of Alberta, Canada)
Heads Up No Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Tartanian4-TBR (Carnegie Mellon University, USA)
2. PokerBotSLO (Universities of Maribor & Ljubljana, Slovenia)
3. HyperboreanNL-TBR (University of Alberta, Canada)
1. HyperboreanNL-IRO (University of Alberta, Canada)
2. SartreNL (University of Auckland, New Zealand)
3. Tartanian4-IRO (Carnegie Mellon University, USA)
3-max Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Hyperborean3P-TBR (University of Alberta, Canada)
2. LittleRock (Rod Byrnes, Australia)
3. Bender (Technical University Darmstadt, German)
1. Hyperborean3P-IRO (University of Alberta, Canada)
2. dcu3pl-IRO (Dublin City University, Ireland)
3. LittleRock (Rod Byrnes, Australia)
2011 [27]

[28]

Heads-up Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Calamari (Marv Andersen, UK)
2. Sartre (University of Auckland, New Zealand)
3. Hyperborean-2011-2p-limit-tbr (University of Alberta, Canada)
1. Hyperborean-2011-2p-limit-iro (University of Alberta, Canada)
2. Slumbot (Eric Jackson, USA)
3. Calamari (Marv Andersen, UK)
Heads Up No Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Lucky7 (Mikrospin d.o.o., Slovenia)
2. SartreNL (University of Auckland, New Zealand)
3. Hyperborean-2011-2p-nolimit-tbr (University of Alberta, Canada)
1. Hyperborean-2011-2p-nolimit-iro (University of Alberta, Canada)
2. SartreNL (University of Auckland, New Zealand)
3. Hugh (USA & Canada)
3-max Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Sartre3p (University of Auckland, New Zealand)
2. Hyperborean-2011-3p-limit-tbr (University of Alberta, Canada)
3. AAIMontybot (Charles University in Prague, Czech Republic)
3. LittleRock (Rod Byrnes, Australia)
1. Hyperborean-2011-3p-limit-iro (University of Alberta, Canada)
2. Sartre3p (University of Auckland, New Zealand)
3. LittleRock (Rod Byrnes, Australia)
2012
Heads-up Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Slumbot (Eric Jackson, USA)
2. Little Rock (Rod Byrnes, Australia)
2. Zbot (Ilkka Rajala, Finland)
1. Slumbot (Eric Jackson, USA)
2. Hyperborean (University of Alberta, Canada)
3. Zbot (Ilkka Rajala, Finland)
Heads Up No Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Little Rock (Rod Byrnes, Australia)
2. Hyperborean (University of Alberta, Canada)
3. Tartanian5 (Carnegie Mellon University, USA)
1. Hyperborean (University of Alberta, Canada)
2. Tartanian5 (Carnegie Mellon University, USA)
3. Neo Poker Bot (Alexander Lee, Spain)
3-max Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Hyperborean (University of Alberta, Canada)
2. Little Rock (Rod Byrnes, Australia)
3. Neo Poker Bot (Alexander Lee, Spain)
3. Sartre (University of Auckland, New Zealand)
1. Hyperborean (University of Alberta, Canada)
2. Little Rock (Rod Byrnes, Australia)
3. Neo Poker Bot (Alexander Lee, Spain)
3. Sartre (University of Auckland, New Zealand)
2013
Heads-up Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Marv (Marv Anderson, UK)
2. Feste (François Pays, France)
2. Hyperborean (University of Alberta, Canada)
1. Neo Poker Bot (Alexander Lee, Spain)
2. Hyperborean (University of Alberta, Canada)
3. Zbot (Ilkka Rajala, Finland)
3. Marv (Marv Anderson, UK)
Heads Up No Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Slumbot NL (Eric Jackson, USA)
2. Hyperborean (University of Alberta, Canada)
3. Tartanian6 (Carnegie Mellon University, USA)
1. Hyperborean (University of Alberta, Canada)
2. Slumbot NL (Eric Jackson, USA)
3. Tartanian6 (Carnegie Mellon University, USA)
3. Nyx (Charles University, Czech Republic)
3-max Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Hyperborean (University of Alberta, Canada)
2. Little Rock (Rod Byrnes, Australia)
3. Neo Poker Bot (Alexander Lee, Spain)
1. Hyperborean (University of Alberta, Canada)
2. Little Rock (Rod Byrnes, Australia)
3. Neo Poker Bot (Alexander Lee, Spain)
2014
Heads-up Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Escabeche (Marv Andersen, UK)
2. SmooCT (University College London, UK)
3. Hyperborean (University of Alberta, Canada)
3. Feste (Francois Pays, France)


Heads Up No Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Tartanian7 (Carnegie Mellon University, USA)
2. Nyx (Charles University, Czech Republic)
2. Prelude (Unfold Poker, USA)
2. Slumbot (Eric Jackson, USA)
1. Tartanian7 (Carnegie Mellon University, USA)
2. Prelude (Unfold Poker, USA)
2. Hyperborean (University of Alberta, Canada)
2. Slumbot (Eric Jackson, USA)
3-max Limit Texas Hold'em
Total BankrollBankroll Instant Run-off
1. Hyperborean (University of Alberta, Canada)
2. SmooCT (University College London, UK)
3. KEmpfer (Technische Universität Darmstadt, Germany)
1. Hyperborean (University of Alberta, Canada)
2. SmooCT (University College London, UK)
3. KEmpfer (Technische Universität Darmstadt, Germany)

Pluribus

The final poker contest was not public. When the Pluribus (poker bot) program consistently beat professionals at 6-hand no-limit Hold’em, the result was quietly announced on a Facebook post. [29]

See also

Related Research Articles

<span class="mw-page-title-main">Poker</span> Card game

Poker is a family of comparing card games in which players wager over which hand is best according to that specific game's rules. It is played worldwide, but in some places the rules may vary. While the earliest known form of the game was played with just 20 cards, today it is usually played with a standard deck, although in countries where short packs are common, it may be played with 32, 40 or 48 cards. Thus poker games vary in deck configuration, the number of cards in play, the number dealt face up or face down, and the number shared by all players, but all have rules that involve one or more rounds of betting.

<span class="mw-page-title-main">Texas hold 'em</span> Variation of the card game of poker

Texas hold 'em is one of the most popular variants of the card game of poker. Two cards, known as hole cards, are dealt face down to each player, and then five community cards are dealt face up in three stages. The stages consist of a series of three cards, later an additional single card, and a final card. Each player seeks the best five-card poker hand from any combination of the seven cards: the five community cards and their two hole cards. Players have betting options to check, call, raise, or fold. Rounds of betting take place before the flop is dealt and after each subsequent deal. The player who has the best hand and has not folded by the end of all betting rounds wins all of the money bet for the hand, known as the pot. In certain situations, a "split pot" or "tie" can occur when two players have hands of equivalent value. This is also called "chop the pot". Texas hold 'em is also the H game featured in HORSE and HOSE.

<span class="mw-page-title-main">Jonathan Schaeffer</span> Canadian researcher and professor

Jonathan Herbert Schaeffer is a Canadian researcher and professor at the University of Alberta and the former Canada Research Chair in Artificial Intelligence.

<span class="mw-page-title-main">Tom McEvoy</span> American poker player and author (born 1944)

Thomas K. McEvoy is a professional poker player, author and member of the Poker Hall of Fame, 2013 inductee. He is best known for winning the 1983 World Series of Poker Main Event.

<span class="mw-page-title-main">Phil Laak</span> Irish-born American poker player (born 1972)

Philip Courtney Laak is an Irish–American professional poker player and a poker commentator, now residing in Los Angeles, California. Laak holds a World Poker Tour (WPT) title, a World Series of Poker (WSOP) bracelet, and has appeared on numerous nationally aired television shows.

<span class="mw-page-title-main">Heads-up poker</span> Type of poker game

Heads-up poker is a form of poker that is played between only two players. It might be played during a larger cash game session, where the game is breaking up and only two players remain on the table, or where two players are trying to start a game and playing heads-up while waiting for other opponents. It is also a necessary phase in most sit-and-go (SNG) poker tournaments; the single remaining tournament winner will at some point have to face only a single opponent. Alternatively, heads-up poker may be played on purpose, either in a cash game format, or as a SNG, where two players play a winner-take-all tournament for a fixed, previously agreed upon amount of money. On larger online poker rooms and during certain tournament series, one may stumble upon larger heads-up tournaments, usually in the shoot-out format. Usually, in order to ensure the fairness of the game, all players finishing at the same level of the tournament bracket will be paid out the same amount of money, no matter what their finishing place is.

<span class="mw-page-title-main">Bill Chen</span> American mathematician, poker player, software designer and badminton player

William Chen is an American quantitative analyst, poker player, and software designer.

Polaris is a Texas hold 'em poker playing program developed by the computer poker research group at the University of Alberta, a project that has been under way for 16 years as of 2007. Polaris is a composite program consisting of a number of bots, including Hyperborean08, the winner of the limit equilibrium series in the 2008 Association for the Advancement of Artificial Intelligence (AAAI) Computer Poker Competition. Polaris also contains a number of other fixed strategies, and chooses between these strategies during a match. Polaris requires little computational power at match time, so it is run on an Apple MacBook Pro laptop during competitions. Polaris plays only heads-up Limit Texas hold'em.

Ali Eslami is a business strategist and renowned high-stakes poker primarily focused on limit mix-games.

Duplicate poker is a variant of the card game poker. Duplicate poker is based on the principles of duplicate bridge, but it also incorporates some of the rules of pot limit and no limit Texas hold'em.

<span class="mw-page-title-main">Progress in artificial intelligence</span> How AI-related technologies evolve

Progress in artificial intelligence (AI) refers to the advances, milestones, and breakthroughs that have been achieved in the field of artificial intelligence over time. AI is a multidisciplinary branch of computer science that aims to create machines and systems capable of performing tasks that typically require human intelligence. Artificial intelligence applications have been used in a wide range of fields including medical diagnosis, economic-financial applications, robot control, law, scientific discovery, video games, and toys. However, many AI applications are not perceived as AI: "A lot of cutting edge AI has filtered into general applications, often without being called AI because once something becomes useful enough and common enough it's not labeled AI anymore." "Many thousands of AI applications are deeply embedded in the infrastructure of every industry." In the late 1990s and early 21st century, AI technology became widely used as elements of larger systems, but the field was rarely credited for these successes at the time.

<span class="mw-page-title-main">Doug Polk</span> American poker player (born 1988)

Douglas K. Polk is an American professional poker player. Polk played under the alias WCGRider, specializing in heads-up No Limit hold'em (HUNL).

Cepheus is the first poker playing program that "essentially weakly solved" the game of heads-up limit Texas hold 'em. This was the first imperfect information game played competitively by humans to be essentially solved. It was developed by the Computer Poker Research Group (CPRG) at the University of Alberta and was introduced in January 2015 in a paper entitled "Heads-up limit hold’em poker is solved", published in Science by Michael Bowling, Neil Burch, Michael Johanson, and Oskari Tammelin.

Claudico is an artificial-intelligence computer-program designed to play no-limit Texas hold 'em heads-up.

Libratus is an artificial intelligence computer program designed to play poker, specifically heads up no-limit Texas hold 'em. Libratus' creators intend for it to be generalisable to other, non-poker-specific applications. It was developed at Carnegie Mellon University, Pittsburgh.

AlphaStar is a computer program by DeepMind that plays the video game StarCraft II. It was unveiled to the public by name in January 2019. In a significant milestone for artificial intelligence, AlphaStar attained Grandmaster status in August 2019.

Pluribus is a computer poker player using artificial intelligence built by Facebook's AI Lab and Carnegie Mellon University. Pluribus plays the poker variation no-limit Texas hold 'em and is "the first bot to beat humans in a complex multiplayer competition". The developers of the bot published their results in 2019.

DeepStack is an artificial intelligence computer program designed to play two-player poker, specifically heads up no-limit Texas hold 'em. It is the first computer program to outplay human professionals in this game.

Tuomas Sandholm is the Angel Jordan University Professor of Computer Science at Carnegie Mellon University and a serial entrepreneur with a research focus on the intersection of artificial intelligence, economics, and operations research.

References

  1. Nature. “DeepMind AI topples experts at complex game Stratego”. Anil Ananthaswamy. NEWS 01 December 2022, Clarification 05 December 2022.
  2. Heaven, Douglas (2019-07-11). "No limit: AI poker bot is first to beat professionals at multiplayer game". Nature. 571 (7765): 307–308. Bibcode:2019Natur.571..307H. doi: 10.1038/d41586-019-02156-9 . PMID   31312056.
  3. Smith, Dana G. "AI Learns What an Infant Knows about the Physical World". Scientific American. Retrieved 2023-05-17.
  4. Seven Games: A Human History. Chapter 5. Oliver Roeder, 2022. Publisher: W.W. Norton and Co.
  5. https://docs.house.gov/meetings/IF/IF17/20131210/101570/HHRG-113-IF17-Wstate-EggertK-20131210.pdf Testimony of Kurt Eggert Professor of Law Chapman University Dale E. Fowler School of Law Before the House Energy and Commerce Committee Subcommittee on Commerce, Manufacturing, and Trade At a Hearing Entitled: “The State of Online Gaming” Rayburn House Office Building, Washington, DC December 10, 2013
  6. Brown, Noam; Sandholm, Tuomas (30 August 2019). "Superhuman AI for multiplayer poker". Science. 365 (6456): 885–890. Bibcode:2019Sci...365..885B. doi: 10.1126/science.aay2400 . PMID   31296650. S2CID   195892791.
  7. "Carnegie Mellon and Facebook AI Beats Professionals in Six-Player Poker - News - Carnegie Mellon University". www.cmu.edu. Retrieved 2023-05-17.
  8. Marr, Bernard. "Artificial Intelligence Masters The Game of Poker – What Does That Mean For Humans?". Forbes. Retrieved 2023-05-17.
  9. Intagliata, Christopher. "This Artificial Intelligence Learns like a Baby". Scientific American. Retrieved 2023-05-17.
  10. Meta Fundamental AI Research Diplomacy Team (FAIR)†; Bakhtin, Anton; Brown, Noam; Dinan, Emily; Farina, Gabriele; Flaherty, Colin; Fried, Daniel; Goff, Andrew; Gray, Jonathan; Hu, Hengyuan; Jacob, Athul Paul; Komeili, Mojtaba; Konath, Karthik; Kwon, Minae; Lerer, Adam (2022-12-09). "Human-level play in the game of Diplomacy by combining language models with strategic reasoning". Science. 378 (6624): 1067–1074. Bibcode:2022Sci...378.1067M. doi:10.1126/science.ade9097. ISSN   0036-8075. PMID   36413172. S2CID   253759631.
  11. Magazine, Smithsonian; Solly, Meilan. "This Poker-Playing A.I. Knows When to Hold 'Em and When to Fold 'Em". Smithsonian Magazine. Retrieved 2023-05-17.
  12. "Bet On The Bot: AI Beats The Professionals At 6-Player Texas Hold 'Em". NPR . Retrieved 2023-05-17.
  13. “AI’s Disruption Of The Strategy Gaming Space Proves That Machines Are Getting Smarter.” Forbes. Annie Brown. Nov 10, 2021,04:42pm EST.
  14. Bowling, Michael; Burch, Neil; Johanson, Michael; Tammelin, Oskari (Jan 2015). "Heads-up limit hold'em poker is solved". Science. 347 (6218): 145–9. Bibcode:2015Sci...347..145B. CiteSeerX   10.1.1.697.72 . doi:10.1126/science.1259433. PMID   25574016. S2CID   3796371.
  15. Philip Ball (2015-01-08). "Game Theorists Crack Poker". Nature. doi: 10.1038/nature.2015.16683 . S2CID   155710390 . Retrieved 2015-01-13 via Nature.
  16. Robert Lee Hotz (2015-01-08). "Computer Conquers Texas Hold 'Em, Researchers Say". Wall Street Journal.
  17. Bob McDonald (2015-01-10). "Poker Computer Takes the Pot [audio interview]". Quirks & Quarks (Podcast).
  18. Joshua Brustein (31 January 2017). "Daftar Situs Poker Online Pkv Games". Bloomberg.com. Bloomberg. Retrieved 2 February 2017.
  19. "Iccm 2004".
  20. https://www.era.lib.ed.ac.uk/bitstream/1842/2392/2/Carter%20RG%20thesis%2007.pdf [ bare URL PDF ]
  21. Marilyn Malara (April 25, 2015). "Brains vs. AI: Computer faces poker pros in no-limit Texas Hold'em". UPI. Retrieved April 26, 2015.
  22. "Rivers Casino's Brains vs AI". Archived from the original on 2016-02-03. Retrieved 2015-10-23.
  23. "Brains Vs. AI | Carnegie Mellon School of Computer Science". www.cs.cmu.edu. Retrieved 2016-02-10.
  24. "Brains Vs. AI | Carnegie Mellon School of Computer Science". www.cs.cmu.edu. Retrieved 2016-02-10.
  25. "Brains vs Artificial Intelligence". www.riverscasino.com. Archived from the original on 2016-02-03. Retrieved 2016-02-10.
  26. "CPRG".
  27. "CPRG".
  28. "Poker Bots Evolution – from History to the Future". 8 July 2020.
  29. Solly, Meilan. "This Poker-Playing A.I. Knows When to Hold 'Em and When to Fold 'Em". Smithsonian.