Claudico

Last updated

Claudico is an artificial-intelligence computer-program designed[ when? ] to play no-limit Texas hold 'em heads-up.

Contents

History

Claudico was designed by Carnegie Mellon professor Tuomas Sandholm and his graduate students. The name means "I limp" in Latin, a reference to limping into a hand without raising—a strategy the bot employs often. [1] Rather than have a professional poker player attempt to explain his strategy to the programming team, Sandholm had the computer attempt to devise the best strategy on its own. The task was so complicated that it required a Pittsburgh Supercomputing Center Blacklight supercomputer with 16 terabytes of RAM to complete. [2]

In explaining his motivation for designing the bot, Sandholm said, "Poker is now a benchmark for artificial intelligence research, just as chess once was. It's a game of exceeding complexity that requires a machine to make decisions based on incomplete and often misleading information, thanks to bluffing, slow play and other decoys". [3]

Originally called Tartanian, a version of the program won a July 2014 tournament against other computer programs. [3]

The improved successor of Claudico is called Libratus. Like Claudico, Libratus is designed to compete against top human players.

2015 match against four human players

From April 24 to May 8, 2015, Claudico participated in an event at Rivers Casino in Pittsburgh, Pennsylvania. The bot faced each of four top human opponents—Dong Kim, Jason Les, Bjorn Li, and Doug Polk—in a series of heads-up matches. [3] At the time, Polk was the world's number-one ranked heads-up player. [1]

Each day featured two 750-hand matches over eight hours (plus breaks) against each of the humans, for a total of 20,000 hands per player over the course of 13 days (with one rest day in the middle). [1] [2] For each 750-hand set, the same hands were dealt to one human taking on Claudico on the main casino floor and another battling the computer in an isolation room, with the hole cards reversed. [4] This was done to ensure that card luck was not a factor in the outcome. The 80,000-hand sample represented the largest-ever human–computer data set. Claudico was able to adjust to its opponent's strategy as the matches progressed, just as the humans could. [2] The match winner was determined by the overall chip count after 80,000 hands; although individual results were kept for the four pros, they were competing as a single team. If the final chip count had been too close for the difference to be statistically meaningful, the match would be declared a draw. [4]

The tournament carried a $100,000 prize pool, funded by Rivers Casino and Microsoft. The casino set up stands and video screens for the public to watch the action live. [1] Additionally, the matches were broadcast online via Twitch. [3] Highlights from the match will air throughout 2015 on CBS Sports Network's weekly show Poker Night in America . [5]

Entering the event, Sandholm estimated that Claudico had a 50/50 chance to win. [3] Polk, however, was confident the humans had the edge. [2] He acknowledged that computers would likely surpass human play eventually, but said, "I hope we can make them go a few more rounds after this before they do, like Kasparov did". [1] He said his strategy would "change more so than when playing against human players ... I think there will be less hand reading so to speak, and [fewer] mind games". [3]

The blinds were 50 and 100 chips for every hand, and both the human's and computer's chip stack were reset to 20,000 at the beginning of each hand. Halfway through the match, the human team was ahead 458,000 chips versus Claudico. [6] The humans went on to increase their lead, winning the match by 732,713 chips. Polk finished up 213,000, Li won 529,000, Kim beat Claudico by 70,000, and Les finished down 80,000. A total of 170 million chips were bet over the 80,000 hands. Polk said Claudico had played well in spots, but also made some bad plays. Overall, it played very differently than humans. "Where a human might place a bet worth half or three-quarters of the pot, Claudico would sometimes bet a miserly 10 percent or an over-the-top 1,000 percent", he explained. "Betting $19,000 to win a $700 pot just isn't something that a person would do". [5]

See also

Related Research Articles

<span class="mw-page-title-main">Poker</span> Card game

Poker is a family of comparing card games in which players wager over which hand is best according to that specific game's rules. It is played worldwide, but in some places the rules may vary. While the earliest known form of the game was played with just 20 cards, today it is usually played with a standard deck, although in countries where short packs are common, it may be played with 32, 40 or 48 cards. Thus poker games vary in deck configuration, the number of cards in play, the number dealt face up or face down, and the number shared by all players, but all have rules that involve one or more rounds of betting.

<span class="mw-page-title-main">Betting in poker</span> Procedures of betting in poker

In the game of poker, the play largely centers on the act of betting, and as such, a protocol has been developed to speed up play, lessen confusion, and increase security while playing. Different games are played using different types of bets, and small variations in etiquette exist between cardrooms, but for the most part the following rules and protocol are observed by the majority of poker players.

<span class="mw-page-title-main">Texas hold 'em</span> Variation of the card game of poker

Texas hold 'em is one of the most popular variants of the card game of poker. Two cards, known as hole cards, are dealt face down to each player, and then five community cards are dealt face up in three stages. The stages consist of a series of three cards, later an additional single card, and a final card. Each player seeks the best five-card poker hand from any combination of the seven cards: the five community cards and their two hole cards. Players have betting options to check, call, raise, or fold. Rounds of betting take place before the flop is dealt and after each subsequent deal. The player who has the best hand and has not folded by the end of all betting rounds wins all of the money bet for the hand, known as the pot. In certain situations, a "split pot" or "tie" can occur when two players have hands of equivalent value. This is also called "chop the pot". Texas hold 'em is also the H game featured in HORSE and HOSE.

<span class="mw-page-title-main">Cheating in poker</span> Overview of poker cheating

Cheating in poker is any behavior outside the rules of poker that is intended to give an unfair advantage to one or more players.

<span class="mw-page-title-main">Tell (poker)</span> Change in a poker players behaviour or demeanour when assessing their hand

A tell in poker is a change in a player's behavior or demeanor that is claimed by some to give clues to that player's assessment of their hand. A player gains an advantage if they observe and understand the meaning of another player's tell, particularly if the tell is unconscious and reliable. Sometimes a player may fake a tell, hoping to induce their opponents to make poor judgments in response to the false tell. More often, people try to avoid giving out a tell, by maintaining a poker face regardless of how strong or weak their hand is.

<span class="mw-page-title-main">Jonathan Schaeffer</span> Canadian researcher and professor

Jonathan Herbert Schaeffer is a Canadian researcher and professor at the University of Alberta and the former Canada Research Chair in Artificial Intelligence.

A computer poker player is a computer program designed to play the game of poker, against human opponents or other computer opponents. It is commonly referred to as pokerbot or just simply bot. As of 2019, computers can beat any human player in poker.

<span class="mw-page-title-main">Daniel Negreanu</span> Canadian poker player (born 1974)

Daniel Negreanu is a Canadian professional poker player who has won six World Series of Poker (WSOP) bracelets and two World Poker Tour (WPT) championship titles. In 2014, independent poker ranking service Global Poker Index recognized Negreanu as the best poker player of the previous decade.

John Ferguson, known by his pen name, Stanford Wong, is a gambling author best known for his book Professional Blackjack, first published in 1975. Wong's computer program "Blackjack Analyzer", initially created for personal use, was one of the first pieces of commercially available blackjack odds analyzing software. Wong has appeared on TV multiple times as a blackjack tournament contestant or as a gambling expert. He owns a publishing house, Pi Yee Press, which has published books by other gambling authors including King Yao.

Polaris is a Texas hold 'em poker playing program developed by the computer poker research group at the University of Alberta, a project that has been under way for 16 years as of 2007. Polaris is a composite program consisting of a number of bots, including Hyperborean08, the winner of the limit equilibrium series in the 2008 Association for the Advancement of Artificial Intelligence (AAAI) Computer Poker Competition. Polaris also contains a number of other fixed strategies, and chooses between these strategies during a match. Polaris requires little computational power at match time, so it is run on an Apple MacBook Pro laptop during competitions. Polaris plays only heads-up Limit Texas hold'em.

Duplicate poker is a variant of the card game poker. Duplicate poker is based on the principles of duplicate bridge, but it also incorporates some of the rules of pot limit and no limit Texas hold'em.

<span class="mw-page-title-main">Progress in artificial intelligence</span> How AI-related technologies evolve

Progress in artificial intelligence (AI) refers to the advances, milestones, and breakthroughs that have been achieved in the field of artificial intelligence over time. AI is a multidisciplinary branch of computer science that aims to create machines and systems capable of performing tasks that typically require human intelligence. Artificial intelligence applications have been used in a wide range of fields including medical diagnosis, economic-financial applications, robot control, law, scientific discovery, video games, and toys. However, many AI applications are not perceived as AI: "A lot of cutting edge AI has filtered into general applications, often without being called AI because once something becomes useful enough and common enough it's not labeled AI anymore." "Many thousands of AI applications are deeply embedded in the infrastructure of every industry." In the late 1990s and early 21st century, AI technology became widely used as elements of larger systems, but the field was rarely credited for these successes at the time.

The following is a glossary of poker terms used in the card game of poker. It supplements the glossary of card game terms. Besides the terms listed here, there are thousands of common and uncommon poker slang terms. This is not intended to be a formal dictionary; precise usage details and multiple closely related senses are omitted here in favor of concise treatment of the basics.

<span class="mw-page-title-main">Doug Polk</span> American poker player (born 1988)

Douglas K. Polk is an American professional poker player. Polk played under the alias WCGRider, specializing in heads-up No Limit hold'em (HUNL).

Cepheus is the first poker playing program that "essentially weakly solved" the game of heads-up limit Texas hold 'em. This was the first imperfect information game played competitively by humans to be essentially solved. It was developed by the Computer Poker Research Group (CPRG) at the University of Alberta and was introduced in January 2015 in a paper entitled "Heads-up limit hold’em poker is solved", published in Science by Michael Bowling, Neil Burch, Michael Johanson, and Oskari Tammelin.

Libratus is an artificial intelligence computer program designed to play poker, specifically heads up no-limit Texas hold 'em. Libratus' creators intend for it to be generalisable to other, non-poker-specific applications. It was developed at Carnegie Mellon University, Pittsburgh.

AlphaStar is a computer program by DeepMind that plays the video game StarCraft II. It was unveiled to the public by name in January 2019. In a significant milestone for artificial intelligence, AlphaStar attained Grandmaster status in August 2019.

Pluribus is a computer poker player using artificial intelligence built by Facebook's AI Lab and Carnegie Mellon University. Pluribus plays the poker variation no-limit Texas hold 'em and is "the first bot to beat humans in a complex multiplayer competition".

DeepStack is an artificial intelligence computer program designed to play two-player poker, specifically heads up no-limit Texas hold 'em. It is the first computer program to outplay human professionals in this game.

Tuomas Sandholm is the Angel Jordan University Professor of Computer Science at Carnegie Mellon University and a serial entrepreneur with a research focus on the intersection of artificial intelligence, economics, and operations research.

References

  1. 1 2 3 4 5 Sean D. Hamill (April 24, 2015). "Who's got the upper hand? Poker computer program pits man against machine". Pittsburgh Post-Gazette. Retrieved April 26, 2015.
  2. 1 2 3 4 Tim Fiorvanti (April 24, 2015). "Brains vs. AI: Poker's Top Heads-Up Pros Take on Computer Program in Two Week Challenge". Bluff. Archived from the original on May 6, 2015. Retrieved April 26, 2015.
  3. 1 2 3 4 5 6 Marilyn Malara (April 25, 2015). "Brains vs. AI: Computer faces poker pros in no-limit Texas Hold'em". UPI. Retrieved April 26, 2015.
  4. 1 2 "Brains Vs. Artificial Intelligence". Rivers Casino. Archived from the original on February 3, 2016. Retrieved April 26, 2015.
  5. 1 2 Jason Glatzer (May 11, 2015). "Man Proves Greater Than Machine: Players Win $732,713 Against Bot "Claudico"". Poker News.
  6. ↑ Jason Glatzer (May 4, 2015). "Man vs. Machine: Pros Ahead of "Claudico" Over $450,000 After Seven Days". Poker News.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.