Master is a version of DeepMind's Go software AlphaGo, named after the account name (originally Magister/Magist) used online, which won 60 straight online games against human professional Go players from 29 December 2016 to 4 January 2017. This version was also used in the Future of Go Summit in May 2017. [1] [2] It used four TPUs on a single machine with Elo rating 4,858. [3] DeepMind claimed that AlphaGo Master was 3-stone stronger than the version used in AlphaGo v. Lee Sedol. [4]
DeepMind released a version of AlphaGo Master in December 2017 that serves as a teaching tool analyzing the win rates of 6,000 Go openings from 230,000 human games. [5] [6]
The software was first used to play games against professional players on 29 December 2016 on the Tygem Go server, under the account name 'Magister' (shown as 'Magist' at the server's Chinese version). The account name was changed to 'Master' on 30 December. After playing 30 games on Tygem, it was moved to the FoxGo server on 1 January 2017.
Master played at the pace of 10 games per day. Many quickly suspected it to be an AI player due to little or no resting between games. After winning its 59th game it was revealed in the chatroom that Master was controlled by Aja Huang of the DeepMind team. [7] On 4 January 2017, after these games were completed, Demis Hassabis, the co-founder of DeepMind, confirmed that Magister and Master both played using an updated version of AlphaGo [8] [9] and said, "We're looking forward to playing some official, full-length games later [in 2017] in collaboration with Go organizations and experts". [8] [9]
Gu Li, a 9-dan player and co-founder of FoxGo, offered a bounty of 100,000 RMB (14,400 USD) to the first human player who could defeat Master. [9] However, no one took the bounty since Master's final online record was 60 wins and 0 losses, [10] including three victories over Go's top ranked player, Ke Jie, [11] who had been quietly briefed in advance that Master was a version of AlphaGo. [10]
Master's adversaries included many world champions such as Ke Jie, Park Jeong-hwan, Yuta Iyama, Tuo Jiaxi, Mi Yuting, Shi Yue, Chen Yaoye, Li Qincheng, Gu Li, Chang Hao, Tang Weixing, Fan Tingyu, Zhou Ruiyang, Jiang Weijie, Chou Chun-hsun, Kim Ji-seok, Kang Dong-yun, Park Yeong-hun, and Won Seong-jin, and also included national champions or world championship runners-up such as Lian Xiao, Tan Xiao, Meng Tailing, Dang Yifei, Huang Yunsong, Yang Dingxin, Gu Zihao, Shin Jinseo, Cho Han-seung, and An Sungjoon. [12] All 60 games except one were fast-paced games with three 20 or 30 seconds byo-yomi. Master offered to extend the byo-yomi to one minute when playing with Nie Weiping due to his old age.
No. | Date | Player (dan during the game) | Time control | Moves | Master color and result |
---|---|---|---|---|---|
1 | 29 December 2016 | Pan Tingyu (1 dan) | three 20-second byo-yomi | 146 | White won by resignation |
2 | 29 December 2016 | Zhang Ziliang (1 dan) | three 20-second byo-yomi | 174 | White won by resignation |
3 | 29 December 2016 | Ding Shixiong (3 dan) | three 20-second byo-yomi | 151 | Black won by resignation |
4 | 29 December 2016 | Xie Erhao (4 dan) | three 20-second byo-yomi | 222 | White won by resignation |
5 | 29 December 2016 | Yu Zhiying (5 dan) | three 20-second byo-yomi | 113 | Black won by resignation |
6 | 29 December 2016 | Li Xiangyu (3 dan) | three 20-second byo-yomi | 131 | Black won by resignation |
7 | 29 December 2016 | Qiao Zhijian (4 dan) | three 20-second byo-yomi | 163 | Black won by resignation |
8 | 29 December 2016 | Han Yizhou (5 dan) | three 20-second byo-yomi | 104 | White won by resignation |
9 | 29 December 2016 | Meng Tailing (6 dan) | three 20-second byo-yomi | 275 | Black won by 4.5 points |
10 | 29 December 2016 | Meng Tailing (6 dan) | three 20-second byo-yomi | 148 | White won by resignation |
11 | 30 December 2016 | Chen Hao (5 dan) | three 20-second byo-yomi | 170 | White won by resignation |
12 | 30 December 2016 | Ryu Suhang (5 dan) | three 20-second byo-yomi | 144 | White won by resignation |
13 | 30 December 2016 | Wang Haoyang (6 dan) | three 20-second byo-yomi | 136 | White won by resignation |
14 | 30 December 2016 | Yan Zaiming (3 dan) | three 20-second byo-yomi | 129 | Black won by resignation |
15 | 30 December 2016 | Park Junghwan (9 dan) | three 20-second byo-yomi | 150 | White won by time |
16 | 30 December 2016 | Lian Xiao (7 dan) | three 20-second byo-yomi | 122 | White won by resignation |
17 | 30 December 2016 | Lian Xiao (7 dan) | three 20-second byo-yomi | 164 | White won by resignation |
18 | 30 December 2016 | Ke Jie (9 dan) | three 20-second byo-yomi | 228 | Black won by 5.5 points |
19 | 30 December 2016 | Ke Jie (9 dan) | three 20-second byo-yomi | 128 | White won by resignation |
20 | 30 December 2016 | Park Junghwan (9 dan) | three 20-second byo-yomi | 255 | Black won by 5.5 points |
21 | 31 December 2016 | Chen Yaoye (9 dan) | three 20-second byo-yomi | 270 | White won by 5.5 points |
22 | 31 December 2016 | Chen Yaoye (9 dan) | three 20-second byo-yomi | 277 | White won by 4.5 points |
23 | 31 December 2016 | Kim Jung-hyun (6 dan) | three 20-second byo-yomi | 135 | Black won by resignation |
24 | 31 December 2016 | Park Junghwan (9 dan) | three 20-second byo-yomi | 223 | Black won by resignation |
25 | 31 December 2016 | Park Junghwan (9 dan) | three 20-second byo-yomi | 261 | White won by 0.5 points |
26 | 31 December 2016 | Yun Chanhee (6 dan) | three 20-second byo-yomi | 217 | Black won by resignation |
27 | 31 December 2016 | Fan Tingyu (9 dan) | three 30-second byo-yomi | 215 | Black won by resignation |
28 | 31 December 2016 | Meng Tailing (6 dan) | three 20-second byo-yomi | 163 | Black won by resignation |
29 | 31 December 2016 | Mi Yuting (9 dan) | three 30-second byo-yomi | 311 | White won by 0.5 points |
30 | 31 December 2016 | Tang Weixing (9 dan) | three 30-second byo-yomi | 186 | White won by resignation |
31 | 1 January 2017 | Li Qincheng (9 dan) | 1 minute + three 20-second byo-yomi | 179 | Black won by resignation |
32 | 2 January 2017 | Gu Li (9 dan) | 1 minute + three 30-second byo-yomi | 154 | White won by resignation |
33 | 2 January 2017 | Gu Li (9 dan) | 1 minute + three 30-second byo-yomi | 191 | Black won by resignation |
34 | 2 January 2017 | Dang Yifei (9 dan) | 1 minute + three 30-second byo-yomi | 149 | Black won by resignation |
35 | 2 January 2017 | Jiang Weijie (9 dan) | 1 minute + three 30-second byo-yomi | 280 | White won by 1.5 points |
36 | 2 January 2017 | Gu Zihao (5 dan) | 1 minute + three 30-second byo-yomi | 209 | Black won by resignation |
37 | 2 January 2017 | Park Yeong-hun (9 dan) | 1 minute + three 30-second byo-yomi | 173 | Black won by resignation |
38 | 2 January 2017 | Tuo Jiaxi (9 dan) | 1 minute + three 30-second byo-yomi | 239 | Black won by resignation |
39 | 2 January 2017 | Yuta Iyama (9 dan) | 1 minute + three 30-second byo-yomi | 135 | Black won by resignation |
40 | 2 January 2017 | Meng Tailing (6 dan) | 1 minute + three 30-second byo-yomi | 274 | White won by 2.5 points |
41 | 2 January 2017 | Kim Ji-seok (9 dan) | 1 minute + three 30-second byo-yomi | 170 | White won by resignation |
42 | 3 January 2017 | Yang Dingxin (4 dan) | 1 minute + three 30-second byo-yomi | 125 | Black won by resignation |
43 | 3 January 2017 | Kang Dong-yun (9 dan) | 1 minute + three 30-second byo-yomi | 165 | Black won by resignation |
44 | 3 January 2017 | An Sung-joon (7 dan) | 1 minute + three 30-second byo-yomi | 260 | White won by 2.5 points |
45 | 3 January 2017 | Shi Yue (9 dan) | 1 minute + three 30-second byo-yomi | 167 | Black won by resignation |
46 | 3 January 2017 | Lian Xiao (7 dan) | 1 minute + three 30-second byo-yomi | 144 | White won by resignation |
47 | 3 January 2017 | Tan Xiao (7 dan) | 1 minute + three 30-second byo-yomi | 191 | Black won by resignation |
48 | 3 January 2017 | Park Junghwan (9 dan) | 1 minute + three 30-second byo-yomi | 270 | White won by 1.5 points |
49 | 3 January 2017 | Won Seong-jin (9 dan) | 1 minute + three 30-second byo-yomi | 222 | White won by resignation |
50 | 3 January 2017 | Ke Jie (9 dan) | 1 minute + three 30-second byo-yomi | 178 | White won by resignation |
51 | 4 January 2017 | Chou Chun-hsun (9 dan) | 1 minute + three 30-second byo-yomi | 118 | White won by resignation |
52 | 4 January 2017 | Fan Tingyu (9 dan) | 1 minute + three 30-second byo-yomi | 202 | White won by resignation |
53 | 4 January 2017 | Huang Yunsong (5 dan) | 1 minute + three 30-second byo-yomi | 133 | Black won by resignation |
54 | 4 January 2017 | Nie Weiping (9 dan) | 1 minute + three 60-second byo-yomi | 254 | Black won by 7.5 points |
55 | 4 January 2017 | Chen Yaoye (9 dan) | 1 minute + three 30-second byo-yomi | 267 | White won by 1.5 points |
56 | 4 January 2017 | Cho Han-seung (9 dan) | 1 minute + three 30-second byo-yomi | 171 | Black won by resignation |
57 | 4 January 2017 | Shin Jin-seo (6 dan) | 1 minute + three 30-second byo-yomi | 139 | Black won by resignation |
58 | 4 January 2017 | Chang Hao (9 dan) | 1 minute + three 30-second byo-yomi | 178 | White won by resignation |
59 | 4 January 2017 | Zhou Ruiyang (9 dan) | 1 minute + three 30-second byo-yomi | 161 | Black won by resignation |
60 | 4 January 2017 | Gu Li (9 dan) | 1 minute + three 30-second byo-yomi | 235 | White won by 2.5 points |
The Master version also participated in the Future of Go summit in May 2017. [1] It defeated Ke Jie in a three-game match by three to zero and beat a human team with five top Go professionals.
Go experts were extremely impressed by Master's performance and by its non-human play style in its online games. Ke Jie stated, "After humanity spent thousands of years improving our tactics, computers tell us that humans are completely wrong... I would go as far as to say not a single human has touched the edge of the truth of Go". [10]
Master played many innovative moves and inspired professional players. [13] [14] [15] [16] [17] [18] [19]
In the 23rd online game Master invaded the 3-3 point at a very early stage. [20]
Online game 23, Master (black) v. Kim Jung-hyun |
In the 24th online game Master played six stones along the second line. [20]
Online game 24 Master (black) v. Park Junghwan |
On 20 January 2017, DeepMind team members Fan Hui [21] and Aja Huang [22] disclosed that Master's operator accidentally entered a move other than AlphaGo's choice in two situations during the online games.
In the 9th online game, Master recommended point a for Move 107.
Online game 9, Master (black) v. Meng Tailing. |
In the 39th online game, Master recommended point a for Move 99.
Online game 39, Master (black) v. Yuta Iyama |
Online game 30: Master (white) v. Tang Weixing (31 December 2016), Master won by resignation. White 36 was widely praised. [23]
First 99 moves |
Moves 100-186 (149 at 131, 150 at 130) |
Sir Demis Hassabis is a British artificial intelligence (AI) researcher, and entrepreneur. He is the chief executive officer and co-founder of Google DeepMind, and Isomorphic Labs, and a UK Government AI Adviser. In 2024, Hassabis and John M. Jumper were jointly awarded the Nobel Prize in Chemistry for their AI research contributions for protein structure prediction.
In the game of Go, a ladder,([征子] Error: {{Lang}}: invalid parameter: |3= ) is a basic sequence of moves in which an attacker pursues a group in atari in a zig-zag pattern across the board. If there are no intervening stones, the group will hit the edge of the board and be captured.
The KGS Go Server, known until 2006 as the Kiseido Go Server, is a game server first developed in 1999 and established in 2000 for people to play Go. The system was developed by William M. Shubert and its code is now written entirely in Java. In Spring of 2017, Shubert transferred ownership to the American Go Foundation.
DeepMind Technologies Limited, also known by its trade name Google DeepMind, is a British-American artificial intelligence research laboratory which serves as a subsidiary of Google. Founded in the UK in 2010, it was acquired by Google in 2014 and merged with Google AI's Google Brain division to become Google DeepMind in April 2023. The company is based in London, with research centres in Canada, France, Germany, and the United States.
AlphaGo is a computer program that plays the board game Go. It was developed by the London-based DeepMind Technologies, an acquired subsidiary of Google. Subsequent versions of AlphaGo became increasingly powerful, including a version that competed under the name Master. After retiring from competitive play, AlphaGo Master was succeeded by an even more powerful version known as AlphaGo Zero, which was completely self-taught without learning from human games. AlphaGo Zero was then generalized into a program known as AlphaZero, which played additional games, including chess and shogi. AlphaZero has in turn been succeeded by a program known as MuZero which learns without being taught the rules.
Fan Hui is a Chinese-born French Go player. Becoming a professional Go player in 1996, Fan moved to France in 2000 and became the coach of the French national Go team in 2005. He was the winner of the European Go Championship in 2013, 2014 and 2015. As of 2015, he is ranked as a 2 dan professional. He additionally won the 2016 European Professional Go Championship.
Darkforest is a computer go program developed by Meta Platforms, based on deep learning techniques using a convolutional neural network. Its updated version Darkfores2 combines the techniques of its predecessor with Monte Carlo tree search. The MCTS effectively takes tree search methods commonly seen in computer chess programs and randomizes them. With the update, the system is known as Darkfmcts3.
AlphaGo versus Lee Sedol, also known as the DeepMind Challenge Match, was a five-game Go match between top Go player Lee Sedol and AlphaGo, a computer Go program developed by DeepMind, played in Seoul, South Korea between 9 and 15 March 2016. AlphaGo won all but the fourth game; all games were won by resignation. The match has been compared with the historic chess match between Deep Blue and Garry Kasparov in 1997.
Ke Jie is a Chinese professional Go player of 9 dan rank. He was born on August 2, 1997, in Liandu District, Lishui City, Zhejiang Province.
Tygem is an internet go server owned by South Korean company TongYang Online. Popular in Asia, their website states that over 500 professional Go players use their service.
David Silver is a principal research scientist at Google DeepMind and a professor at University College London. He has led research on reinforcement learning with AlphaGo, AlphaZero and co-lead on AlphaStar.
Aja Huang is a Taiwanese computer scientist and expert on artificial intelligence. He works for DeepMind and was a member of the AlphaGo project.
The Future of Go Summit was held in May 2017 by the Chinese Go Association, Sport Bureau of Zhejiang Province and Google in Wuzhen, Zhejiang, the permanent host of the World Internet Conference. It featured five Go games involving AlphaGo and top Chinese Go players, as well as a forum on the future of AI. It was Google’s biggest public event in partnership with the Chinese government since Google China's search engine was moved out of mainland China to Hong Kong due to the government censorship in 2010. It was seen as a charm offensive launched by Google toward Chinese officials, being part of effort to reopen China's market.
AlphaGo versus Ke Jie was a three-game Go match between the computer Go program AlphaGo Master and current world No. 1 ranking player Ke Jie, being part of the Future of Go Summit in Wuzhen, China, played on 23, 25, and 27 May 2017. AlphaGo defeated Ke Jie in all three games.
AlphaGo Zero is a version of DeepMind's Go software AlphaGo. AlphaGo's team published an article in Nature in October 2017 introducing AlphaGo Zero, a version created without using data from human games, and stronger than any previous version. By playing games against itself, AlphaGo Zero: surpassed the strength of AlphaGo Lee in three days by winning 100 games to 0; reached the level of AlphaGo Master in 21 days; and exceeded all previous versions in 40 days.
AlphaGo versus Fan Hui was a five-game Go match between European champion Fan Hui, a 2-dan professional, and AlphaGo, a computer Go program developed by DeepMind, held at DeepMind's headquarters in London in October 2015. AlphaGo won all five games. This was the first time a computer Go program had beaten a professional human player on a full-sized board without handicap. This match was not disclosed to the public until 27 January 2016 to coincide with the publication of a paper in the journal Nature describing the algorithms AlphaGo used.
Leela Zero is a free and open-source computer Go program released on 25 October 2017. It is developed by Belgian programmer Gian-Carlo Pascutto, the author of chess engine Sjeng and Go engine Leela.
AlphaStar is an artificial intelligence (AI) software developed by DeepMind for playing the video game StarCraft II. It was unveiled to the public by name in January 2019. AlphaStar attained "Grandmaster" status in August 2019, a significant milestone not just for AI in video games, but arguably for the field as a whole.
Timothy P. Lillicrap is a Canadian neuroscientist and AI researcher, adjunct professor at University College London, and staff research scientist at Google DeepMind, where he has been involved in the AlphaGo and AlphaZero projects mastering the games of Go, Chess and Shogi. His research focuses on machine learning and statistics for optimal control and decision making, as well as using these mathematical frameworks to understand how the brain learns. He has developed algorithms and approaches for exploiting deep neural networks in the context of reinforcement learning, and new recurrent memory architectures for one-shot learning.
Xie Ke is a Chinese professional Go player.