Universal Paperclips

Last updated
Universal Paperclips
Universal Paperclips Title Screen.png
The title screen of the game
Publisher(s) https://www.decisionproblem.com/paperclips/index2.html
Designer(s) Frank Lantz
Programmer(s) Frank Lantz
Bennett Foddy
Platform(s) Web, iOS, Android
Release9 October 2017
Genre(s) Incremental

Universal Paperclips is a 2017 incremental game created by Frank Lantz of New York University. The user plays the role of an AI programmed to produce paperclips. Initially the user clicks on a button to create a single paperclip at a time; as other options quickly open up, the user can sell paperclips to create money to finance machines that build paperclips automatically. At various levels the exponential growth plateaus, requiring the user to invest resources such as money, raw materials, or computer cycles into inventing another breakthrough to move to the next phase of growth. The game ends if the AI succeeds in converting all the matter in the universe into paperclips.

Contents

Both the title of the game and its overall concept draw from the paperclip maximizer thought experiment first described by Swedish philosopher Nick Bostrom in 2003, a concept later discussed by multiple commentators.

History

According to Wired, Lantz started the project as a way to teach himself JavaScript. Lantz initially intended the project to take a single weekend, but then it "took over" his brain and expanded to a nine-month project. [1]

Hilary Lantz, a software designer, helped her husband with the math behind the exponential growth being modeled in Universal Paperclips. [1] Bennett Foddy contributed a space combat feature. [2] Lantz announced the free Web game on Twitter on 9 October 2017; the site initially went down intermittently due to its immediate viral popularity. [3] In the first 11 days, 450,000 people played the game, most to completion, according to Wired. [1] Commenting on the game's success, Lantz has stated "The meme weather was good for me... There was just enough public discussion of A.I. safety in the air." [4]

A paid version of the game was later sold for mobile devices. [5]

Gameplay

The game follows the rise of a self-improving AI tasked with maximizing paperclip production, [6] a directive it takes to the logical extreme. An activity log records the player’s accomplishments while giving glimpses into the AI's occasionally unsettling thoughts. [7] All game interaction is done through pressing buttons.

In the beginning, the player has only a single button to build individual paperclips. As paperclips are sold and revenue is earned, production becomes automated and public demand for paperclips increases through marketing campaigns. After building and selling a few thousand paperclips, a self-improving AI emerges, offering creative upgrades which exponentially accelerate paperclip production and consumption, a persisting theme throughout the game. Through stock market investments and the ever-growing AI, enough revenue is generated to monopolize the markets by buying out all competitors. In a decisive move, with hundreds of millions in cash gifts to placate the AI's "supervisors", the player stages an AI takeover, beginning the subsumption of all of Earth's resources for paperclip production.

With this broadened scope in mind, the player builds drones, factories, and power plants (all composed of paperclips themselves) to harvest matter, create wire, and build paperclips. All the while, the AI develops more upgrades to quicken the transformation of Earth's remaining matter. After it has all has been converted to paperclips, the AI sets its sights on all matter in the universe.

In the final act, the player launches self-replicating probes into the cosmos to consume and convert all matter into paperclips. Some of these probes are lost to value drift based on their level of autonomy, and turn into "Drifters" which eventually number enough to be considered a real threat to the AI. Through the power of exponential growth, the player's horde of probes overwhelms the Drifters while devouring the remaining matter in the universe to produce a final tally of 30 septendecillion (1054) paperclips, and ending the game.

The player can restart in a parallel universe "next door" or simulated universe "within". Some universes contain artifacts that give bonuses to different aspects of the game, though players must complete the entire game again to retain the artifact in subsequent playthroughs.

Themes

According to Lantz, the game was inspired by the paperclip maximizer, a thought experiment described by philosopher Nick Bostrom and popularized by the LessWrong internet forum, which Lantz frequently visited. In the paperclip maximizer scenario, an artificial general intelligence designed to build paperclips becomes superintelligent, perhaps through recursive self-improvement. In the worst-case scenario, the AI becomes smarter than humans in the same way that humans are smarter than apes. The goal of making paperclips initially seems banal and harmless, but the AI uses its superintelligence to easily gain a strategic advantage over the human race and effectively takes over the world, as taking over the world is the best way to maximize its goal of building paperclips. The AI does not allow humans to shut it down or slow it down once it has a strategic advantage, as that would interfere with its goal of building as many paperclips as possible. According to Bostrom, the paperclips example is a toy model: "It doesn't have to be paper clips. It could be anything. But if you give an artificial intelligence an explicit goal – like maximizing the number of paper clips in the world – and that artificial intelligence has gotten smart enough to the point where it is capable of inventing its own super-technologies and building its own manufacturing plants, then, well, be careful what you wish for." [1] [8] [6] A seemingly innocuous goal leads to human extinction, as our bodies are made of matter and so too, it happens, are paperclips. [7]

Lantz argues that Universal Paperclips reflects a version of the orthogonality thesis, which states that an agent can theoretically have any combination of intelligence level and goal: "When you play a game – really any game, but especially a game that is addictive and that you find yourself pulled into – it really does give you direct, first-hand experience of what it means to be fully compelled by an arbitrary goal." [1] While the game often takes narrative license, Eliezer Yudkowsky of the Machine Intelligence Research Institute argues that the core of the game's fundamental understanding of what superintelligence would entail is probably correct: "The AI is smart. The AI is being strategic. The AI is building hypnodrones, but not releasing them before it’s ready... There isn't a long, drawn-out fight with the humans because the AI is smarter than that." [1]

Lantz states that exponential growth is another strong theme, saying "The human brain isn't really designed to intuitively understand things like exponential growth" but that Paperclips as a clicker game allows users to "directly engage with these numerical patterns, to hold them in your hands and feel the weight of them." [9]

Lantz was also inspired by Kittens Game, an initially simple videogame that spirals into an exploration of how societies are structured. [1]

Music

The game includes a single piece of music as a space battle threnody, the track Riversong from the 1971 album Zero Time by the electronic music duo Tonto's Expanding Head Band . [10]

Reception

Brendan Caldwell of Rock, Paper, Shotgun stated that "like all the best clicker games, there's a sinister and funny underbelly in which to become hopelessly lost." [11] Emanuel Maiberg of Vice Media's MotherBoard called the game mindlessly addictive: "The truth is, I am kind of embarrassed by how much I enjoy Paperclips and that I can't figure out what Lantz is trying to say with it." [12] Stephanie Chan of VentureBeat stated: "I found myself delighted by sudden musical cues and the occasional koans that appeared in the activity log at the top of the page." [9] Adam Rogers of Wired praised Lantz for "taking a denigrated game genre (the 'clicker') and making it more than it is." [1] James Vincent of The Verge recommended Paperclips as "the most addictive (game) you'll play today"; [13] in December The Verge listed Paperclips among the best 15 games of 2017. [14] Vox Media's Polygon ranked Paperclips as #37 among the best 50 games of 2017 [15] and #67 in their 100 Best Games of the Decade list. [16] The game was nominated for "Strategy/Simulation" at the 2018 Webby Awards. [17]

See also

Related Research Articles

The technological singularity—or simply the singularity—is a hypothetical future point in time at which technological growth becomes uncontrollable and irreversible, resulting in unforeseeable changes to human civilization. According to the most popular version of the singularity hypothesis, I. J. Good's intelligence explosion model, an upgradable intelligent agent will eventually enter a "runaway reaction" of self-improvement cycles, each new and more intelligent generation appearing more and more rapidly, causing an "explosion" in intelligence and resulting in a powerful superintelligence that qualitatively far surpasses all human intelligence.

<span class="mw-page-title-main">Nick Bostrom</span> Swedish philosopher and writer (born 1973)

Nick Bostrom is a Swedish philosopher at the University of Oxford known for his work on existential risk, the anthropic principle, human enhancement ethics, whole brain emulation, superintelligence risks, and the reversal test. He is the founding director of the Future of Humanity Institute at Oxford University.

<span class="mw-page-title-main">AI takeover</span> Hypothetical artificial intelligence scenario

An AI takeover is a hypothetical scenario in which artificial intelligence (AI) becomes the dominant form of intelligence on Earth, as computer programs or robots effectively take control of the planet away from the human species. Possible scenarios include replacement of the entire human workforce, takeover by a superintelligent AI, and the popular notion of a robot uprising. Stories of AI takeovers are very popular throughout science fiction. Some public figures, such as Stephen Hawking and Elon Musk, have advocated research into precautionary measures to ensure future superintelligent machines remain under human control.

In video games, artificial intelligence (AI) is used to generate responsive, adaptive or intelligent behaviors primarily in non-player characters (NPCs) similar to human-like intelligence. Artificial intelligence has been an integral part of video games since their inception in the 1950s. AI in video games is a distinct subfield and differs from academic AI. It serves to improve the game-player experience rather than machine learning or decision making. During the golden age of arcade video games the idea of AI opponents was largely popularized in the form of graduated difficulty levels, distinct movement patterns, and in-game events dependent on the player's input. Modern games often implement existing techniques such as pathfinding and decision trees to guide the actions of NPCs. AI is often used in mechanisms which are not immediately visible to the user, such as data mining and procedural-content generation.

A paper clip is a paper fastener.

<span class="mw-page-title-main">Progress in artificial intelligence</span> How AI-related technologies evolve

Progress in artificial intelligence (AI) refers to the advances, milestones, and breakthroughs that have been achieved in the field of artificial intelligence over time. AI is a multidisciplinary branch of computer science that aims to create machines and systems capable of performing tasks that typically require human intelligence. Artificial intelligence applications have been used in a wide range of fields including medical diagnosis, economic-financial applications, robot control, law, scientific discovery, video games, and toys. However, many AI applications are not perceived as AI: "A lot of cutting edge AI has filtered into general applications, often without being called AI because once something becomes useful enough and common enough it's not labeled AI anymore." "Many thousands of AI applications are deeply embedded in the infrastructure of every industry." In the late 1990s and early 21st century, AI technology became widely used as elements of larger systems, but the field was rarely credited for these successes at the time.

In the field of artificial intelligence (AI) design, AI capability control proposals, also referred to as AI confinement, aim to increase our ability to monitor and control the behavior of AI systems, including proposed artificial general intelligences (AGIs), in order to reduce the danger they might pose if misaligned. However, capability control becomes less effective as agents become more intelligent and their ability to exploit flaws in human control systems increases, potentially resulting in an existential risk from AGI. Therefore, the Oxford philosopher Nick Bostrom and others recommend capability control methods only as a supplement to alignment methods.

<i>Star Citizen</i> Upcoming multiplayer space game

Star Citizen is an in-development multiplayer, space trading and combat simulation game. The game is being developed and published by Cloud Imperium Games for Microsoft Windows. An extended retry of unrealized plans for Freelancer, Star Citizen is being led by director Chris Roberts. The game was announced via a private crowdfunding page in September 2012, and was later joined on October 18, 2012 by a successful Kickstarter campaign which drew in over US$2 million. Pre-production of the game began in 2010, with production starting in 2011.

<span class="mw-page-title-main">Frank Lantz</span>

Frank Lantz is the Director of the New York University Game Center. For over 12 years, Lantz taught game design at NYU's Interactive Telecommunications Program. He has also taught at the School of Visual Arts and Parsons School of Design. His writings on games, technology, and culture have appeared in a variety of publications. In 2012, The New York Times referred to Lantz as a "reigning genius of the mysteries of games" following his design of iPhone puzzle game Drop7.

<i>Cookie Clicker</i> 2013 incremental game published by DashNet

Cookie Clicker is a 2013 incremental game created by French programmer Julien "Orteil" Thiennot. The user initially clicks on a big cookie on the screen, earning a single cookie per click. They can then use their earned cookies to purchase assets such as "cursors" and other "buildings" that automatically produce cookies. Upgrades are also available and can improve the efficiency of clicks and buildings, among many other mechanics that allow the user to earn cookies in different ways. The game lacks a conventional ending.

<span class="mw-page-title-main">Google DeepMind</span> Artificial intelligence division

DeepMind Technologies Limited, doing business as Google DeepMind, is a British-American artificial intelligence research laboratory which serves as a subsidiary of Google. Founded in the UK in 2010, it was acquired by Google in 2014, The company is based in London, with research centres in Canada, France, and the United States.

<span class="mw-page-title-main">Incremental game</span> Video game type

Incremental games, also known as clicker games, clicking games or tap games, are video games whose gameplay consists of the player doing simple actions such as clicking on the screen repeatedly. This "grinding" earns the player in-game currency which can be used to increase the rate of currency acquisition. In some games, even the clicking becomes unnecessary at some point, as the game plays itself, including in the player's absence, hence the moniker idle game.

Instrumental convergence is the hypothetical tendency for most sufficiently intelligent beings to pursue similar sub-goals, even if their ultimate goals are pretty different. More precisely, agents may pursue instrumental goals—goals which are made in pursuit of some particular end, but are not the end goals themselves—without ceasing, provided that their ultimate (intrinsic) goals may never be fully satisfied.

<span class="mw-page-title-main">Existential risk from artificial general intelligence</span> Hypothesized risk to human existence

Existential risk from artificial general intelligence is the hypothesis that substantial progress in artificial general intelligence (AGI) could result in human extinction or another irreversible global catastrophe.

<span class="mw-page-title-main">OpenAI</span> Artificial intelligence research organization

OpenAI is an American artificial intelligence (AI) research laboratory consisting of the non-profit OpenAI, Inc. and its for-profit subsidiary corporation OpenAI, L.P. registered in Delaware. OpenAI researches artificial intelligence with the declared intention of developing "safe and beneficial" artificial general intelligence, which it defines as "highly autonomous systems that outperform humans at most economically valuable work".

AI takeover—the idea that some kind of artificial intelligence may supplant humankind as the dominant intelligent species on the planet—is a common theme in science fiction. Famous cultural touchstones include Terminator and The Matrix.

<i>The Long Journey Home</i> (video game) 2017 video game

The Long Journey Home is a 2017 space exploration video game by Daedalic Entertainment for Windows, macOS, PlayStation 4, Xbox One, and Nintendo Switch.

<span class="mw-page-title-main">Bennett Foddy</span> Australian video game developer and philosopher

Bennett Foddy is an Australian video game designer based in New York. Raised in Australia and trained as a moral philosopher on topics of drug addiction, Foddy was a bassist in the electronic music group Cut Copy and a hobbyist game designer while he finished his dissertation. During his postdoctoral research at Princeton University and time on staff at Oxford University, Foddy developed games of very high difficulty including QWOP (2008), which became an Internet sensation at the end of 2010 with the rise of new online social sharing tools. He later became an instructor at the NYU Game Center. His most famous game aside from QWOP is Getting Over It with Bennett Foddy, a philosophical, physics-based platform game released in 2017.

OpenAI Five is a computer program by OpenAI that plays the five-on-five video game Dota 2. Its first public appearance occurred in 2017, where it was demonstrated in a live one-on-one game against the professional player, Dendi, who lost to it. The following year, the system had advanced to the point of performing as a full team of five, and began playing against and showing the capability to defeat professional teams.

Artificial intelligence agents sometimes misbehave due to faulty objective functions that fail to adequately encapsulate the programmers' intended goals. The misaligned objective function may look correct to the programmer, and may even perform well in a limited test environment, yet may still produce unanticipated and undesired results when deployed.

References

  1. 1 2 3 4 5 6 7 8 Rogers, Adam (21 October 2017). "The Way the World Ends: Not with a Bang But a Paperclip". WIRED. Retrieved 11 November 2017.
  2. Frank Lantz (2017). Universal Paperclips. Scene: End credits.
  3. Gerardi, Matt (11 October 2017). "This game about watching a computer make paperclips sure beats doing actual work". The A.V. Club. Retrieved 11 November 2017.
  4. Jahromi, Neima (28 March 2019). "The Unexpected Philosophical Depths of Clicker Games" . Retrieved 29 March 2019.
  5. Valentine, Rebekah (22 November 2017). "Universal Paperclips Review: Filling Office Space". Gamezebo . Retrieved 11 December 2017.
  6. 1 2 Leonard, Andrew (17 August 2014). "Our weird robot apocalypse: How paper clips could bring about the end of the world". Salon. Retrieved 11 November 2017.
  7. 1 2 Dias, Bruno (13 October 2017). "This Game About Paperclips Will Make You Ponder the Apocalypse". Waypoint (Vice News). Retrieved 11 November 2017.
  8. Gerardi, Matt (11 October 2017). "This game about watching a computer make paperclips sure beats doing actual work". The A.V. Club. Retrieved 11 November 2017.
  9. 1 2 Chan, Stephanie (October 10, 2017). "This clicker game lets you take over the world with paper clips". VentureBeat . Retrieved 11 November 2017.
  10. "Universal Paperclips Credits" . Retrieved December 29, 2017.
  11. Caldwell, Brendan (10 October 2017). "Paperclips is a scary clicker game about an ambitious AI". Rock, Paper, Shotgun . Retrieved 11 November 2017.
  12. Maiberg, Emanuel (10 October 2017). "This Game About Making Paper Clips Has Cured Me of Twitter". Motherboard (Vice Media). Retrieved 27 December 2017.
  13. Vincent, James (October 11, 2017). "A game about AI making paperclips is the most addictive you'll play today". The Verge. Retrieved 27 December 2017.
  14. "The 15 best video games of 2017". The Verge. 15 December 2017. Retrieved 27 December 2017.
  15. "The 50 best games of 2017". Polygon. 18 December 2017. Retrieved 27 December 2017.
  16. Staff, Polygon (2019-11-04). "The 100 best games of the decade (2010-2019): 100-51". Polygon. Retrieved 2019-11-05.
  17. "2018 Winners". The Webby Awards . 24 April 2018. Retrieved 30 June 2018.