Since late 2009, the headquarters of the Internet Archive has been the building that formerly housed the Fourth Church of Christ, Scientist in San Francisco, California.
The Internet Archive allows the public to upload and download digital material to its data cluster, but the bulk of its data is collected automatically by its web crawlers, which work to preserve as much of the public web as possible. Its web archive, the Wayback Machine, contains hundreds of billions of web captures.[6][7] The Archive also oversees numerous book digitization projects, collectively one of the world's largest book digitization efforts.
History
Headquarters in Building 116 of the Presidio of San Francisco in 2008
Brewster Kahle founded the Archive in May 1996, around the same time that he began the for-profit web crawling company Alexa Internet.[8][9] The earliest known archived page on the site was saved on May 10, 1996, at 2:42pm UTC (7:42am PDT). By October of that year, the Internet Archive had begun to archive and preserve the World Wide Web in large amounts.[10][11][12][13][14] The archived content became more easily available to the general public in 2001, through the Wayback Machine.
In late 1999, the Archive expanded its collections beyond the web archive, beginning with the Prelinger Archives. Now, the Internet Archive includes texts, audio, moving images, and software. It hosts a number of other projects: the NASA Images Archive, the contract crawling service Archive-It, and the wiki-editable library catalog and book information site Open Library. Soon after that, the Archive began working to provide specialized services relating to the information access needs of the print-disabled; publicly accessible books were made available in a protected Digital Accessible Information System (DAISY) format.[15]
Most societies place importance on preserving artifacts of their culture and heritage. Without such artifacts, civilization has no memory and no mechanism to learn from its successes and failures. Our culture now produces more and more artifacts in digital form. The Archive's mission is to help preserve those artifacts and create an Internet library for researchers, historians, and scholars.
In August 2012, the Archive announced[17] that it had added BitTorrent to its file download options for more than 1.3million existing files, and all newly uploaded files.[18][19] This method is the fastest means of downloading media from the Archive, as files are served from two Archive data centers, in addition to other torrent clients which have downloaded and continue to serve the files.[18][20]
On November 6, 2013, the Internet Archive's headquarters in San Francisco's Richmond District caught fire,[21] destroying equipment and damaging some nearby apartments.[22] According to the Archive, it lost a side-building housing one of 30 of its scanning centers; cameras, lights, and scanning equipment worth hundreds of thousands of dollars; and "maybe 20 boxes of books and film, some irreplaceable, most already digitized, and some replaceable".[23] The nonprofit Archive sought donations to cover the estimated $600,000 in damage.[24]
An overhaul of the site was launched as beta in November 2014, and the legacy layout was removed in March 2016.[25][26]
In November 2016, Kahle announced that the Internet Archive was building the Internet Archive of Canada, a copy of the Archive to be based somewhere in Canada. The announcement received widespread coverage due to the implication that the decision to build a backup archive in a foreign country was because of the upcoming presidency of Donald Trump.[27][28][29]
Beginning in 2017, OCLC and the Internet Archive have collaborated to make the Archive's records of digitized books available in WorldCat.[30]
Since 2018, the Internet Archive visual arts residency, which is organized by Amir Saber Esfahani and Andrew McClintock, helps connect artists with the Archive's over 48 petabytes[31] of digitized materials. Over the course of the yearlong residency, visual artists create a body of work which culminates in an exhibition. The hope is to connect digital history with the arts and create something for future generations to appreciate online or off.[32] Previous artists in residence include Taravat Talepasand, Whitney Lynn, and Jenny Odell.[33]
The Internet Archive acquires most materials from donations,[34] such as hundreds of thousands of 78rpm discs from Boston Public Library in 2017,[35] a donation of 250,000 books from Trent University in 2018,[36] and the entire collection of Marygrove College's library after it closed in 2020.[37] All material is then digitized and retained in digital storage, while a digital copy is returned to the original holder and the Internet Archive's copy, if not in the public domain, is lent to patrons worldwide one at a time under the controlled digital lending (CDL) theory of the first-sale doctrine.[38]
In September 2024, Google and the Internet Archive signed a partnership to allow people to see previous versions of websites on Google Search that uses the Wayback Machine, without linking the Google Cache yet.[42]
Internet Archive main page showing partially available services
Beginning October 9, 2024, the Internet Archive's team, including archivist Jason Scott and security researcher Scott Helme, confirmed DDoS attacks, site defacement, and a data breach. The purported hacktivist group SN_BLACKMETA again claimed responsibility.[50] A pop-up on the defaced site claimed that there was a "catastrophic" security breach, stating "Have you ever felt like the Internet Archive runs on sticks and is constantly on the verge of suffering a catastrophic security breach? It just happened. See 31 million of you on HIBP!"[51][47] It was reported that about 31 million user accounts were affected, and compromised in a file called "ia_users.sql", dated September 28, 2024.[50][52] The attackers stole users' email addresses and Bcrypt-hashed passwords.[53] As of October 15, 2024, the website was still mostly offline for "prioritizing keeping data safe at the expense of service availability."[54] On October 11, Kahle said that the data is safe, and will bring the service back to normal "in days, not weeks."[55][56][57] On October 13, the Wayback Machine was restored in a read-only format, while archiving web pages was temporarily disabled.[58] On October 14, Brewster Kahle said "[the Wayback Machine] volume is back to normal: 1,500 requests per second".[59] On October 20, threat actors stole unrotated API tokens and breached Internet Archive on its Zendesk email support platform; they also claimed responsibility for the other breaches yet stated that SN_BLACKMETA was behind just the DDoS attacks.[60][61] On October 21, Internet Archive went back online in a read-only manner.[62] On October 22, all Internet Archive services temporarily went offline,[63][64] but later that same day, only the Wayback Machine, Archive-It, and blog.archive.org were resumed.[citation needed] On October 23, archive.org, the Wayback Machine, Archive-It, and the Open Library services all resumed but with some features, such as logging in, still unavailable until the staff announced it back available in the next day or two.[65]
Operations
This section needs to be updated. Please help update this article to reflect recent events or newly available information.(May 2020)
The Archive is a 501(c)(3) nonprofit operating in the United States. In 2019, it had an annual budget of $37million, derived from revenue from its Web crawling services, various partnerships, grants, donations, and the Kahle-Austin Foundation.[66] The Internet Archive also manages periodic funding campaigns. For instance, a December 2019 campaign had a goal of reaching $6million in donations.[67] It uses Ubuntu as its choice of operating system for the website servers.[68]
Brewster Kahle of the Internet Archive talks about archiving operations
The Archive is headquartered in San Francisco, California. From 1996 to 2009, its headquarters were in the Presidio of San Francisco, a former U.S. military base. Since 2009, its headquarters have been at 300 Funston Avenue in San Francisco, a former Christian Science Church. At one time, most of its staff worked in its book-scanning centers; as of 2019, scanning is performed by 100 paid operators worldwide.[69] The Archive also has data centers in three Californian cities: San Francisco, Redwood City, and Richmond. To reduce the risk of data loss, the Archive creates copies of parts of its collection at more distant locations, including the Bibliotheca Alexandrina[70][71] in Egypt and a facility in Amsterdam.[72]
The Wayback Machine is a service that allows archives of the World Wide Web to be searched and accessed.[76] It can be used to see what previous versions of web sites used to look like or to visit web sites that no longer even exist. The Wayback Machine was created as a joint effort between Alexa Internet (owned by Amazon.com) and the Internet Archive.[77] Hundreds of billions of web sites and their associated data (images, source code, documents, etc.) are saved in a database. As of September5,2024[update], the Internet Archive held over 866billion web pages, more than 42.5million print materials, 13million videos, 3million TV news, 1.2million software programs, 14million audio files, 5million images, and 272,660 concerts in its Wayback Machine.[5]
Created in early 2006, Archive-It[78] is a web archiving subscription service that allows institutions and individuals to build and preserve collections of digital content and create digital archives. Archive-It allows the user to customize their capture or exclusion of web content they want to preserve for cultural heritage reasons. Through a web application, Archive-It partners can harvest, catalog, manage, browse, search, and view their archived collections.[79]
In terms of accessibility, the archived web sites are full text searchable within seven days of capture.[80] Content collected through Archive-It is captured and stored as a WARC file. A primary and back-up copy is stored at the Internet Archive data centers. A copy of the WARC file can be given to subscribing partner institutions for geo-redundant preservation and storage purposes to their best practice standards.[81] Periodically, the data captured through Archive-It is indexed into the Internet Archive's general archive.
As of March2014[update], Archive-It had more than 275 partner institutions in 46 U.S. states and 16 countries that have captured more than 7.4billion URLs for more than 2,444 public collections.[citation needed] Archive-It partners are universities and college libraries, state archives, federal institutions, museums, law libraries, and cultural organizations, including the Electronic Literature Organization, North Carolina State Archives and Library, Stanford University, Columbia University, American University in Cairo, Georgetown Law Library, and many others.[citation needed]
In September 2020, Internet Archive announced a new initiative to archive and preserve open access academic journals, called Internet Archive Scholar.[82][83][84] Its full-text search index includes over 25million research articles and other scholarly documents preserved in the Internet Archive. The collection spans from digitized copies of eighteenth century journals through the latest open access conference proceedings and pre-prints crawled from the World Wide Web.[citation needed]
General Index
In 2021, the Internet Archive announced the initial version of the General Index, a publicly available index to a collection of 107million academic journal articles.[85][86]
Items and collections
The Archive stores files inside so-called items, which are similar to directories in that they can contain multiple files, but can have additional metadata such as a description and tags which make them more searchable.
Some file types can be previewed directly on the site, where as others have to be downloaded in order to be opened. If multiple multimedia files exist in an item, the website generates a playlist for video or audio files, or a slide show for pictures. If an item contains at least one video or picture, the Archive generates a preview thumbnail that can be seen on collection pages and in searches. Items can contain mixed data such as music files with an album cover picture, in which case the picture is used as thumbnail.[87][88][89][90]
Staff members of the Internet Archive organize items by placing them into so-called collections, which are pages listing multiple items.[91]
Book collections
Text collection
Internet Archive "Scribe" book scanning workstationAn Internet Archive in-house scan ongoing
The scanning performed by the Internet Archive is financially supported by libraries and foundations.[92]As of November2008[update], when there were approximately 1million texts, the entire collection was greater than 0.5 petabytes, which included raw camera images, cropped and skewed images, PDFs, and raw OCR data.[93]
As of July2013[update], the Internet Archive was operating 33 scanning centers in five countries, digitizing about 1,000 books a day for a total of more than 2million books, in a total collection of 4.4million books–including material digitized by others and fed into the Internet Archive; at that time, users were performing more than 15million downloads per month.[94]
The material digitized by others includes more than 300,000 books that were contributed to the collection, between about 2006 and 2008, by Microsoft through its Live Search Books project, which also included financial support and scanning equipment directly donated to the Internet Archive.[95] On May 23, 2008, Microsoft announced it would be ending its Live Book Search project and would no longer be scanning books, donating its remaining scanning equipment to its former partners.[95]
Around October 2007, Archive users began uploading public domain books from Google Book Search.[96]As of November2013[update], there were more than 900,000 Google-digitized books in the Archive's collection;[97] the books are identical to the copies found on Google, except without the Google watermarks, and are available for unrestricted use and download.[a] Brewster Kahle revealed in 2013 that this archival effort was coordinated by Aaron Swartz, who, with a "bunch of friends", downloaded the public domain books from Google slowly enough and from enough computers to stay within Google's restrictions. They did this to ensure public access to the public domain. The Archive ensured the items were attributed and linked back to Google, which never complained, while libraries "grumbled". According to Kahle, this is an example of Swartz's "genius" to work on what could give the most to the public good for millions of people.[98]
In addition to books, the Archive offers free and anonymous public access to more than four million court opinions, legal briefs, or exhibits uploaded from the United States Federal Courts' PACER electronic document system via the RECAP web browser plugin. These documents had been kept behind a federal court paywall. On the Archive, they had been accessed by more than six million people by 2013.[98]
The Open Library is another project of the Internet Archive. The project seeks to include a web page for every book ever published: it holds 25million catalog records of editions. It also seeks to be a web-accessible public library: it contains the full texts of approximately 1,600,000 public domain books (out of the more than five million from the main texts collection), as well as in-print and in-copyright books,[102] many of which are fully readable, downloadable[103][104] and full-text searchable;[105] it offers a two-week loan of e-books in its controlled digital lending program for over 647,784 books not in the public domain, in partnership with over 1,000 library partners from six countries[94][106] after a free registration on the web site. Open Library is a free and open-source software project, with its source code freely available on GitHub.
The Open Library faces objections from some authors and the Society of Authors, who hold that the project is distributing books without authorization and is thus in violation of copyright laws,[107] and four major publishers initiated a copyright infringement lawsuit against the Internet Archive in June 2020 to stop the Open Library project.[108]
In 2017, the MIT Press authorized the Internet Archive to digitize and lend books from the press's backlist,[111] with financial support from the Arcadia Fund.[112][113] A year later, the Internet Archive received further funding from the Arcadia Fund to invite some other university presses to partner with the Internet Archive to digitize books, a project called "Unlocking University Press Books".[114][115]
The Library of Congress created numerous Handle System identifiers that pointed to free digitized books in the Internet Archive.[116] The Internet Archive and Open Library are listed on the Library of Congress website as a source of e-books.[117]
Media collections
Media readerMicrofilms at the Internet ArchiveVideocassettes at the Internet Archive
In addition to web archives, the Internet Archive maintains extensive collections of digital media that are attested by the uploader to be in the public domain in the United States or licensed under a license that allows redistribution, such as Creative Commons licenses.[citation needed] Media are organized into collections by media type (moving images, audio, text, etc.), and into sub-collections by various criteria. Each of the main collections includes a "Community" sub-collection (formerly named "Open Source") where general contributions by the public are stored.[citation needed]
The Live Music Archive sub-collection includes more than 170,000 concert recordings from independent musicians, as well as more established artists and musical ensembles with permissive rules about recording their concerts, such as the Grateful Dead, and more recently, The Smashing Pumpkins. Also, Jordan Zevon has allowed the Internet Archive to host a definitive collection of his father Warren Zevon's concert recordings. The Zevon collection ranges from 1976 to 2001 and contains 126 concerts including 1,137 songs.[122]
The Great 78 Project aims to digitize 250,000 78rpm singles (500,000 songs) from the period between 1880 and 1960, donated by various collectors and institutions. It has been developed in collaboration with the Archive of Contemporary Music and George Blood Audio, responsible for the audio digitization.[119]
The Archive has a collection of freely distributable music that is streamed and available for download via its Netlabels service. The music in this collection generally has Creative Commons-license catalogs of virtual record labels.[123][124]
The Cover Art Archive is a joint project between the Internet Archive and MusicBrainz, whose goal is to make cover art images on the Internet. As of April2021,[update] this collection contains more than 1,400,000 items.[126]
Metropolitan Museum of Art images
The images of this collection are from the Metropolitan Museum of Art. This collection contains more than 140,000 items.[127]
NASA Images
The NASA Images archive was created through a Space Act Agreement between the Internet Archive and NASA to bring public access to NASA's image, video, and audio collections in a single, searchable resource. The Internet Archive NASA Images team worked closely with all of the NASA centers to keep adding to the ever-growing collection.[128] The nasaimages.org site launched in July 2008 and had more than 100,000 items online at the end of its hosting in 2012.
Occupy Wall Street Flickr archive
This collection contains Creative Commons-licensed photographs from Flickr related to the Occupy Wall Street movement. This collection contains more than 15,000 items.[129]
One of the sub-collections of the Internet Archive's Video Archive is the Machinima Archive. This small section hosts many Machinima videos. Machinima is a digital artform in which computer games, game engines, or software engines are used in a sandbox-like mode to create motion pictures, recreate plays, or even publish presentations or keynotes. The archive collects a range of Machinima films from internet publishers such as Rooster Teeth and Machinima.com as well as independent producers. The sub-collection is a collaborative effort among the Internet Archive, the How They Got Game research project at Stanford University, the Academy of Machinima Arts and Sciences, and Machinima.com.[131]
The Internet Archive holds a collection of approximately 3,863 feature films.[134] Additionally, the Internet Archive's Moving Image collection includes: newsreels, classic cartoons, pro- and anti-war propaganda, The Video Cellar Collection, Skip Elsheimer's "A.V. Geeks" collection, early television, and ephemeral material from Prelinger Archives, such as advertising, educational, and industrial films, as well as amateur and home movie collections.[citation needed]
IA's FedFlix collection, Joint Venture NTIS-1832 between the National Technical Information Service and Public.Resource.Org that features "the best movies of the United States Government, from training films to history, from our national parks to the U.S. Fire Academy and the Postal Inspectors"[135]
IA's Independent News collection, which includes sub-collections such as the Internet Archive's World At War competition from 2001, in which contestants created short films demonstrating "why access to history matters". Among their most-downloaded video files are eyewitness recordings of the devastating 2004 Indian Ocean earthquake.[citation needed]
IA's September 11 Television Archive, which contains archival footage from the world's major television networks of the terrorist attacks of September 11, 2001, as they unfolded on live television.[136]
Open Educational Resources is a digital collection at archive.org. This collection contains hundreds of free courses, video lectures, and supplemental materials from universities in the United States and China. The contributors of this collection are ArsDigita University, Hewlett Foundation, MIT, Monterey Institute, and Naropa University.[137]
TV News Search & Borrow
TV tuners at the Internet Archive
In September 2012, the Internet Archive launched the TV News Search & Borrow service for searching U.S. national news programs.[138] The service is built on closed captioning transcripts and allows users to search and stream 30-second video clips. Upon launch, the service contained "350,000 news programs collected over 3 years from national U.S. networks and stations in San Francisco and Washington D.C."[139] According to Kahle, the service was inspired by the Vanderbilt Television News Archive, a similar library of televised network news programs.[140] In contrast to Vanderbilt, which limits access to streaming video to individuals associated with subscribing colleges and universities, the TV News Search & Borrow allows open access to its streaming video clips. In 2013, the Archive received an additional donation of "approximately 40,000 well-organized tapes" from the estate of a Philadelphia woman, Marion Stokes. Stokes "had recorded more than 35 years of TV news in Philadelphia and Boston with her VHS and Betamax machines."[141]
Miscellaneous collections
Brooklyn Museum collection contains approximately 3,000 items from Brooklyn Museum.[142] In December 2020, the film research library of Lillian Michelson was donated to the archive.[143]
Other services and endeavors
Physical media
A vintage wall intercom, an example of another "archived" item
Voicing a strong reaction to the idea of books simply being thrown away, and inspired by the Svalbard Global Seed Vault, Kahle now envisions collecting one copy of every book ever published. "We're not going to get there, but that's our goal", he said. Alongside the books, Kahle plans to store the Internet Archive's old servers, which were replaced in 2010.[144]
Software
The Internet Archive has "the largest collection of historical software online in the world", spanning 50 years of computer history in terabytes of computer magazines and journals, books, shareware discs, FTP sites, video games, etc. The Internet Archive has created an archive of what it describes as "vintage software", as a way to preserve them.[145] The project advocated an exemption from the United States Digital Millennium Copyright Act to permit them to bypass copy protection, which the United States Copyright Office approved in 2003 for a period of three years.[146] The Archive does not offer the software for download, as the exemption is solely "for the purpose of preservation or archival reproduction of published digital works by a library or archive."[147] The Library of Congress renewed the exemption in 2006, and in 2009 indefinitely extended it pending further rulemakings.[148] The Library reiterated the exemption as a "Final Rule" with no expiration date in 2010.[149] In 2013, the Internet Archive began to provide select video games browser-playable via MESS, for instance the Atari 2600 game E.T. the Extra-Terrestrial.[150] Since December 23, 2014, the Internet Archive presents, via a browser-based DOSBox emulation, thousands of DOS/PC games[151][152][153][154] for "scholarship and research purposes only".[155][156][157] In November 2020, the Archive introduced a new emulator for Adobe Flash called Ruffle, and began archiving Flash animations and games ahead of the December 31, 2020, end-of-life for the Flash plugin across all computer systems.[158]
Table Top Scribe System
A combined hardware software system has been developed that performs a safe method of digitizing content.[159][160]
Credit Union
From 2012 to November 2015, the Internet Archive operated the Internet Archive Federal Credit Union, a federal credit union based in New Brunswick, New Jersey, with the goal of providing access to low- and middle-income people. Throughout its short existence, the IAFCU experienced significant conflicts with the National Credit Union Administration, which severely limited the IAFCU's loan portfolio and concerns over serving Bitcoin firms. At the time of its dissolution, it consisted of 395 members and was worth $2.5million.[161][162]
Decentralization
Since 2019,[163] the Internet Archive organizes an event called Decentralized Web Camp (DWeb Camp). It is an annual camp that brings together a diverse global community of contributors in a natural setting. The camp aims to tackle real-world challenges facing the web and co-create decentralized technologies for a better internet. It aims to foster collaboration, learning, and fun while promoting principles of trust, human agency, mutual respect, and ecological awareness.[164]
Wayforward Machine
Screenshot of viewing English Wikipedia on the Wayforward Machine
On 30 September 2021, as a part of its 25th anniversary celebration, Internet Archive launched the "Wayforward Machine", a satirical, fictional website covered with pop-ups asking for personal information. The site was intended to depict a fictionaldystopian timeline of real-world events leading to such a future, such as the repeal of Section 230 of the United States Code in 2022 and the introduction of advertising implants in 2041.[165][166]
The Great Room of the Internet Archive features a collection of more than 100 ceramic figures representing employees of the Internet Archive, with the 100th statue immortalizing Aaron Swartz. This collection, inspired by the statues of the Xian warriors in China, was commissioned by Brewster Kahle, sculpted by Nuala Creed, and as of 2014, is ongoing.[167]
Artists in residence
The Internet Archive visual arts residency,[168] organized by Amir Saber Esfahani, is designed to connect emerging and mid-career artists with the Archive's millions of collections and to show what is possible when open access to information intersects with the arts. During this one-year residency, selected artists develop a body of work that responds to and utilizes the Archive's collections in their own practice.[169]
On May 8, 2008, it was revealed that the Internet Archive had successfully challenged an FBInational security letter asking for logs on an undisclosed user.[173][174]
On November 28, 2016, it was revealed that a second FBI national security letter had been successfully challenged that had been asking for logs on another undisclosed user.[175]
The Internet Archive is a member of the Open Book Alliance, which has been among the most outspoken critics of the Google Book Settlement. The Archive advocates an alternative digital library project.[177]
Hosting of disputed media
On October 9, 2016, the Internet Archive was temporarily blocked in Turkey after it was used (amongst other file hosting services) by hackers to host 17GB of leaked government emails.[178][179]
Because the Internet Archive only lightly moderates uploads, it includes resources that may be valued by extremists and the site may be used by them to evade block listing. In February 2018, the Counter Extremism Project said that the Archive hosted terrorist videos, including the beheading of Alan Henning, and had declined to respond to requests about the videos.[180] In May 2018, a report published by the cyber-security firm Flashpoint stated that the Islamic State was using the Internet Archive to share its propaganda.[181] Chris Butler, from the Internet Archive, responded that they regularly spoke to the US and EU governments about sharing information on terrorism.[181] In April 2019, Europol, acting on a referral from French police, asked the Internet Archive to remove 550 sites of "terrorist propaganda".[182] The Archive rejected the request, saying that the reports were wrong about the content they pointed to, or were too broad for the organization to comply with.[182] On July 14, 2021, the Internet Archive held a joint "Referral Action Day" with Europol to target terrorist videos.[183]
A 2021 article said that jihadists regularly used the Internet Archive for "dead drops" of terrorist videos.[184] In January 2022, a former UCLA lecturer's 800-page manifesto, containing racist ideas and threats against UCLA staff, was uploaded to the Internet Archive.[185] The manifesto was removed by the Internet Archive after a week, amidst discussion about whether such documents should be preserved by archivists or not.[185] Another 2022 paper found "an alarming volume of terrorist, extremist, and racist material on the Internet Archive".[186] A 2023 paper reported that Neo-Nazis collect links to online, publicly available resources to be shared with new recruits. As the Internet Archive hosts uploaded texts that are not allowed on other websites, Nazi and neo-Nazi books in the Archive (e.g., The Turner Diaries) frequently appear on these lists. These lists also feature older, public domain material created when white supremacist views were more mainstream.[187]
2020 National Emergency Library
In the midst of the COVID-19 pandemic which closed many schools, universities, and libraries, the Archive announced on March 24, 2020, that it was creating the National Emergency Library by removing the lending restrictions it had in place for 1.4million digitized books in its Open Library but otherwise limiting users to the number of books they could check out and enforcing their return; normally, the site would only allow one digital lending for each physical copy of the book they had, by use of an encrypted file that would become unusable after the lending period was completed.[4] This Library would remain as such until at least June 30, 2020, or until the US national emergency was over, whichever came later.[188] At launch, the Internet Archive allowed authors and rightholders to submit opt-out requests for their works to be omitted from the National Emergency Library.[189][190][191]
The Internet Archive said the National Emergency Library addressed an "unprecedented global and immediate need for access to reading and research material" due to the closures of physical libraries worldwide.[192] They justified the move in a number of ways. Legally, they said they were promoting access to those inaccessible resources, which they claimed was an exercise in fair use principles. The Archive continued implementing their controlled digital lending policy that predated the National Emergency Library, meaning they still encrypted the lent copies and it was no easier for users to create new copies of the books than before. An ultimate determination of whether or not the National Emergency Library constituted fair use could only be made by a court. Morally, they also pointed out that the Internet Archive was a registered library like any other, that they either paid for the books themselves or received them as donations, and that lending through libraries predated copyright restrictions.[189][193]
The Archive had already been criticized by authors and publishers for its prior lending approach, and upon announcement of the National Emergency Library, authors, publishers, and groups representing both took further issue with The Archive and its Open Library project, equating the move to copyright infringement and digital piracy, and using the COVID-19 pandemic as a reason to push the boundaries of copyright.[191][194][195][196] After the works of some of these authors were ridiculed in responses, the Internet Archive's Jason Scott requested that supporters of the National Emergency Library not denigrate anyone's books: "I realize there's strong debate and disagreement here, but books are life-giving and life-changing and these writers made them."[197]
Copyright issues
In November 2005, free downloads of Grateful Dead concerts were removed from the site, following what seemed to be disagreements between some of the former band members. John Perry Barlow identified Bob Weir, Mickey Hart, and Bill Kreutzmann as the instigators of the change, according to an article in The New York Times.[198]Phil Lesh, a founding member of the band,commented on the change in a November 30, 2005, posting to his personal web site:
It was brought to my attention that all of the Grateful Dead shows were taken down from Archive.org right before Thanksgiving. I was not part of this decision making process and was not notified that the shows were to be pulled. I do feel that the music is the Grateful Dead's legacy and I hope that one way or another all of it is available for those who want it.[199]
A November 30 forum post from Brewster Kahle summarized what appeared to be the compromise reached among the band members. Audience recordings could be downloaded or streamed, but soundboard recordings were to be available for streaming only. Concerts have since been re-added.[200]
In February 2016, Internet Archive users had begun archiving digital copies of Nintendo Power, Nintendo's official magazine for their games and products, which ran from 1988 to 2012. The first 140 issues had been collected, before Nintendo had the archive removed on August 8, 2016. In response to the take-down, Nintendo told gaming website Polygon, "[Nintendo] must protect our own characters, trademarks and other content. The unapproved use of Nintendo's intellectual property can weaken our ability to protect and preserve it, or to possibly use it for new projects".[201]
In August 2017, the Department of Telecommunications of the Government of India blocked the Internet Archive along with other file-sharing websites, in accordance with two court orders issued by the Madras High Court,[202] citing piracy concerns after copies of two Bollywood films were allegedly shared via the service.[203] The HTTP version of the Archive was blocked but it remained accessible using the HTTPS protocol.[202]
In 2023, the Internet Archive became a popular site for Indians to watch the first episode of India: The Modi Question,[204] a BBC documentary released on January 17 and banned in India by January 20.[205][206] The video was reported to have been removed by the Archive on January 23.[204] The Internet Archive then stated, on January 27, that they had removed the video in response to a BBC request under the Digital Millennium Copyright Act.[207]
The operation of the National Emergency Library was part of a lawsuit filed against the Internet Archive by four major book publishers—Hachette, HarperCollins, John Wiley & Sons, and Penguin Random House—in June 2020, challenging the copyright validity of the controlled digital lending program.[4][108][208] In response, the Internet Archive closed the National Emergency Library on June 16, 2020, rather than the planned June 30, 2020, due to the lawsuit.[209][210] The plaintiffs, supported by the Copyright Alliance,[211] claimed in their lawsuit that the Internet Archive's actions constituted a "willful mass copyright infringement."[212]
Judge Koeltl ruled on March 24, 2023, against Internet Archive in the case, saying the National Emergency Library concept was not fair use, so the Archive infringed their copyrights by lending out the books without the waitlist restriction. An agreement was then reached for the Internet Archive to pay an undisclosed amount to the publishers.[213] The Internet Archive appealed the ruling.[214][215] On September 4, 2024, the U.S. Court of Appeals for the Second Circuit upheld the district court's ruling, calling the Internet Archive's argument that they were shielded by fair use doctrine "unpersuasive".[216]
Music publishers' lawsuit
In August 2023, the music industry corporations Universal Music Group (UMG), Sony Music and Concord sued the Internet Archive over its Great 78 Project, asserting the project was engaged in copyright infringement. The Great 78 Project stores digitized versions of pre-1972 songs and albums from 78rpm phonograph records, for "the preservation, research and discovery of 78rpm records." The project had started in 2016, when pre-1972 recordings had not been protected by copyright; in 2018, the U.S. Congress passed the Music Modernization Act (MMA) which enabled legal remedies for unauthorised use of pre-1972 recordings until 2067, thus effectively covering them with copyright.[217]
UMG and Sony had been the two largest companies in this sector for more than a decade, with respective market shares of 31.8% and 22.1% in 2023.[218] Concord was a rapidly expanding music business closely partnered with UMG since its transformation into Concord Music Group in 2004[219] and backed since at least 2000 by J.P. Morgan.[220] It was the first music company to perform an asset-backedsecuritization, led by Apollo Global Management, in December 2022. Its assets consisted of over 1 million copyrights to music older than 18 months.[221][222] According to its CEO Bob Valentine, Concord derived about 85% of its revenue "from catalog, rather than newly-developed, music". As Valentine stated in his first interview, "The phenomenon of artists' IP has never been more liquid; it is now a real and proven asset class. Investment bankers are focused on it, financiers are financing it, and then there's entities like us, that know how to buy rights, but also know how to manage them and have the relationships to do so."[219] The share of catalog music in total album equivalent consumption in the United States rose from 62.8% to 72.6% between 2019 and 2023.[223]
The publishers are seeking statutory damages for nearly 4,142 songs named in the suit, with a maximum possible fine of $621million.[224] The Internet Archive has argued that the primitive sound quality of the original recordings falls within the doctrine of "fair use" to digitize for preservation, that the number of downloads is so small it has almost no impact on the publishers' revenue, and over 95% of the collection is not readily available anywhere else.[224] The plaintiffs said in response, "if ever there were a theory of fair use invented for litigation, this is it."[225] According to a legal source at Mayer Brown, the music publishers' case could be challenged as unconstitutional, since the granting of copyright to pre-1972 works in the MMA only benefitted record companies without having a systemic effect.[217]
↑ Books imported from Google have a metadata tag of scanner:google for searching purposes. The archive provides a link to Google for PDF copies, but also maintains a local PDF copy, which is viewable under the "All Files: HTTPS" link. As all the other books in the collection, they also provide OCR text and images in open formats, particularly DjVu, which Google Books does not offer.
Related Research Articles
Brewster Lurton Kahle is an American digital librarian, computer engineer, Internet entrepreneur, and advocate of universal access to all knowledge. He received a Bachelor of Science degree in computer science and engineering from the Massachusetts Institute of Technology in 1982. Kahle founded the Internet Archive and co-founded Alexa Internet in 1996. He was inducted into the Internet Hall of Fame in 2012.
Michael Stern Hart was an American author, best known as the inventor of the e-book and the founder of Project Gutenberg (PG), the first project to make e-books freely available via the Internet. He published e-books via ARPANET years before the Internet existed, and later on BBS networks and Gopher servers.
Electronic publishing includes the digital publication of e-books, digital magazines, and the development of digital libraries and catalogues. It also includes the editing of books, journals, and magazines to be posted on a screen.
Alexa Internet, Inc. was a web traffic analysis company based in San Francisco, California. It was founded as an independent company by Brewster Kahle and Bruce Gilliat in 1996. Alexa provided web traffic data, global rankings, and other information on over 30 million websites. It was acquired by Amazon in 1999 for $250 million in stock. Amazon discontinued the Alexa Internet service on May 1, 2022.
The National Library of New Zealand is charged with the obligation to "enrich the cultural and economic life of New Zealand and its interchanges with other nations". Under the Act, the library's duties include collecting, preserving and protecting New Zealand's documentary heritage, supporting other libraries in New Zealand, and collaborating with peer institutions abroad. The library headquarters is on the corner of Aitken and Molesworth Streets in Wellington, close to the New Zealand Parliament Buildings and the Court of Appeal.
The Open Content Alliance (OCA) was a consortium of organizations contributing to a permanent, publicly accessible archive of digitized texts. Its creation was announced in October 2005 by Yahoo!, the Internet Archive, the University of California, the University of Toronto and others. Scanning for the Open Content Alliance was administered by the Internet Archive, which also provided permanent storage and access through its website.
Open Library is an online project intended to create "one web page for every book ever published". Created by Aaron Swartz, Brewster Kahle, Alexis Rossi, Anand Chitipothu, and Rebecca Hargrave Malamud, Open Library is a project of the Internet Archive, a nonprofit organization. It has been funded in part by grants from the California State Library and the Kahle/Austin Foundation. Open Library provides online digital copies in multiple formats, created from images of many public domain, out-of-print, and in-print books.
Google Books is a service from Google that searches the full text of books and magazines that Google has scanned, converted to text using optical character recognition (OCR), and stored in its digital database. Books are provided either by publishers and authors through the Google Books Partner Program, or by Google's library partners through the Library Project. Additionally, Google has partnered with a number of magazine publishers to digitize their archives.
The Michigan Digitization Project is a project in partnership with Google Books to digitize the entire print collection of the University of Michigan Library. The digitized collection is available through the University of Michigan Library catalog, Mirlyn, the HathiTrust Digital Library, and Google Books. Full-text of works that are out of copyright or in the public domain are available.
Scribd Inc. operates three primary platforms: Scribd, Everand, and SlideShare. Scribd is a digital document library that hosts over 195 million documents. Everand is a digital content subscription service offering a wide selection of ebooks, audiobooks, magazines, podcasts, and sheet music. SlideShare is an online platform featuring over 15 million presentations from subject matter experts.
HathiTrust Digital Library is a large-scale collaborative repository of digital content from research libraries including content digitized via Google Books and the Internet Archive digitization initiatives, as well as content digitized locally by libraries.
A digital library is an online database of digital objects that can include text, still images, audio, video, digital documents, or other digital media formats or a library accessible through the internet. Objects can consist of digitized content like print or photographs, as well as originally produced digital content like word processor files or social media posts. In addition to storing content, digital libraries provide means for organizing, searching, and retrieving the content contained in the collection. Digital libraries can vary immensely in size and scope, and can be maintained by individuals or organizations. The digital content may be stored locally, or accessed remotely via computer networks. These information retrieval systems are able to exchange information with each other through interoperability and sustainability.
The Library of Congress (LOC) is a research library in Washington, D.C. that serves as the library and research service of the U.S. Congress and the de facto national library of the United States. It also administers copyright law through the United States Copyright Office.
Authors Guild v. Google 804 F.3d 202 was a copyright case heard in federal court for the Southern District of New York, and then the Second Circuit Court of Appeals between 2005 and 2015. It concerned fair use in copyright law and the transformation of printed copyrighted books into an online searchable database through scanning and digitization. It centered on the legality of the Google Book Search Library Partner project that had been launched in 2003.
The Wayback Machine is a digital archive of the World Wide Web founded by the Internet Archive, an American nonprofit organization based in San Francisco, California. Created in 1996 and launched to the public in 2001, it allows users to go "back in time" to see how websites looked in the past. Its founders, Brewster Kahle and Bruce Gilliat, developed the Wayback Machine to provide "universal access to all knowledge" by preserving archived copies of defunct web pages.
Trove is an Australian online library database owned by the National Library of Australia in which it holds partnerships with source providers National and State Libraries Australia, an aggregator and service which includes full text documents, digital images, bibliographic and holdings data of items which are not available digitally, and a free faceted-search engine as a discovery tool.
The Digital Public Library of America (DPLA) is a US project aimed at providing public access to digital holdings in order to create a large-scale public digital library. It officially launched on April 18, 2013, after two-and-a-half years of development.
The Boston Library Consortium (BLC) is a library consortium based in the Boston area with 26 member institutions across New England.
Controlled digital lending (CDL) is a model by which libraries digitize materials in their collection and make them available for lending. It is based on interpretations of the United States copyright principles of fair use and copyright exhaustion.
Hachette Book Group, Inc. v. Internet Archive, No. 20-cv-4160 (JGK), 664 F.Supp.3d 370, WL 2623787, is a case in which the United States District Court for the Southern District of New York determined that the Internet Archive, a registered library, committed copyright infringement by scanning and lending complete copies of books through controlled digital lending mechanisms. Stemming from the creation of the National Emergency Library (NEL) during the onset of the COVID-19 pandemic, publishing companies Hachette Book Group, Penguin Random House, HarperCollins, and Wiley alleged that the Internet Archive's Open Library and National Emergency Library facilitated copyright infringement. The case primarily concerns the fair use of controlled digital lending (CDL) of complete copies of certain books. The case does not concern the display of short passages, limited page views, search results, books out of copyright or out of print, or books without an ebook version currently for sale.
↑ Hanamura, Wendy (May 30, 2017). "MIT Press Classics Available Soon at Archive.org". blog.archive.org. Retrieved June 27, 2020. For more than eighty years, MIT Press has been publishing acclaimed titles in science, technology, art and architecture. Now, thanks to a new partnership between the Internet Archive and MIT Press, readers will be able to borrow these classics online for the first time.
↑ Freeland, Chris (May 21, 2018). "Internet Archive awarded grant from Arcadia Fund to digitize university press collections". blog.archive.org. Retrieved June 27, 2020. Internet Archive has received a $1 million dollar grant from Arcadia – a charitable fund of Lisbet Rausing and Peter Baldwin – to digitize titles from university press collections to make them available via controlled digital lending.
↑ Library of CongressCopyright Office (November 27, 2006). "Exemption to Prohibition on Circumvention of Copyright Protection Systems for Access Control Technologies". Federal Register. 71 (227): 68472–68480. Archived from the original on November 1, 2007. Retrieved October 21, 2007. Computer programs and video games distributed in formats that have become obsolete and that require the original media or hardware as a condition of access, when circumvention is accomplished for the purpose of preservation or archival reproduction of published digital works by a library or archive. A format shall be considered obsolete if the machine or system necessary to render perceptible a work stored in that format is no longer manufactured or is no longer reasonably available in the commercial marketplace.
↑ Kahle, Brewster; Vernon, Matt (December 1, 2005). "Good News and an Apology: GD on the Internet Archive". Live Music Archive Forum. Internet Archive. Archived from the original on August 6, 2014.Authors and date indicate the first posting in the forum thread.
↑ Butler, Chris (January 27, 2023). "BBC Modi Documentary Removal". Internet Archive. Archived from the original on October 12, 2024. Retrieved January 29, 2023.
This page is based on this Wikipedia article Text is available under the CC BY-SA 4.0 license; additional terms may apply. Images, videos and audio are available under their respective licenses.
$30.5 million (2022) [1] 
