Archive.today

Last updated

archive.today
Archive.is-Screenshot.png
Screenshot of the archive.today home page
Type of site
Web archiving
Available in Multilingual
URL
RegistrationNo
LaunchedMay 16, 2012;10 years ago (2012-05-16) [1] [2]

archive.today (or archive.is) is a web archiving site, founded in 2012, that saves snapshots on demand, and has support for JavaScript-heavy sites such as Google Maps and progressive web apps such as Twitter. [3] archive.today records two snapshots: one replicates the original webpage including any functional live links; the other is a screenshot of the page. [4]

Contents

Features

Functionality

archive.today can capture individual pages in response to explicit user requests. [5] [6] [7] Since its beginning, archive.today has supported crawling pages with URLs containing the now-deprecated hash-bang fragment (#!). [8]

archive.today records only text and images, excluding XML, RTF, spreadsheet (xls or ods) and other non-static content. However, videos for certain sites, like Twitter, are saved. [9] It keeps track of the history of snapshots saved, requesting confirmation before adding a new snapshot of an already saved page. [10] [11]

Pages are captured at a browser width of 1,024 pixels. CSS is converted to inline CSS, removing responsive web design and selectors such as :hover and :active. Content generated using JavaScript during the crawling process appears in a frozen state. [12] HTML class names are preserved inside the old-class attribute. When text is selected, a JavaScript applet generates a URL fragment seen in the browser's address bar that automatically highlights that portion of the text when visited again.

Web pages cannot be duplicated from archive.today to web.archive.org as second-level backup, as archive.today places an exclusion for Wayback Machine and does not save its snapshots in WARC format. The reverse—from web.archive.org to archive.today—is possible, [13] but the copy usually takes more time than a direct capture. Some web sites get deleted from Internet Archive's listings retroactively or blocked from being saved due to their robots.txt file, but archive.today does not use this. [14]

The research toolbar enables advanced keywords operators, using * as the wildcard character. A couple of quotation marks address the search to an exact sequence of keywords present in the title or in the body of the webpage, whereas the insite operator restricts it to a specific Internet domain. [15]

Once a web page is archived, it cannot be deleted directly by any Internet user. [16] Removing advertisements, popups or expanding links from archived pages is possible by asking the owner to do it on his blog. [17]

While saving a dynamic list, archive.today searchbox shows only a result that links the previous and the following section of the list (e.g. 20 links for page). [18] The other web pages saved are filtered, and sometimes may be found by one of their occurrences. [19] [ clarification needed ]

The search feature is backed by Google CustomSearch. If it delivers no results, archive.today attempts to utilize Yandex Search. [20]

While saving a page, a list of URLs for individual page elements and their content sizes, HTTP statuses and MIME types is shown. This list can only be viewed during the crawling process.

One can download archived pages as a ZIP file, except pages archived since 29 November 2019, when archive.today changed their browser engine from PhantomJS to Chromium. [21]

Since July 2013, archive.today supports the API of the Memento Project. [22] [23]

History

archive.today was founded in 2012. The site originally branded itself as archive.today, but in May 2015, changed the primary mirror to archive.is. [24]

In January 2019, it began to deprecate the archive.is domain in favor of the archive.today mirror. [25]

Worldwide availability

Australia

In March 2019, the site was blocked for six months by several Australian internet providers in the aftermath of the Christchurch mosque shootings in an attempt to limit distribution of the footage of the attack. [26] [27] It has since been unblocked.

China

According to GreatFire.org, archive.today has been blocked in China since March 2016, [28] archive.li since September 2017, [29] archive.fo since July 2018, [30] as well as archive.ph since December 2019. [31]

Finland

On 21 July 2015, the operators blocked access to the service from all Finnish IP addresses, stating on Twitter that they did this in order to avoid escalating a dispute they allegedly had with the Finnish government. [32] It has since been unblocked.

Russia

In Russia, only HTTP access is possible; HTTPS connections are blocked. [33] [34]

Cloudflare DNS availability

As of May 2018, it has not been possible to reach the site when using Cloudflare's 1.1.1.1 DNS service. [35] Cloudflare staff have stated that the problem is on the end of archive.today, as its authoritative nameservers return invalid records when queried from within Cloudflare's network because archive.today returns invalid data to DNS requests coming via Cloudflare's DNS servers. archive.today's reasoning for this is the fact Cloudflare does not send EDNS Client Subnet information in its DNS requests. [36] [37]

See also

Related Research Articles

<span class="mw-page-title-main">JavaScript</span> High-level programming language

JavaScript, often abbreviated as JS, is a programming language that is one of the core technologies of the World Wide Web, alongside HTML and CSS. As of 2022, 98% of websites use JavaScript on the client side for webpage behavior, often incorporating third-party libraries. All major web browsers have a dedicated JavaScript engine to execute the code on users' devices.

<span class="mw-page-title-main">World Wide Web</span> System of interlinked hypertext documents accessed over the Internet

The World Wide Web (WWW), commonly known as the Web, is an information system enabling documents and other web resources to be accessed over the Internet.

<span class="mw-page-title-main">Firefox</span> Free and open-source web browser by Mozilla

Mozilla Firefox, or simply Firefox, is a free and open-source web browser developed by the Mozilla Foundation and its subsidiary, the Mozilla Corporation. It uses the Gecko rendering engine to display web pages, which implements current and anticipated web standards. In November 2017, Firefox began incorporating new technology under the code name Quantum to promote parallelism and a more intuitive user interface. Firefox is available for Windows 7 and later versions, macOS, and Linux. Its unofficial ports are available for various Unix and Unix-like operating systems, including FreeBSD, OpenBSD, NetBSD, illumos, and Solaris Unix. It is also available for Android and iOS. However, as with all other iOS web browsers, the iOS version uses the WebKit layout engine instead of Gecko due to platform requirements. An optimized version is also available on the Amazon Fire TV, as one of the two main browsers available with Amazon's Silk Browser.

<span class="mw-page-title-main">Content delivery network</span> Layer in the internet ecosystem addressing bottlenecks

A content delivery network, or content distribution network (CDN), is a geographically distributed network of proxy servers and their data centers. The goal is to provide high availability and performance by distributing the service spatially relative to end users. CDNs came into existence in the late 1990s as a means for alleviating the performance bottlenecks of the Internet as the Internet was starting to become a mission-critical medium for people and enterprises. Since then, CDNs have grown to serve a large portion of the Internet content today, including web objects, downloadable objects, applications, live streaming media, on-demand streaming media, and social media sites.

Ad blocking or ad filtering is a software capability for blocking or altering online advertising in a web browser, an application or a network. This may be done using browser extensions or other methods.

<span class="mw-page-title-main">Usage share of web browsers</span> Relative market adoption of web browsers

The usage share of web browsers is the portion, often expressed as a percentage, of visitors to a group of web sites that use a particular web browser.

NoScript is a free software extension for Mozilla Firefox, SeaMonkey, other Mozilla-based web browsers and Google Chrome, written and maintained by Giorgio Maone, an Italian software developer and member of the Mozilla Security Group.

<span class="mw-page-title-main">HTTP cookie</span> Small pieces of data stored by a web browser while on a website

HTTP cookies are small blocks of data created by a web server while a user is browsing a website and placed on the user's computer or other device by the user's web browser. Cookies are placed on the device used to access a website, and more than one cookie may be placed on a user's device during a session.

WebCite was an on-demand archive site, designed to digitally preserve scientific and educationally important material on the web by taking snapshots of Internet contents as they existed at the time when a blogger or a scholar cited or quoted from it. The preservation service enabled verifiability of claims supported by the cited sources even when the original web pages are being revised, removed, or disappear for other reasons, an effect known as link rot.

jQuery is a JavaScript library designed to simplify HTML DOM tree traversal and manipulation, as well as event handling, CSS animation, and Ajax. It is free, open-source software using the permissive MIT License. As of Aug 2022, jQuery is used by 77% of the 10 million most popular websites. Web analysis indicates that it is the most widely deployed JavaScript library by a large margin, having at least 3 to 4 times more usage than any other JavaScript library.

DNS rebinding is a method of manipulating resolution of domain names that is commonly used as a form of computer attack. In this attack, a malicious web page causes visitors to run a client-side script that attacks machines elsewhere on the network. In theory, the same-origin policy prevents this from happening: client-side scripts are only allowed to access content on the same host that served the script. Comparing domain names is an essential part of enforcing this policy, so DNS rebinding circumvents this protection by abusing the Domain Name System (DNS).

<span class="mw-page-title-main">Google Chrome</span> Web browser developed by Google

Google Chrome is a cross-platform web browser developed by Google. It was first released in 2008 for Microsoft Windows, built with free software components from Apple WebKit and Mozilla Firefox. It was later ported to Linux, macOS, iOS, and Android, where it is the default browser. The browser is also the main component of ChromeOS, where it serves as the platform for web applications.

<span class="mw-page-title-main">Wayback Machine</span> Digital archive founded by the Internet Archive

The Wayback Machine is a digital archive of the World Wide Web founded by the Internet Archive, a nonprofit based in San Francisco, California. Created in 1996 and launched to the public in 2001, it allows the user to go "back in time" and see how websites looked in the past. Its founders, Brewster Kahle and Bruce Gilliat, developed the Wayback Machine to provide "universal access to all knowledge" by preserving archived copies of defunct web pages.

<span class="mw-page-title-main">Cloudflare</span> American technology company

Cloudflare, Inc. is an American content delivery network and DDoS mitigation company, founded in 2010. It primarily acts as a reverse proxy between a website's visitor and the Cloudflare customer's hosting provider. Its headquarters are in San Francisco, California. According to The Hill, it is used by more than 20 percent of the entire Internet for its web security services.

Internet censorship circumvention is the use of various methods and tools to bypass internet censorship.

cdnjs Content delivery network for web resources

cdnjs is a free and open-source software (FOSS) content delivery network (CDN) hosted by Cloudflare. As of May 2021, it serves 4,013 JavaScript and CSS libraries, which are stored publicly on GitHub. It is included in millions of websites, or 12.4% of the websites on the Internet, making it the second most popular CDN for JavaScript.

DNS over HTTPS (DoH) is a protocol for performing remote Domain Name System (DNS) resolution via the HTTPS protocol. A goal of the method is to increase user privacy and security by preventing eavesdropping and manipulation of DNS data by man-in-the-middle attacks by using the HTTPS protocol to encrypt the data between the DoH client and the DoH-based DNS resolver. By March 2018, Google and the Mozilla Foundation had started testing versions of DNS over HTTPS. In February 2020, Firefox switched to DNS over HTTPS by default for users in the United States.

EDNS Client Subnet (ECS) is an option in the Extension Mechanisms for DNS that allows a recursive DNS resolver to specify the subnetwork for the host or client on whose behalf it is making a DNS query. This is generally intended to help speed up the delivery of data from content delivery networks, by allowing better use of DNS-based load balancing to select a service address near the client when the client computer is not necessarily near the recursive resolver.

DNS over TLS (DoT) is a network security protocol for encrypting and wrapping Domain Name System (DNS) queries and answers via the Transport Layer Security (TLS) protocol. The goal of the method is to increase user privacy and security by preventing eavesdropping and manipulation of DNS data via man-in-the-middle attacks. The well-known port number for DoT is 853.

1.1.1.1 is a free Domain Name System (DNS) service by American company Cloudflare in partnership with APNIC. The service functions as a recursive name server providing domain name resolution for any host on the Internet. The service was announced on April 1, 2018. On November 11, 2018, Cloudflare announced a mobile application of their 1.1.1.1 service for Android and iOS. On September 25, 2019, Cloudflare released WARP, an upgraded version of their original 1.1.1.1 mobile application.

References

  1. Archive.is blog—When did the Archive-is site originally launch? at archive.today(archived 20 March 2021)
  2. Archive.is — Викиреальность at archive.today(archived 29 April 2021)
  3. Brinkmann, Martin (22 April 2015). "Create publicly available web page archives with Archive.is". Ghacks . Archived from the original on 12 April 2019. Retrieved 13 June 2015.
  4. Brunelle, Justin F.; Kelly, Mat; Weigle, Michele C.; Nelson, Michael L. (25 January 2015). "The impact of JavaScript on archivability" (PDF). International Journal on Digital Libraries. 17 (2): 95–117. doi:10.1007/s00799-015-0140-8. S2CID   8433375. Archived (PDF) from the original on 27 May 2019.
  5. Dascalescu, Dan (18 February 2013). "Web page archiving – Dan Dascalescu's Wiki (review)". Wiki.dandascalescu.com. Archived from the original on 22 September 2013. Retrieved 3 October 2013.
  6. Koebler, Jason (29 October 2014). "Dear GamerGate: Please Stop Stealing Our Shit". Motherboard . Archived from the original on 27 May 2019. Retrieved 22 March 2017. There is no way for a website to protect itself from having an Archive.today user mirror the site.
  7. "archive.is/faq". archive.is. Retrieved 15 February 2019.
  8. "Home page of Archive.is in 2013". Archived from the original on 12 January 2013.
  9. "Archive.today blog". Archived from the original on 7 September 2021.
  10. Archiving Websites with the Archive.is , retrieved 27 January 2022
  11. "Example snapshot history on archive.is".
  12. JavaScript-generated loading animation of Dailymotion video appearing in a frozen state
  13. "Example: Page saved from Web Archive to Archive.is" (in Spanish). Archived from the original on 20 May 2013. Retrieved 23 October 2019.
  14. "Archive.today FAQ". archive.ph.{{cite web}}: CS1 maint: url-status (link)
  15. For example, the string insite: https://en.wikipedia.org "World Cup" returns the "World+Cup"/ related snapshots
  16. "Some Frequently Asked Question" (blog). archive.is. 24 January 2013. Archived from the original on 26 September 2013. Retrieved 12 November 2018.
  17. "Example user request on the Archive.is blog". Archive.is blog. Retrieved 7 April 2022.
  18. "Example of dynamic list". WorldCat.org.
  19. Archiving Websites with the Archive.is , retrieved 27 January 2022
  20. "Just realized that I can search for keywords in the search bar for archive today, was this a recently added feature?". Archive.is blog. Retrieved 27 January 2022.
  21. "Archive.is blog". 17 July 2020. Archived from the original on 3 October 2020.
  22. Nelson, Michael L. (9 July 2013). "Archive.is Supports Memento". Research and Teaching Updates. Web Science and Digital Libraries Research Group at Old Dominion University. Archived from the original on 27 July 2013. Retrieved 17 September 2013.
  23. "archive.is". Memento Protocol Information. Memento Development Group. Archived from the original on 15 September 2013. Retrieved 17 September 2013.
  24. "Why did you change the URL back from archive-today to archive-is?". Archive.is Blog. 3 May 2015. Archived from the original on 1 June 2015. Retrieved 6 January 2019.
  25. @archiveis (4 January 2019). "Please do not use archive.IS mirror for linking, use others mirrors [.TODAY .FO .LI .VN .MD .PH]. .IS might stop working soon" (Tweet). Archived from the original on 6 January 2019 via Twitter.
  26. "ISPs in AU and NZ start censoring the internet without legal precedent". Private Internet Access. 19 March 2019. Retrieved 20 March 2019.
  27. "New Zealand ISPs Say They're Blocking Sites That Fail To Remove Christchurch Shooting Video". Gizmodo Australia . 19 March 2019. Archived from the original on 18 May 2019. Retrieved 20 March 2019.
  28. "archive.is is 100% blocked in China". GreatFire Analyzer. 12 August 2018. Archived from the original on 12 August 2018.
  29. "archive.li is 100% blocked in China". Great Fire Analyzer. 12 August 2018. Archived from the original on 12 August 2018.
  30. "archive.fo is 100% blocked in China". Great Fire Analyzer. 12 August 2018. Archived from the original on 12 August 2018.
  31. "archive.ph is 100% blocked in China". en.greatfire.org. Retrieved 7 April 2022.
  32. Lapintie, Lassi (22 July 2015). "Suomalaisilta estettiin haktivistien suosimalla verkkosivulla käynti" [Finns' access to website used by hacktivists blocked]. Iltalehti (in Finnish). Archived from the original on 27 May 2019. Retrieved 4 March 2016.
  33. Elistratov, Vladimir (29 January 2016). "Roskomnadzor zablokiroval servis archive.is, khranyashchiy kopii veb-saytov" Роскомнадзор заблокировал сервис archive.is, хранящий копии веб-сайтов. TJournal (in Russian). Archived from the original on 30 August 2017. Retrieved 30 January 2016.
  34. Cushing, Tim (4 February 2016). "Russia Blocks Another Archive Site Because It Might Contain Old Pages About Drugs". Techdirt . Archived from the original on 23 March 2019. Retrieved 26 February 2016.
  35. "Archive.is - Error 1001". Cloudflare Community. 15 May 2018. Retrieved 2 December 2021.
  36. @archiveis (16 July 2018). ""Having to do" is not so direct here. Absence of EDNS and massive mismatch (not only on AS/Country, but even on the continent level) of where DNS and related HTTP requests come from causes so many troubles so I consider EDNS-less requests from Cloudflare as invalid" (Tweet) via Twitter.
  37. "Comment by Matthew Prince on Hacker News". Hacker News. 4 May 2019. Archived from the original on 13 May 2022. Retrieved 4 October 2021.