Sneakernet

Last updated

A USB flash drive allows the transfer of data between individuals without use of the Internet. Holding a cruzer 8gb.jpg
A USB flash drive allows the transfer of data between individuals without use of the Internet.
Memory cards are a popular physical medium for transferring files and have become smaller in size as technology has advanced. Memory-card-comparison.jpg
Memory cards are a popular physical medium for transferring files and have become smaller in size as technology has advanced.

Sneakernet, also called sneaker net, is an informal term for the transfer of electronic information by physically moving media such as magnetic tape, floppy disks, optical discs, USB flash drives or external hard drives between computers, rather than transmitting it over a computer network. Sneakernets enable data transfer through physical means and offer a solution in the presence of network connections that lack reliability; however, a consequence of this physical transfer is high latency. [1] The term, a tongue-in-cheek play on net(work) as in Internet or Ethernet , refers to walking in sneakers as the transport mechanism. [2] Alternative terms may be floppy net, train net, or pigeon net.

Contents

Summary and background

Compact cassettes were a natural way of transferring data between ZX Spectrum systems in the 1980s and 1990s. Sinclair computer (ZX Spectrum), met adaptor, vier boeken en zeven cassettes met spelletjes, objectnr 77523-1-14.JPG
Compact cassettes were a natural way of transferring data between ZX Spectrum systems in the 1980s and 1990s.

Sneakernets are in use throughout the computer universe. A sneakernet may be used when computer networks are prohibitively expensive for the owner to maintain; in high-security environments where manual inspection (for re-classification of information) is necessary; where information needs to be shared between networks with different levels of security clearance; when data transfer is impractical due to bandwidth limitations; when a particular system is simply incompatible with the local network, unable to be connected, or when two systems are not on the same network at the same time. Because sneakernets take advantage of physical media, security measures used for the transfer of sensitive information are respectively physical.

This form of data transfer is also used for peer-to-peer (or friend-to-friend) file sharing and has grown in popularity in metropolitan areas and college communities. The ease of this system has been facilitated by the availability of USB external hard drives, USB flash drives and portable music players. [3]

The United States Postal Service offers a Media Mail service for compact discs, among other items. This provides a viable mode of transport for long distance sneakernet use. In fact, when mailing media with sufficiently high data density such as high capacity hard drives, the throughput (data transferred per unit of time) as well as the cost per unit of data transferred may compete favorably with networked methods of data transfer. [4]

Usage examples

Afghanistan

In 2021 Taliban-governed Afghanistan, "computer kars" distribute Internet-derived content by hand: "Movies, music, mobile applications, iOS updates, and naughty videos. Also creating Apple IDs and social media accounts, and backing up and unlocking phones and recovering data." The kars collectively maintain an archive of hundreds of terabytes of data. Four terabytes of the latest Indian or American movies or Turkish TV dramas, dubbed in the Afghan national languages Dari and Pashto reportedly wholesale for about 800 afghanis, or nine US dollars, while the retail price of five gigabytes of content is 100 afghanis, or one US dollar. Kars report that their earnings have dropped 90% under Taliban rule. [5]

Australia

When Australia joined Usenet in 1983, it received articles via tapes sent from the United States to the University of Sydney, which disseminated data to dozens of other computers on the country's Unix network. [6]

Bhutan

The Rigsum Sherig Collection project [7] uses a sneakernet to distribute offline educational resources, including Kiwix and Khan Academy on a Stick, [8] to hundreds of schools and other educational institutions in the Kingdom of Bhutan. Many of the schools in Bhutan have computers or IT labs, but no Internet connection (or a very slow one). [9] The sneakernet, facilitated by teachers, distributes about 25 GB of free, open-source educational software to the schools, often using external hard disks.

Cuba

El Paquete Semanal is a roughly 1TB compilation of media, distributed weekly throughout Cuba via portable hard drives and USB memory sticks. [10]

Iran

A weekly data dump compilation collected through the satellite system Toosheh.

North Korea

North Korean dissidents have been known to smuggle flash drives filled with western movies and television shows. [11] [12] [13] [14] [15]

Pakistan

The May 2011 raid of Osama bin Laden's compound in Abbottabad, Pakistan, revealed that he used a series of USB thumb drives to store his email drafts. A courier of his would then take the saved emails to a nearby Internet cafe and send them out to the desired recipients. [16] [17]

South Africa

In September 2009, Durban company Unlimited IT reportedly pitted a messenger pigeon against South African ISP Telkom to transfer 4 GB of data 60 miles (97 km) from Howick to Durban. The pigeon, carrying the data on a memory stick, arrived in one hour eight minutes, with the data taking another hour to read from the memory stick. During the same two-hour period, only about 4.2% of the data had been transferred over the ADSL link. [18] A similar experiment was conducted in England in September 2010; the "pigeonnet" also proved superior. [19] [20] In November 2009 the Australian comedy/current-affairs television program Hungry Beast repeated this experiment. The experiment had the team transfer a 700 MB file via three delivery methods to determine which was the fastest; A carrier pigeon with a microSD card, a car carrying a USB Stick, or a Telstra ADSL line. The data was to be transferred a distance of 132 km by road. The pigeon won the race with a time of approximately 1 hour 5 minutes, the car came in second at 2 hours 10 minutes, while the internet transfer did not finish, having dropped out a second time and not come back. [21]

Wizzy Digital Courier provided Internet access to schools in South Africa with poor or no network connectivity by implementing UUCP on USB memory sticks. This allowed offline cached email transport and scoops of web pages to back-fill a web cache. [22]

United States

Google has used a sneakernet to transport large datasets, including 120 TB of data from the Hubble Space Telescope. [23] [24] Users of Google Cloud can import their data into Google Cloud Storage through sneakernet. [25]

Oracle similarly offers its Data Transfer Service to customers to migrate data to Oracle Cloud Infrastructure or export data from it. [26]

The SETI@home project uses a sneakernet to overcome bandwidth limitations: data recorded by the radio telescope in Arecibo, Puerto Rico was stored on magnetic tapes which were then shipped to Berkeley, California, for processing. In 2005, Jim Gray reported sending hard drives and even "metal boxes with processors" to transport large amounts of data by postal mail. [27]

Very Long Baseline Interferometry performed using the Very Long Baseline Array ships hard drives to a data reduction site in Socorro, New Mexico. They refer to their data transfer mechanism as "HDOA" (Hard Drives On Airplane).

Data analytics teams in the financial services sector often use sneakernets to transfer sensitive corporate information and information obtained from data mining, such as ledger entries, customer data and financial statistics. There are several reasons for this: firstly, sneakernets can generally provide very high security (and possibly more importantly, they are perceived to be secure) due to the impossibility of a man-in-the-middle attack or packet sniffing; secondly, the volumes of data concerned are often extremely high; and thirdly, setting up secure network links between the client business and the analytics team's facilities is often either impossible or an extremely convoluted process.

In 2015 Amazon Web Services launched AWS Snowball, a 50 lb (23 kg), 50 TB device for transporting data to the AWS cloud; [28] and in 2016 AWS Snowmobile, a truck to transport up to 100 PB of data in one load. [29] For similar reasons, there is also a Google Transfer Appliance, an IBM Cloud Mass Data Migration device, [30] and Microsoft's Azure Data Box Disk service. [31]

Observation data from the Event Horizon Telescope is collected on hard drives which are transported by commercial freight airplanes [32] from the various telescopes to the MIT Haystack Observatory and the Max Planck Institute for Radio Astronomy, where the data is analyzed. [33]

USSR

In later USSR, the operating system called DEMOS was created and adapted for many types of Soviet computers by cloning versions of UNIX that were brought into USSR on magnetic tapes bypassing the Iron Curtain. This allowed to build Relcom country-wide UUCP network to provide global Usenet access for Soviet users which led to the registration of .su ("Soviet Union") top level domain in 1990.

In media

Non-fiction

There's a lot of band-width in a station wagon.

Fred Gruenberger, Computing: A Second Course [34]

The first USENET citation is July 16, 1985,[ citation needed ] and it was widely considered an old joke already.[ clarification needed ]

Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway.

Other alleged speakers included Tom Reidel, Warren Jackson, or Bob Sutterfield.

Although the station wagon transporting magnetic tapes is generally considered the canonical version, variants using trucks or Boeing 747s or C-5s and later storage technologies such as CD-ROMs, DVDs, Blu-rays, or SD Cards [36] have frequently appeared.

The very first problem in Andrew S. Tanenbaum's 1981 textbook Computer Networks asks the student to calculate the bandwidth of a St. Bernard carrying floppy disks. [37]

Fiction

Similar concepts

See also

Related Research Articles

<span class="mw-page-title-main">SCSI</span> Set of computer and peripheral connection standards

Small Computer System Interface is a set of standards for physically connecting and transferring data between computers and peripheral devices, best known for its use with storage devices such as hard disk drives. SCSI was introduced in the 1980s and has seen widespread use on servers and high-end workstations, with new SCSI standards being published as recently as SAS-4 in 2017.

<span class="mw-page-title-main">Tape drive</span> Data storage device

A tape drive is a data storage device that reads and writes data on a magnetic tape. Magnetic-tape data storage is typically used for offline, archival data storage. Tape media generally has a favorable unit cost and a long archival stability.

<span class="mw-page-title-main">USB</span> Standard for computer data connections

Universal Serial Bus (USB) is an industry standard that allows data exchange and delivery of power between many various types of electronics. It specifies its architecture, in particular its physical interface, and communication protocols for data transfer and power delivery to and from hosts, such as personal computers, to and from peripheral devices, e.g. displays, keyboards, and mass storage devices, and to and from intermediate hubs, which multiply the number of a host's ports.

<span class="mw-page-title-main">IP over Avian Carriers</span> Proposal to carry IP traffic by birds

In computer networking, IP over Avian Carriers (IPoAC) is a joke proposal to carry Internet Protocol (IP) traffic by birds such as homing pigeons. IP over Avian Carriers was initially described in RFC 1149 issued by the Internet Engineering Task Force, written by David Waitzman, and released on April 1, 1990. It is one of several April Fools' Day Request for Comments.

<span class="mw-page-title-main">News server</span> Type of server software

A news server is a collection of software used to handle Usenet articles. It may also refer to a computer itself which is primarily or solely used for handling Usenet. Access to Usenet is only available through news server providers.

The Network News Transfer Protocol (NNTP) is an application protocol used for transporting Usenet news articles (netnews) between news servers, and for reading/posting articles by the end user client applications. Brian Kantor of the University of California, San Diego, and Phil Lapsley of the University of California, Berkeley, wrote RFC 977, the specification for the Network News Transfer Protocol, in March 1986. Other contributors included Stan O. Barber from the Baylor College of Medicine and Erik Fair of Apple Computer.

UUCP is a suite of computer programs and protocols allowing remote execution of commands and transfer of files, email and netnews between computers.

In computing, a removable media is a data storage media that is designed to be readily inserted and removed from a system. Most early removable media, such as floppy disks and optical discs, require a dedicated read/write device to be installed in the computer, while others, such as USB flash drives, are plug-and-play with all the hardware required to read them built into the device, so only need a driver software to be installed in order to communicate with the device. Some removable media readers/drives are integrated into the computer case, while others are standalone devices that need to be additionally installed or connected.

<span class="mw-page-title-main">USB flash drive</span> Data storage device

A flash drive is a data storage device that includes flash memory with an integrated USB interface. A typical USB drive is removable, rewritable, and smaller than an optical disc, and usually weighs less than 30 g (1 oz). Since first offered for sale in late 2000, the storage capacities of USB drives range from 8 to 256 gigabytes (GB), 512 GB and 1 terabyte (TB). As of 2023, 2 TB flash drives were the largest currently in production. Some allow up to 100,000 write/erase cycles, depending on the exact type of memory chip used, and are thought to physically last between 10 and 100 years under normal circumstances.

File synchronization in computing is the process of ensuring that computer files in two or more locations are updated via certain rules.

A virtual tape library (VTL) is a data storage virtualization technology used typically for backup and recovery purposes. A VTL presents a storage component as tape libraries or tape drives for use with existing backup software.

In computing, external storage refers to non-volatile (secondary) data storage outside a computer's own internal hardware, and thus can be readily disconnected and accessed elsewhere. Such storage devices may refer to removable media, compact flash drives, portable storage devices, or network-attached storage. Web-based cloud storage is the latest technology for external storage.

An air gap, air wall, air gapping or disconnected network is a network security measure employed on one or more computers to ensure that a secure computer network is physically isolated from unsecured networks, such as the public Internet or an unsecured local area network. It means a computer or network has no network interface controllers connected to other networks, with a physical or conceptual air gap, analogous to the air gap used in plumbing to maintain water quality.

<span class="mw-page-title-main">Usenet</span> Worldwide computer-based distributed discussion system

Usenet, USENET, or, "in full", User's Network, is a worldwide distributed discussion system available on computers. It was developed from the general-purpose Unix-to-Unix Copy (UUCP) dial-up network architecture. Tom Truscott and Jim Ellis conceived the idea in 1979, and it was established in 1980. Users read and post messages to one or more topic categories, known as newsgroups. Usenet resembles a bulletin board system (BBS) in many respects and is the precursor to the Internet forums that have become widely used. Discussions are threaded, as with web forums and BBSes, though posts are stored on the server sequentially.

This is a comparison of online backup services.

Sideloading describes the process of transferring files between two local devices, in particular between a personal computer and a mobile device such as a mobile phone, smartphone, PDA, tablet, portable media player or e-reader.

<span class="mw-page-title-main">USB dead drop</span> USB device installed in a public space

A USB dead drop is a USB mass storage device installed in a public space. For example, a USB flash drive might be mounted in an outdoor brick wall and fixed in place with fast concrete. Members of the public are implicitly invited to find files, or leave files, on a dead drop by directly plugging their laptop into the wall-mounted USB stick in order to transfer data. The dead drops can therefore be regarded as an anonymous, offline, peer-to-peer file sharing network. In practice, USB dead drops are more often used for social or artistic reasons, rather than practical ones.

Amazon S3 Glacier is an online file storage web service that provides storage for data archiving and backup.

In computer storage, cold data refers to data that is rarely accessed, therefore considered "cold".

References

  1. Jaya, Andika Candra; Safitri, Cutifa; Mandala, Rila (December 16, 2020). "Sneakernet: A Technological Overview and Improvement". 2020 IEEE International Conference on Sustainable Engineering and Creative Computing (ICSECC). IEEE. pp. 287–291. doi:10.1109/icsecc51444.2020.9557509. ISBN   978-1-7281-7588-1.
  2. "sneakernet". Oxford Dictionary. Archived from the original on November 19, 2015. Retrieved September 9, 2016.
  3. Boutin, Paul (August 26, 2002). "Sneakernet Redux: Walk Your Data". Wired News . Archived from the original on November 19, 2009. Retrieved June 8, 2010.
  4. Munroe, Randall (February 8, 2013). "FedEx Bandwidth". xkcd what if?. Archived from the original on February 8, 2013. Retrieved September 18, 2019.
  5. Kumar, Ruchi (November 26, 2021). "Can Afghanistan's underground "sneakernet" survive the Taliban?". MIT Technology Review. Retrieved November 26, 2021.
  6. Marquis, Bret (March 29, 1983). "Australia joins USENET". Newsgroup:  net.news.newsite. 467@sdchema.UUCP. Retrieved February 14, 2016.
  7. "Rigsum Sherig Collection". rigsum-it.com. Retrieved August 8, 2023.
  8. "Khan Academy on a Stick". mujica.org. Retrieved August 8, 2023.
  9. "Only a Third of Government Schools Have Internet Access". Kuensel. April 18, 2013. Archived from the original on June 15, 2013.
  10. Kessler, Sarah (July 7, 2015). "In Cuba, An Underground Network Armed With USB Drives Does The Work Of Google And YouTube". Fast Company . Retrieved August 8, 2023.
  11. "Fighting The State, Without The Web: North Korea's Sneakernet Insurgency".
  12. Greenberg, Andy (March 1, 2015). "The Plot to Free North Korea with Smuggled Episodes of 'Friends'". Wired.
  13. "How One Man Wants to Free North Korea With USB Drives and Pirated Movies". Gizmodo. March 2, 2015.
  14. Crocker, Lizzie (December 22, 2014). "North Korea's Secret Movie Bootleggers: How Western Films Make It Into the Hermit Kingdom". The Daily Beast.
  15. "Balloon activist sends 'thousands of copies' of The Interview to North Korea". The Guardian. Agence France-Presse. April 8, 2015.
  16. Apuzzo, Matt; Goldman, Adam (May 13, 2011). "How bin Laden emailed without being detected by US". The Washington Times. Associated Press. Retrieved June 29, 2012.
  17. McCullagh, Declan (May 13, 2011). "How bin Laden evaded the NSA: Sneakernet". Privacy Inc. CNET . Retrieved May 17, 2011.
  18. "SA Pigeon 'Faster than broadband'". BBC News. September 10, 2009.
  19. "BT feathers ruffled over pigeon-based file transfer caper". The Register . September 17, 2010.
  20. Pigeon flies past broadband in data speed race, BBC News Technology, September 16, 2010
  21. "The Great Australian Internet Challenge". ABC Television/Hungry Beast. November 10, 2009.
  22. Lindow, Megan (April 23, 2004). "Seeking Riches From the Poor". Wired.
  23. "Google helps terabyte data swaps". BBC News. March 7, 2007. Retrieved May 23, 2010.
  24. Farivar, Cyrus (March 20, 2007). "Google's Next-Gen of Sneakernet". Wired . Retrieved February 5, 2013.
  25. "Offline Media Import / Export". Google Cloud. Archived from the original on July 15, 2019. Retrieved January 29, 2016.{{cite web}}: CS1 maint: unfit URL (link)
  26. "Overview of Data Transfer Service" . Retrieved April 30, 2021.
  27. "A Conversation with Jim Gray". ACM Queue . 1 (4). July 31, 2003. Archived from the original on December 5, 2009. Who would ever, in this time of the greatest interconnectivity in human history, go back to shipping bytes around via snail mail as a preferred means of data transfer?
  28. Kastrenakes, Jacob (October 7, 2015). "Amazon made a huge plastic box called Snowball so people can ship data to the cloud". The Verge . Retrieved October 8, 2015.
  29. Dignan, Larry (November 30, 2016). "AWS' Snowmobile data transport truck highlights why cloud giant is so damn disruptive".
  30. Sharwood, Simon (September 19, 2017). "IBM packs 120TB into a carry-on bag, for snow-balling cloud uploads". The Register . Retrieved September 19, 2017.
  31. "What is Azure Data Box?". Microsoft Learn. July 26, 2022.
  32. "The Hidden Shipping and Handling Behind That Black-Hole Picture". The Atlantic . April 13, 2019. Retrieved April 14, 2019.
  33. Mearian, Lucas (August 18, 2015). "Massive telescope array aims for black hole, gets gusher of data". Computerworld. Retrieved August 21, 2015.
  34. Gruenberger, Fred (1971). Computing: A Second Course. San Francisco: Canfield Press. p. 138. ISBN   978-0063834057 . Retrieved January 24, 2017.
  35. Tanenbaum, Andrew S. (1989). Computer Networks. New Jersey: Prentice-Hall. p.  57. ISBN   0-13-166836-6.
  36. "Fedex Bandwidths" . Retrieved April 18, 2023.
  37. "Updated Textbook Explores Theoretical Basis of Networks". InfoWorld. February 6, 1989. Retrieved April 16, 2019.
  38. Poole, Steven (August 18, 2007). "Sign language". The Guardian . London. Retrieved September 24, 2009.
  39. Ben Hui (March 1, 2006). "Haggle". University of Cambridge Computer Laboratory. Archived from the original on June 28, 2015.