Alluvium (peercasting)

Last updated

Alluvium is open source peercasting software developed by the Foundation for Decentralization Research, first released in 2003. It comprises three components, Core, Media Player, and Server. Alluvium allows video and audio programming to be broadcast over the Internet using swarming technology. It is powered by Onion Networks' Swarmcast, and is notable for its incorporation of server-side time-based playlists, and client software which examines those playlists and begins streaming content from the server(and available peers) per that schedule, simplifying the creation of continuous-broadcast video and audio.

Contents

Technical overview

Alluvium is a technology for low-cost streaming media broadcasts. It differs in method from server-to-client streaming servers such as icecast, Real Server, and QuickTime Streaming Server. It requires only a standard web server and client software. No additional modules or CGI scripts are required for its operation.

Requirements

Web Server

The web server handles static files: content, and the playlist(s). The Alluvium playlist file is a text file, residing on the web server, written in the Alluvium playlist format, which is based on the RSS 1.0 news format. The playlist file specifies the play order of URLs that can be hosted anywhere on the web. All RSS tags used are standard tags from existing schemas. An Alluvium playlist file can be generated using the Broadcaster playlist generation tool.

The web server is configured to deliver Alluvium playlists with MIME type Content-Type: application/x-alluvium for files with the extension .rss

Client software

The client software, running on each listener's computer, scans through a playlist file until it finds an entry which is scheduled for the current time, then fetches that media. Files are downloaded using the Open Content Network (OCN) utilizing Swarmcast swarming download technology. After the first file download has started, the client immediately sends it to a locally generated icecast-compatible stream. The client's media player can then be directed to the local stream and listen to it exactly as though it was a normal icecast stream.

Swarming download operation

The client software first checks with the OCN gateway, which stores special headers for all of the files being distributed through the OCN. If the gateway doesn't know about a particular URL, it will fetch the necessary information from the URL and then cache it. The information stored by the gateway contains information needed to swarm download the file such as a hashtree.

Among the information obtained by the client from the gateway is a list of addresses for other clients who are also downloading or have recently downloaded the file. Clients download multiple parts of the file simultaneously from each other. When a certain part of the file is unavailable from other clients, a client will fetch it from the original source URL and then share that part with the other clients, minimizing the load on the server which stores the content files. The majority of data transfer happens between peers. Priority for downloading is given to chunks earlier in the file, so that file playback can happen immediately.

This swarming architecture offers savings in bandwidth and processor usage. Because most transfers happen between listeners, the source server has much less load. Also, unlike icecast, servers which serve files for Alluvium stations do not decode the files, so broadcasts can be done from low-cost, obsolete hardware with sufficiently fast I/O and network speeds.

History

Alluvium was developed as part of the Tristero project, hosted at SourceForge, by Brandon Wiley. The source code, still in beta, is available as part of the Tristero project at tristero.cvs.sourceforge.net

Alluvium was unveiled at CodeCon 2 in February 2003, generating interest in the peer-to-peer, open source, and streaming radio communities. [1] In 2004, CodeCon 3 was broadcast live using Alluvium 2.0. [2] [3]

Alluvium was further developed and incorporated into software developed at and named after ActLab.TV, a peercasted TV and radio service operated by the ActLab at the University of Texas at Austin. [4]

Related Research Articles

Gnutella is a peer-to-peer network protocol. Founded in 2000, it was the first decentralized peer-to-peer network of its kind, leading to other, later networks adopting the model.

Peer-to-peer Type of decentralized and distributed network architecture

Peer-to-peer (P2P) computing or networking is a distributed application architecture that partitions tasks or workloads between peers. Peers are equally privileged, equipotent participants in the application. They are said to form a peer-to-peer network of nodes.

RealAudio is a proprietary audio format developed by RealNetworks and first released in April 1995. It uses a variety of audio codecs, ranging from low-bitrate formats that can be used over dialup modems, to high-fidelity formats for music. It can also be used as a streaming audio format, that is played at the same time as it is downloaded. In the past, many internet radio stations used RealAudio to stream their programming over the internet in real time. In recent years, however, the format has become less common and has given way to more popular audio formats. RealAudio was heavily used by the BBC websites until 2009, though it was discontinued due to its declining use. BBC World Service, the last of the BBC websites to use RealAudio, discontinued its use in March 2011.

eDonkey2000

eDonkey2000 was a peer-to-peer file sharing application developed by US company MetaMachine, using the Multisource File Transfer Protocol. This client supports both the eDonkey2000 network and the Overnet network.

BitTorrent is a communication protocol for peer-to-peer file sharing (P2P), which enables users to distribute data and electronic files over the Internet in a decentralized manner.

In computer networks, download means to receive data from a remote system, typically a server such as a web server, an FTP server, an email server, or other similar system. This contrasts with uploading, where data is sent to a remote server. A download is a file offered for downloading or that has been downloaded, or the process of receiving such a file.

SHOUTcast DNAS is cross-platform proprietary software for streaming media over the Internet. The software, developed by Nullsoft, is available free of charge. It allows digital audio content, primarily in MP3 or High-Efficiency Advanced Audio Coding format, to be broadcast to and from media player software, enabling the creation of Internet radio "stations".

Icecast

Icecast is a streaming media project released as free software maintained by the Xiph.Org Foundation. It also refers specifically to the server program which is part of the project. Icecast was created in December 1998/January 1999 by Jack Moffitt and Barath Raghavan to provide an open-source audio streaming server that anyone could modify, use, and tinker with. Version 2, a ground-up rewrite aimed at multi-format support and scalability, was started in 2001 and released in January 2004.

MythTV Free and open source home entertainment application

MythTV is a free and open-source home entertainment application with a simplified "10-foot user interface" design for the living room TV. It turns a computer with the necessary hardware into a network streaming digital video recorder, a digital multimedia home entertainment system, or home theater personal computer. It can be considered a free and open-source alternative to TiVo or Windows Media Center. It runs on various operating systems, primarily Linux, macOS, and FreeBSD.

Peercasting is a method of multicasting streams, usually audio and/or video, to the Internet via peer-to-peer technology. It can be used for commercial, independent, and amateur multicasts. Unlike traditional IP Multicast, peercasting can facilitate on-demand content delivery.

The eDonkey Network is a decentralized, mostly server-based, peer-to-peer file sharing network created in 2000 by US developers Jed McCaleb and Sam Yagan that is best suited to share big files among users, and to provide long term availability of files. Like most sharing networks, it is decentralized, as there is no central hub for the network; also, files are not stored on a central server but are exchanged directly between users based on the peer-to-peer principle.

BitTorrent is an ad-supported BitTorrent client developed by Bram Cohen and Rainberry, Inc. used for uploading and downloading files via the BitTorrent protocol. BitTorrent was the first client written for the protocol. It is often nicknamed Mainline by developers denoting its official origins. Since version 6.0 the BitTorrent client has been a rebranded version of μTorrent. As a result, it is no longer open source. It is currently available for Microsoft Windows, Mac, Linux, iOS and Android.

GnucDNA was a software library for building peer-to-peer applications. It provides developers with a common layer to create their own Gnutella or Gnutella2 client or network. As a separate component, GnucDNA can be updated independently of the client, passing down improvements to the applications already using it.

P2PTV

P2PTV refers to peer-to-peer (P2P) software applications designed to redistribute video streams in real time on a P2P network; the distributed video streams are typically TV channels from all over the world but may also come from other sources. The draw to these applications is significant because they have the potential to make any TV channel globally available by any individual feeding the stream into the network where each peer joining to watch the video is a relay to other peer viewers, allowing a scalable distribution among a large audience with no incremental cost for the source.

Tribler Peer-to-peer filesharing software and protocol

Tribler is an open source decentralized BitTorrent client which allows anonymous peer-to-peer by default. Tribler is based on the BitTorrent protocol and uses an overlay network for content searching. Due to this overlay network, Tribler does not require an external website or indexing service to discover content. The user interface of Tribler is very basic and focused on ease of use instead of diversity of features. Tribler is available for Linux, Windows, and OS X.

The following is a general comparison of BitTorrent clients, which are computer programs designed for peer-to-peer file sharing using the BitTorrent protocol.

HTTP Live Streaming is an HTTP-based adaptive bitrate streaming communications protocol developed by Apple Inc. and released in 2009. Support for the protocol is widespread in media players, web browsers, mobile devices, and streaming media servers. As of 2019, an annual video industry survey has consistently found it to be the most popular streaming format.

In the BitTorrent file distribution system, a torrent file or meta-info file is a computer file that contains metadata about files and folders to be distributed, and usually also a list of the network locations of trackers, which are computers that help participants in the system find each other and form efficient distribution groups called swarms. A torrent file does not contain the content to be distributed; it only contains information about those files, such as their names, folder structure, and sizes obtained via cryptographic hash values for verifying file integrity. The term torrent may refer either to the metadata file or to the files downloaded, depending on the context.

Retroshare Free software

Retroshare is a free and open-source peer-to-peer communication and file sharing app based on a friend-to-friend network built on GNU Privacy Guard (GPG). Optionally, peers may communicate certificates and IP addresses to and from their friends.

μTorrent Proprietary adware BitTorrent client

μTorrent, or uTorrent is a proprietary adware BitTorrent client owned and developed by Rainberry, Inc. With over 150 million users it is the most widely used BitTorrent client outside China; globally only behind Xunlei. The "μ" in its name comes from the SI prefix "micro-", referring to the program's small memory footprint: the program was designed to use minimal computer resources while offering functionality comparable to larger BitTorrent clients such as Vuze or BitComet. μTorrent became controversial in 2015 when many users unknowingly accepted a default option during installation which also installed a cryptocurrency miner. The miner was removed in later versions, but had already done irreversible damage to μTorrent's reputation.

References

  1. Swarm Radio- a cheaper, faster 'casting tech The Register. Andrew Orlowski, February 24, 2003
  2. Codecon 2004 Archived 2007-06-12 at the Wayback Machine Conference Website.
  3. "Foundation for Decentralized Research CodeCon page". Archived from the original on 2004-07-25. Retrieved 2007-04-15.
  4. Swarmcasting Software Turns PCs into Broadcast Stations Archived 2011-06-29 at the Wayback Machine (Paywall). IEEE Computer. Linda Dailey Paulson, September 2005.