Open Connect

Last updated

Open Connect is a content distribution network specifically developed by Netflix to deliver its TV shows and movies to avoid the traffic and fees.

Contents

Netflix provides physical appliances to internet service providers that allow them to avoid traffic during peak hours of streaming or sustain the anticipated ones. By shipping copies of content to these appliances ahead of time, the devices can store duplicates of titles, thereby reducing the network burden. Also, Netflix places its servers in locations with the highest number of subscribers and forms partnerships with ISP networks or IXP s.  [1]

Furthermore, Netflix adapts its content to the quality of the network. This is achieved by sending three copies of each title, each at a different quality level, to its servers. For example, if a user's ISP is overwhelmed or the Internet connection is poor, the system can select a lower-bitrate version of the title. [2]

History

Netflix launched Open Connect in 2012. Since then, Netflix has spent over $1 billion to develop and distribute more than 8,000 Open Connect Appliances (OCA). The service started working on the free-of-charge distribution of OCAs in cooperation with ISPs. So far, more than 1,000 ISPs have acquired and installed OCAs, which has allowed them to save $1.25 billion by 2021. [3]

In the case of an OCA that is hosted at an IXP, Netflix maintains ownership of the OCA and is responsible for covering its own expenses such as power consumption, colocation fees, cross-connect fees, and other related costs. Netflix has installed OCAs in over 52 IXP s around the world, enabling a connection with any ISP. [4]

Deployment

Netflix deploys OCAs within IXPs located in major Netflix markets around the world. These OCAs are interconnected with ISPs present at the same location through free public or private peering.

OCAs are directly installed within ISP networks. While Netflix supplies the server hardware at no cost, ISPs are responsible for providing space, power, and connectivity. [5]

Requirements

Requirements for deploying embedded appliances [6]
CriteriaDescription
NetworkISP with a public ASN
Netflix Viewer TrafficMinimum 5 Gbit/s of peak Netflix traffic
AWS ConnectivityAccessible control plane services running in AWS
Physical Connection2-6 x 10 Gbit/s optical Ethernet ports in a LACP LAG per OCA
Maximum Power Supply Draw750W

Three primary factors that determine the number of appliances that need to be deployed are:

  1. The network architecture requirements
  2. The maximum amount of Netflix traffic to be delivered from a particular site
  3. The availability and failover options that can be implemented at that site. [7]

Hardware

Open Connect is a combination of local servers, referred to as OCAs, and additional infrastructure. Netflix has developed storage appliances that are used to store the content in many IX locations globally and are embedded at larger ISP partner locations. The storage holds up to 350 TB, therefore, if something from storage becomes popular, Netflix will move that title onto the other server called flash server which serves large traffic. [1]

Software

These are used software for designing Open Connect Appliance Software:

Benefits

Related Research Articles

<span class="mw-page-title-main">London Internet Exchange</span> Internet exchange point in London

The London Internet Exchange ("LINX") is a mutually governed Internet exchange point (IXP) that provides peering services and public policy representation to network operators. It was founded in 1994 in London. LINX operates IXPs in London, Manchester, Scotland and Wales in the United Kingdom and Northern Virginia in the United States.

<span class="mw-page-title-main">Internet service provider</span> Organization that provides access to the Internet

An Internet service provider (ISP) is an organization that provides services for accessing, using, managing, or participating in the Internet. ISPs can be organized in various forms, such as commercial, community-owned, non-profit, or otherwise privately owned.

An autonomous system (AS) is a collection of connected Internet Protocol (IP) routing prefixes under the control of one or more network operators on behalf of a single administrative entity or domain, that presents a common and clearly defined routing policy to the Internet. Each AS is assigned an autonomous system number (ASN), for use in Border Gateway Protocol (BGP) routing. Autonomous System Numbers are assigned to Local Internet Registries (LIRs) and end user organizations by their respective Regional Internet Registries (RIRs), which in turn receive blocks of ASNs for reassignment from the Internet Assigned Numbers Authority (IANA). The IANA also maintains a registry of ASNs which are reserved for private use.

Internet exchange points are common grounds of IP networking, allowing participant Internet service providers (ISPs) to exchange data destined for their respective networks. IXPs are generally located at places with preexisting connections to multiple distinct networks, i.e., datacenters, and operate physical infrastructure (switches) to connect their participants. Organizationally, most IXPs are each independent not-for-profit associations of their constituent participating networks. The primary alternative to IXPs is private peering, where ISPs directly connect their networks to each other.

<span class="mw-page-title-main">Content delivery network</span> Layer in the internet ecosystem addressing bottlenecks

A content delivery network, or content distribution network (CDN), is a geographically distributed network of proxy servers and their data centers. The goal is to provide high availability and performance by distributing the service spatially relative to end users. CDNs came into existence in the late 1990s as a means for alleviating the performance bottlenecks of the Internet as the Internet was starting to become a mission-critical medium for people and enterprises. Since then, CDNs have grown to serve a large portion of the Internet content today, including web objects, downloadable objects, applications, live streaming media, on-demand streaming media, and social media sites.

A gateway is a piece of networking hardware or software used in telecommunications networks that allows data to flow from one discrete network to another. Gateways are distinct from routers or switches in that they communicate using more than one protocol to connect multiple networks and can operate at any of the seven layers of the open systems interconnection model (OSI).

<span class="mw-page-title-main">Net neutrality</span> Principle that Internet service providers should treat all data equally

Network neutrality, often referred to as net neutrality, is the principle that Internet service providers (ISPs) must treat all Internet communications equally, offering users and online content providers consistent rates irrespective of content, website, platform, application, type of equipment, source address, destination address, or method of communication.

<span class="mw-page-title-main">Ateme</span>

Ateme S.A. is a multinational company that specializes in video delivery, namely software for video compression based on H.265 / HEVC standards; MPEG4; MPEG2 encoding / decoding software for contribution links, as well as for multi-screen live streaming, OTT and CDN software; origin-server and packaging software; and cloud DVR technology. The company has its headquarters in Vélizy near Paris, France, with offices that spread over Europe, North America, South America, Asia and Australia. The company also has a worldwide resellers network and operates globally with clients in more than 60 countries.

Bandwidth throttling consists in the intentional limitation of the communication speed, of the ingoing (received) or outgoing (sent) data in a network node or in a network device.

<span class="mw-page-title-main">F5, Inc.</span> U.S. information technology company

F5, Inc. is a publicly-held American technology company specializing in application security, multi-cloud management, online fraud prevention, application delivery networking (ADN), application availability & performance, network security, and access & authorization.

<span class="mw-page-title-main">Toronto Internet Exchange</span> Not-for-profit Internet Exchange Point

The Toronto Internet Exchange Community (TorIX) is a not-for-profit Internet Exchange Point (IXP) located in a carrier hotel at 151 Front Street West, Equinix's TR2 data centre at 45 Parliament Street and 905 King Street West in Toronto, Ontario, Canada. As of March 2021, TorIX has 259 unique autonomous systems representing 285 peer connections and peak traffic rates of 1.344 Tbps, making it the largest IXP in Canada. According to Wikipedia's List of Internet Exchange Points by Size, TorIX is the 16th largest IXP in the world in numbers of peers, and 17th in the world in traffic averages. The Exchange is organized and run by industry professionals in voluntary capacity.

Average Per-Bit Delivery Cost, or APBDC, is the cost accounting method by which Internet Service Providers (ISPs) calculate their cost of goods sold.

<span class="mw-page-title-main">Internet in Africa</span> Internet access and usage in Africa

The Internet in Africa is limited by a lower penetration rate when compared to the rest of the world. Measurable parameters such as the number of ISP subscriptions, overall number of hosts, IXP-traffic, and overall available bandwidth are indicators that Africa is far behind the "digital divide". Moreover, Africa itself exhibits an inner digital divide, with most Internet activity and infrastructure concentrated in South Africa, Morocco, Egypt as well as smaller economies like Mauritius and Seychelles. In general, only 24.4% of the African population have access to the Internet, as of 2018. Only 0.4% of the African population has a fixed-broadband subscription. The majority of internet users use it through mobile broadband.

Opengear is a global computer network technology company headquartered in Edison, New Jersey, U.S., with R&D operations in Brisbane, Qld, Australia and production in Sandy, UT.

ApplianSys, founded in 2000, is a privately held venture capital-backed technology company based in Coventry, United Kingdom. It designs, builds and markets Internet server appliances that are deployed in more than 150 countries. Forrester Research have listed ApplianSys as being a key vendor in the worldwide IP Address Management market, with its DNS engine used in a third of all GPRS networks.

Content delivery network interconnection (CDNI) is a set of interfaces and mechanisms required for interconnecting two independent content delivery networks (CDNs) that enables one to deliver content on behalf of the other. Interconnected CDNs offer many benefits, such as footprint extension, reduced infrastructure costs, higher availability, etc., for content service providers (CSPs), CDNs, and end users. Among its many use cases, it allows small CDNs to interconnect and provides services for CSPs that allows them to compete against the CDNs of global CSPs.

Mumbai Internet Exchange is a Mumbai-based Internet exchange point (IXP) founded on 15 August 2014 as Mumbai Convergence Hub is an Open Carrier Neutral Internet Exchange & Peering Hub. As of 30 March 2021 it interconnects more than 375 members, making it the largest IXP in India and surrounding region.

The Zettabyte Era or Zettabyte Zone is a period of human and computer science history that started in the mid-2010s. The precise starting date depends on whether it is defined as when the global IP traffic first exceeded one zettabyte, which happened in 2016, or when the amount of digital data in the world first exceeded a zettabyte, which happened in 2012. A zettabyte is a multiple of the unit byte that measures digital storage, and it is equivalent to 1,000,000,000,000,000,000,000 (1021) bytes.

MANRS is an Internet Society-supported activity aimed at securing global Internet routing. Its main participants are Internet Service Providers (ISPs), cloud providers, Internet Exchange Points (IXPs) and Content Delivery Networks (CDNs).

The Internet Exchange Point Of Nigeria (IXPN) is a neutral and not-for-profit Internet exchange point (IXP) founded in 2006 by the Nigerian Communications Commission (NCC) in partnership with the Internet Service Providers Association Of Nigeria (ISPAN). Among other things, IXPN was created to reduce connectivity costs in millions of dollars in offshore internet bandwidth payments, reduce latency from 900 milliseconds to 30 milliseconds for local content, serve as the central point for connecting Higher Educational Institutions (HEIs) towards the development of National Research and Educational Network (NREN). As at April 2022, IXPN is the 5th largest IXP in Africa by number of peers, and 3rd in Africa by traffic according to Packet Clearing House’s IXP directory

References

  1. 1 2 Keck, Catie (2021-11-17). "A look under the hood of the most successful streaming service on the planet". The Verge. Retrieved 2023-04-24.
  2. Monnier, R., Jerbi, K., & Uitto, M. (2017). CONVINcE D2.2.2 Updated specification of power-efficient encoder V1.0. imtbs-tsp.eu. Retrieved 2023-04-24. https://convince.wp.imtbs-tsp.eu/files/2017/09/CONVINcE-D2.2.2-Updated-specification-of-power-efficient-encoder-V1.01.pdf.
  3. 1 2 Netflix’s Open Connect program and codec optimisation helped ISPs save over USD1 billion globally in 2021. Analysys Mason. (2022-07-14). Retrieved 2023-04-24. https://www.analysysmason.com/contentassets/ef8295594cc54285bf554b05daa06431/modelling-the-impact-of-netflix-traffic-and-open-connect-on-isp-traffic-dependent-costs---2022-07-14.pdf
  4. 1 2 Böttger, Timm; Cuadrado, Felix; Tyson, Gareth; Castro, Ignacio; Uhlig, Steve (2018-04-27). "Open Connect Everywhere: A Glimpse at the Internet Ecosystem through the Lens of the Netflix CDN". ACM SIGCOMM Computer Communication Review. 48 (1): 28–34. doi:10.1145/3211852.3211857. ISSN   0146-4833.
  5. "Netflix: What Happens When You Press Play? - High Scalability -". highscalability.com. Retrieved 2023-04-24.
  6. "Requirements for deploying embedded appliances". Netflix Open Connect Help Center. Retrieved 2023-05-13.
  7. The carbon footprint of watching Netflix. Telecoms.com. (2022-12-05). Retrieved 2023-04-24. https://telecoms.com/opinion/the-carbon-footprint-of-watching-netflix/
  8. "Behind the curtain: How Netflix streams movies to your TV". TechHive. Retrieved 2023-04-24.
  9. Barua, H. (2019-09-29). Managing global CDN operations at Netflix. InfoQ. Retrieved 2023-04-24. https://www.infoq.com/news/2019/09/global-cdn-netflix/