Open Connect

Last updated

Open Connect is a content distribution network specifically developed by Netflix to deliver its TV shows and movies to avoid traffic and fees.

Contents

Netflix provides physical appliances to internet service providers that allow them to avoid traffic during peak hours of streaming or sustain the anticipated ones. By shipping copies of content to these appliances ahead of time, the devices can store duplicates of titles, thereby reducing the network burden. Also, Netflix places its servers in locations with the highest number of subscribers and forms partnerships with ISP networks or IXPs.  [1]

Furthermore, Netflix adapts its content to the quality of the network. This is achieved by sending three copies of each title, each at a different quality level, to its servers. For example, if a user's ISP is overwhelmed or the Internet connection is poor, the system can select a lower-bitrate version of the title. [2]

History

Netflix launched Open Connect in 2012. Since then, Netflix has spent over $1 billion to develop and distribute more than 8,000 Open Connect Appliances (OCA). The service started working on the free-of-charge distribution of OCAs in cooperation with ISPs. So far, more than 1,000 ISPs have acquired and installed OCAs, which has allowed them to save $1.25 billion by 2021. [3]

In the case of an OCA that is hosted at an IXP, Netflix maintains ownership of the OCA and is responsible for covering its own expenses such as power consumption, colocation fees, cross-connect fees, and other related costs. Netflix has installed OCAs in over 52 IXPs around the world, enabling a connection with any ISP. [4]

Deployment

Netflix deploys OCAs within IXPs located in major Netflix markets around the world. These OCAs are interconnected with ISPs present at the same location through free public or private peering.

OCAs are directly installed within ISP networks. While Netflix supplies the server hardware at no cost, ISPs are responsible for providing space, power, and connectivity. [5]

Requirements

Requirements for deploying embedded appliances [6]
CriteriaDescription
NetworkISP with a public ASN
Netflix Viewer TrafficMinimum 5 Gbit/s of peak Netflix traffic
AWS ConnectivityAccessible control plane services running in AWS
Physical Connection2-6 x 10 Gbit/s optical Ethernet ports in a LACP LAG per OCA
Maximum Power Supply Draw750W

Three primary factors that determine the number of appliances that need to be deployed are:

  1. The network architecture requirements
  2. The maximum amount of Netflix traffic to be delivered from a particular site
  3. The availability and failover options that can be implemented at that site. [7]

Hardware

Open Connect is a combination of local servers, referred to as OCAs, and additional infrastructure. Netflix has developed storage appliances that are used to store the content in many IX locations globally and are embedded at larger ISP partner locations. The storage holds up to 350 TB, therefore, if something from storage becomes popular, Netflix will move that title onto the other server called flash server which serves large traffic. [1]

Software

These are used software for designing Open Connect Appliance Software:

Benefits

Related Research Articles

<span class="mw-page-title-main">London Internet Exchange</span> Internet exchange point in London

The London Internet Exchange (LINX) is a mutually governed Internet exchange point (IXP) providing peering services and public policy representation to network operators, encompassing over 950 different autonomous systems (ASNs). Established in 1994 in London, LINX operates IXPs in London, Manchester, Scotland, and Wales in the United Kingdom, as well as in Northern Virginia, United States.

<span class="mw-page-title-main">Proxy server</span> Computer server that makes and receives requests on behalf of a user

In computer networking, a proxy server is a server application that acts as an intermediary between a client requesting a resource and the server providing that resource. It improves privacy, security, and possibly performance in the process.

<span class="mw-page-title-main">Internet service provider</span> Organization that provides access to the Internet

An Internet service provider (ISP) is an organization that provides myriad services related to accessing, using, managing, or participating in the Internet. ISPs can be organized in various forms, such as commercial, community-owned, non-profit, or otherwise privately owned.

An autonomous system (AS) is a collection of connected Internet Protocol (IP) routing prefixes under the control of one or more network operators on behalf of a single administrative entity or domain, that presents a common and clearly defined routing policy to the Internet. Each AS is assigned an autonomous system number (ASN), for use in Border Gateway Protocol (BGP) routing. Autonomous System Numbers are assigned to Local Internet Registries (LIRs) and end-user organizations by their respective Regional Internet Registries (RIRs), which in turn receive blocks of ASNs for reassignment from the Internet Assigned Numbers Authority (IANA). The IANA also maintains a registry of ASNs which are reserved for private use.

Internet exchange points are common grounds of IP networking, allowing participant Internet service providers (ISPs) to exchange data destined for their respective networks. IXPs are generally located at places with preexisting connections to multiple distinct networks, i.e., datacenters, and operate physical infrastructure (switches) to connect their participants. Organizationally, most IXPs are each independent not-for-profit associations of their constituent participating networks. The primary alternative to IXPs is private peering, where ISPs directly connect their networks to each other.

<span class="mw-page-title-main">Content delivery network</span> Layer in the internet ecosystem addressing bottlenecks

A content delivery network or content distribution network (CDN) is a geographically distributed network of proxy servers and their data centers. The goal is to provide high availability and performance ("speed") by distributing the service spatially relative to end users. CDNs came into existence in the late 1990s as a means for alleviating the performance bottlenecks of the Internet as the Internet was starting to become a mission-critical medium for people and enterprises. Since then, CDNs have grown to serve a large portion of the Internet content today, including web objects, downloadable objects, applications, live streaming media, on-demand streaming media, and social media sites.

A gateway is a piece of networking hardware or software used in telecommunications networks that allows data to flow from one discrete network to another. Gateways are distinct from routers or switches in that they communicate using more than one protocol to connect multiple networks and can operate at any of the seven layers of the OSI model.

<span class="mw-page-title-main">Net neutrality</span> Principle that Internet service providers should treat all data equally

Network neutrality, often referred to as net neutrality, is the principle that Internet service providers (ISPs) must treat all Internet communications equally, offering users and online content providers consistent transfer rates regardless of content, website, platform, application, type of equipment, source address, destination address, or method of communication. Net neutrality was advocated for in the 1990s by the presidential administration of Bill Clinton in the United States. Clinton's signing of the Telecommunications Act of 1996, an amendment to the Communications Act of 1934, set a worldwide example for net neutrality laws and the regulation of ISPs.

<span class="mw-page-title-main">F5, Inc.</span> U.S. information technology company

F5, Inc. is an American technology company specializing in application security, multi-cloud management, online fraud prevention, application delivery networking (ADN), application availability & performance, network security, and access & authorization.

<span class="mw-page-title-main">Toronto Internet Exchange</span> Not-for-profit Internet Exchange Point

The Toronto Internet Exchange Community (TorIX) is a not-for-profit Internet Exchange Point (IXP) located in a carrier hotel at 151 Front Street West, Equinix's TR2 data centre at 45 Parliament Street and 905 King Street West in Toronto, Ontario, Canada. As of March 2021, TorIX has 259 unique autonomous systems representing 285 peer connections and peak traffic rates of 1.344 Tbps, making it the largest IXP in Canada. According to Wikipedia's List of Internet Exchange Points by Size, TorIX is the 16th largest IXP in the world in numbers of peers, and 17th in the world in traffic averages. The Exchange is organized and run by industry professionals in voluntary capacity.

Average Per-Bit Delivery Cost, or APBDC, is the cost accounting method by which Internet Service Providers (ISPs) calculate their cost of goods sold.

<span class="mw-page-title-main">Internet in Africa</span> Internet access and usage in Africa

The Internet in Africa is limited by a lower penetration rate when compared to the rest of the world. Measurable parameters such as the number of ISP subscriptions, overall number of hosts, IXP-traffic, and overall available bandwidth are indicators that Africa is far behind the "digital divide.". Moreover, Africa itself exhibits an inner digital divide, with most Internet activity and infrastructure concentrated in South Africa, Morocco, and Egypt, as well as smaller economies like Mauritius and the Seychelles. In general, only 43% of the African population has access to the Internet as of 2021. Only 0.4% of the African population has a fixed-broadband subscription. The majority of internet users use it through mobile broadband.

Opengear is a global computer network technology company headquartered in Edison, New Jersey, U.S., with engineering in Brisbane, Qld, Australia and production in Sandy, UT.

ApplianSys, founded in 2000, is a privately held venture capital-backed technology company based in Coventry, United Kingdom. It designs, builds and markets Internet server appliances that are deployed in more than 150 countries. Forrester Research have listed ApplianSys as being a key vendor in the worldwide IP Address Management market, with its DNS engine used in a third of all GPRS networks.

Content delivery network interconnection (CDNI) is a set of interfaces and mechanisms required for interconnecting two independent content delivery networks (CDNs) that enables one to deliver content on behalf of the other. Interconnected CDNs offer many benefits, such as footprint extension, reduced infrastructure costs, higher availability, etc., for content service providers (CSPs), CDNs, and end users. Among its many use cases, it allows small CDNs to interconnect and provides services for CSPs that allows them to compete against the CDNs of global CSPs.

Mumbai Internet Exchange is a subsidiary of the German Internet exchange point (IXP) DE-CIX, founded on 15 August 2014 as Mumbai Convergence Hub as an Open Carrier Neutral Internet Exchange & Peering Hub. As of 30 March 2021 it interconnects more than 375 members, making it the largest IXP in India and surrounding region.

<span class="mw-page-title-main">Domain fronting</span> Technique for Internet censorship circumvention

Domain fronting is a technique for Internet censorship circumvention that uses different domain names in different communication layers of an HTTPS connection to discreetly connect to a different target domain than that which is discernable to third parties monitoring the requests and connections.

MANRS is an Internet Society-supported activity aimed at securing global Internet routing. Its main participants are Internet Service Providers (ISPs), cloud providers, Internet Exchange Points (IXPs) and content delivery networks (CDNs).

The Internet Exchange Point Of Nigeria (IXPN) is a neutral and not-for-profit Internet exchange point (IXP) founded in 2006 by the Nigerian Communications Commission (NCC) in partnership with the Internet Service Providers Association Of Nigeria (ISPAN). Among other things, IXPN was created to reduce connectivity costs in millions of dollars in offshore internet bandwidth payments, reduce latency from 900 milliseconds to 30 milliseconds for local content, serve as the central point for connecting Higher Educational Institutions (HEIs) towards the development of National Research and Educational Network (NREN). As at April 2022, IXPN is the 5th largest IXP in Africa by number of peers, and 3rd in Africa by traffic according to Packet Clearing House’s IXP directory

References

  1. 1 2 Keck, Catie (2021-11-17). "A look under the hood of the most successful streaming service on the planet". The Verge. Retrieved 2023-04-24.
  2. ↑ Monnier, R., Jerbi, K., & Uitto, M. (2017). CONVINcE D2.2.2 Updated specification of power-efficient encoder V1.0. imtbs-tsp.eu. Retrieved 2023-04-24. https://convince.wp.imtbs-tsp.eu/files/2017/09/CONVINcE-D2.2.2-Updated-specification-of-power-efficient-encoder-V1.01.pdf.
  3. 1 2 Netflix’s Open Connect program and codec optimisation helped ISPs save over USD1 billion globally in 2021. Analysys Mason. (2022-07-14). Retrieved 2023-04-24. https://www.analysysmason.com/contentassets/ef8295594cc54285bf554b05daa06431/modelling-the-impact-of-netflix-traffic-and-open-connect-on-isp-traffic-dependent-costs---2022-07-14.pdf
  4. 1 2 Böttger, Timm; Cuadrado, Felix; Tyson, Gareth; Castro, Ignacio; Uhlig, Steve (2018-04-27). "Open Connect Everywhere: A Glimpse at the Internet Ecosystem through the Lens of the Netflix CDN". ACM SIGCOMM Computer Communication Review. 48 (1): 28–34. doi:10.1145/3211852.3211857. ISSN   0146-4833. S2CID   4817223.
  5. ↑ "Netflix: What Happens When You Press Play? - High Scalability -". highscalability.com. 11 December 2017. Retrieved 2023-04-24.
  6. ↑ "Requirements for deploying embedded appliances". Netflix Open Connect Help Center. Retrieved 2023-05-13.
  7. ↑ The carbon footprint of watching Netflix. Telecoms.com. (2022-12-05). Retrieved 2023-04-24. https://telecoms.com/opinion/the-carbon-footprint-of-watching-netflix/
  8. ↑ "Behind the curtain: How Netflix streams movies to your TV". TechHive. Retrieved 2023-04-24.
  9. ↑ Barua, H. (2019-09-29). Managing global CDN operations at Netflix. InfoQ. Retrieved 2023-04-24. https://www.infoq.com/news/2019/09/global-cdn-netflix/
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.