Worldwide LHC Computing Grid

Last updated

The Worldwide LHC Computing Grid (WLCG), formerly (until 2006) [1] the LHC Computing Grid (LCG), is an international collaborative project that consists of a grid-based computer network infrastructure incorporating over 170 computing centers in 42 countries, as of 2017. It was designed by CERN to handle the prodigious volume of data produced by Large Hadron Collider (LHC) experiments. [2] [3]

Contents

servers rack of Worldwide LHC Computing Grid in CERN Rack of Worldwide LHC Computing Grid.jpg
servers rack of Worldwide LHC Computing Grid in CERN

By 2012, data from over 300 trillion (3×1014) LHC proton-proton collisions had been analyzed, [4] and LHC collision data was being produced at approximately 25 petabytes per year. As of  2017 the LHC Computing Grid is the world's largest computing grid comprising over 170 computing facilities in a worldwide network across 42 countries [4] [5] [6] scattered around the world that produce a massive distributed computing infrastructure with about 1,000,000 CPU cores, providing more than 10,000 physicists around the world with near real-time access to the LHC data, and the power to process it.

According to the WLCG Website as of 2024: "WLCG combines about 1.4 million computer cores and 1.5 exabytes of storage from over 170 sites in 42 countries [...] It runs over 2 million tasks per day and [...] global transfer rates exceeded 260 GB/s." Indicating substantial upgrades to WLCG over time beyond its initial release.

Background

The Large Hadron Collider at CERN was designed to test the existence of the Higgs boson, an important but elusive piece of knowledge that had been sought by particle physicists for over 40 years. A very powerful particle accelerator was needed, because Higgs bosons might not be seen in lower energy experiments, and because vast numbers of collisions would need to be studied. Such a collider would also produce unprecedented quantities of collision data requiring analysis. Therefore, advanced computing facilities were needed to process the data.

Description

A design report was published in 2005. [7] It was announced to be ready for data on 3 October 2008. [8] A popular 2008 press article predicted "the internet could soon be made obsolete" by its technology. [9] CERN had to publish its own articles trying to clear up the confusion. [10] It incorporates both private fiber-optic cable links and existing high-speed portions of the public Internet. At the end of 2010, the Grid consisted of some 200,000 processing cores and 150 petabytes of disk space, distributed across 34 countries. [11]

The data stream from the detectors provides approximately 300 GByte/s of data, which after filtering for "interesting events", results in a data stream of about 300 MByte/s. The CERN computer center, considered "Tier 0" of the LHC Computing Grid, has a dedicated 10 Gbit/s connection to the counting room.

The project was expected to generate multiple TB of raw data and event summary data, which represents the output of calculations done by the CPU farm at the CERN data center. This data is sent out from CERN to thirteen Tier 1 academic institutions in Europe, Asia, and North America, [12] via dedicated links with 10 Gbit/s or higher of bandwidth. This is called the LHC Optical Private Network. [13] More than 150 Tier 2 institutions are connected to the Tier 1 institutions by general-purpose national research and education networks. [14] The data produced by the LHC on all of its distributed computing grid is expected to add up to 200 PB of data each year. [15] In total, the four main detectors at the LHC produced 13 petabytes of data in 2010. [11]

The Tier 1 institutions receive specific subsets of the raw data, for which they serve as a backup repository for CERN. They also perform reprocessing when recalibration is necessary. [14] The primary configuration for the computers used in the grid is based on CentOS. [16] In 2015, CERN switched away from Scientific Linux to CentOS. [16]

Distributed computing resources for analysis by end-user physicists are provided by multiple federations across the Europe, Asia Pacific and the Americas.

See also

Related Research Articles

<span class="mw-page-title-main">CERN</span> European research centre in Switzerland

The European Organization for Nuclear Research, known as CERN, is an intergovernmental organization that operates the largest particle physics laboratory in the world. Established in 1954, it is based in Meyrin, western suburb of Geneva, on the France–Switzerland border. It comprises 23 member states. Israel, admitted in 2013, is the only non-European full member. CERN is an official United Nations General Assembly observer.

Grid computing is the use of widely distributed computer resources to reach a common goal. A computing grid can be thought of as a distributed system with non-interactive workloads that involve many files. Grid computing is distinguished from conventional high-performance computing systems such as cluster computing in that grid computers have each node set to perform a different task/application. Grid computers also tend to be more heterogeneous and geographically dispersed than cluster computers. Although a single grid can be dedicated to a particular application, commonly a grid is used for a variety of purposes. Grids are often constructed with general-purpose grid middleware software libraries. Grid sizes can be quite large.

<span class="mw-page-title-main">Compact Muon Solenoid</span> General-purposes experiment at the Large Hadron Collider

The Compact Muon Solenoid (CMS) experiment is one of two large general-purpose particle physics detectors built on the Large Hadron Collider (LHC) at CERN in Switzerland and France. The goal of the CMS experiment is to investigate a wide range of physics, including the search for the Higgs boson, extra dimensions, and particles that could make up dark matter.

<span class="mw-page-title-main">Large Hadron Collider</span> Particle accelerator at CERN, Switzerland

The Large Hadron Collider (LHC) is the world's largest and highest-energy particle collider. It was built by the European Organization for Nuclear Research (CERN) between 1998 and 2008 in collaboration with over 10,000 scientists and hundreds of universities and laboratories across more than 100 countries. It lies in a tunnel 27 kilometres (17 mi) in circumference and as deep as 175 metres (574 ft) beneath the France–Switzerland border near Geneva.

<span class="mw-page-title-main">ATLAS experiment</span> CERN LHC experiment

ATLAS is the largest general-purpose particle detector experiment at the Large Hadron Collider (LHC), a particle accelerator at CERN in Switzerland. The experiment is designed to take advantage of the unprecedented energy available at the LHC and observe phenomena that involve highly massive particles which were not observable using earlier lower-energy accelerators. ATLAS was one of the two LHC experiments involved in the discovery of the Higgs boson in July 2012. It was also designed to search for evidence of theories of particle physics beyond the Standard Model.

<span class="mw-page-title-main">Large Electron–Positron Collider</span> Particle accelerator at CERN, Switzerland

The Large Electron–Positron Collider (LEP) was one of the largest particle accelerators ever constructed. It was built at CERN, a multi-national centre for research in nuclear and particle physics near Geneva, Switzerland.

<span class="mw-page-title-main">LHC@home</span> Volunteer computing project researching particle simulations for LHC development

LHC@home is a volunteer computing project researching particle physics that uses the Berkeley Open Infrastructure for Network Computing (BOINC) platform. The project's computing power is utilized by physicists at CERN in support of the Large Hadron Collider and other experimental particle accelerators.

<span class="mw-page-title-main">Microcosm (CERN)</span> Museum at CERN in Meyrin (Switzerland)

Microcosm or CERN Museum was an interactive exhibition presenting the work of the CERN particle physics laboratory and its flagship accelerator the Large Hadron Collider (LHC). It first opened to the public in 1990 and closed permanently in September 2022, to be replaced by the Science Gateway in 2023. The final version of the exhibition opened in January 2016, developed by CERN in collaboration with Spanish design team Indissoluble.

<span class="mw-page-title-main">DØ experiment</span> Particle physics research project (1983–2011)

The DØ experiment was a worldwide collaboration of scientists conducting research on the fundamental nature of matter. DØ was one of two major experiments located at the Tevatron Collider at Fermilab in Batavia, Illinois. The Tevatron was the world's highest-energy accelerator from 1983 until 2009, when its energy was surpassed by the Large Hadron Collider. The DØ experiment stopped taking data in 2011, when the Tevatron shut down, but data analysis is still ongoing. The DØ detector is preserved in Fermilab's DØ Assembly Building as part of a historical exhibit for public tours.

The Nordic Data Grid Facility, or NDGF, is a common e-Science infrastructure provided by the Nordic countries for scientific computing and data storage. It is the first and so far only internationally distributed WLCG Tier1 center, providing computing and storage services to experiments at CERN.

<span class="mw-page-title-main">Higgs boson</span> Elementary particle involved with rest mass

The Higgs boson, sometimes called the Higgs particle, is an elementary particle in the Standard Model of particle physics produced by the quantum excitation of the Higgs field, one of the fields in particle physics theory. In the Standard Model, the Higgs particle is a massive scalar boson with zero spin, even (positive) parity, no electric charge, and no colour charge that couples to mass. It is also very unstable, decaying into other particles almost immediately upon generation.

The Open Science Grid Consortium is an organization that administers a worldwide grid of technological resources called the Open Science Grid, which facilitates distributed computing for scientific research. Founded in 2004, the consortium is composed of service and resource providers, researchers from universities and national laboratories, as well as computing centers across the United States. Members independently own and manage the resources which make up the distributed facility, and consortium agreements provide the framework for technological and organizational integration.

GridPP is a collaboration of particle physicists and computer scientists from the United Kingdom and CERN. They manage and maintain a distributed computing grid across the UK with the primary aim of providing resources to particle physicists working on the Large Hadron Collider (LHC) experiments at CERN. They are funded by the UK's Science and Technology Facilities Council. The collaboration oversees a major computing facility called the Tier1 at the Rutherford Appleton Laboratory (RAL) along with the four Tier 2 organisations of ScotGrid, NorthGrid, SouthGrid and LondonGrid. The Tier 2s are geographically distributed and are composed of computing clusters at multiple institutes.

<span class="mw-page-title-main">European Middleware Initiative</span>

The European Middleware Initiative (EMI) was a computer software platform for high performance distributed computing. It was developed and distributed directly by the EMI project. It was the base for other grid middleware distributions used by scientific research communities and distributed computing infrastructures all over the world especially in Europe, South America and Asia. EMI supported broad scientific experiments and initiatives, such as the Worldwide LHC Computing Grid.

<span class="mw-page-title-main">Search for the Higgs boson</span> Effort to prove or disprove the existence of particle

The search for the Higgs boson was a 40-year effort by physicists to prove the existence or non-existence of the Higgs boson, first theorised in the 1960s. The Higgs boson was the last unobserved fundamental particle in the Standard Model of particle physics, and its discovery was described as being the "ultimate verification" of the Standard Model. In March 2013, the Higgs boson was officially confirmed to exist.

<span class="mw-page-title-main">Guido Tonelli</span> Italian particle physicist

Guido Tonelli is an Italian particle physicist who was involved with the discovery of the Higgs boson at the Large Hadron Collider. He is a professor of General Physics at the University of Pisa (Italy) and a CERN visiting scientist.

The Circular Electron Positron Collider (CEPC) is a proposed Chinese electron positron collider for experimenting on the Higgs boson. It would be the world's largest particle accelerator with a circumference of 100 kilometres (62 mi).

<span class="mw-page-title-main">Future Circular Collider</span> Proposed post-LHC particle accelerator at CERN, Geneva, Switzerland

The Future Circular Collider (FCC) is a proposed particle accelerator with an energy significantly above that of previous circular colliders, such as the Super Proton Synchrotron, the Tevatron, and the Large Hadron Collider (LHC). The FCC project is considering three scenarios for collision types: FCC-hh, for hadron-hadron collisions, including proton-proton and heavy ion collisions, FCC-ee, for electron-positron collisions, and FCC-eh, for electron-hadron collisions.

<span class="mw-page-title-main">Maria Girone</span> Head of CERN openlab

Maria Girone is the Head of CERN openlab. She leads the development of High Performance Computing (HPC) technologies for particle physics experiments.

<span class="mw-page-title-main">Kamal Benslama</span> Moroccan-Swiss Experimental Particle physicist

Kamal Benslama is a Moroccan-Swiss experimental particle physicist. He is a professor of physics at Drew University, a visiting experimental scientist at Fermilab, and a guest scientist at Brookhaven National Laboratory. He worked on the ATLAS experiment, at the Large Hadron Collider (LHC) at CERN in Switzerland, which is considered the largest experiment in the history of physical science. At present, he is member of the MU2E collaboration at Fermi National Accelerator Laboratory (Fermilab), located just outside Batavia, Illinois, near Chicago. Fermilab is a United States Department of Energy national laboratory specializing in high-energy particle physics.

References

  1. ↑ Hayes, Jacqui (21 December 2011). "Happy 10th Birthday, WLCG!". International Grid Science This Week. Retrieved 2012-12-20.
  2. ↑ Worldwide LHC Computing Grid, CERN, January 2017, retrieved 2017-08-04
  3. ↑ About, CERN, January 2017, retrieved 2017-08-04
  4. 1 2 Hunt for Higgs boson hits key decision point
  5. ↑ Worldwide LHC Computing Grid about page 2017: "Even after filtering out 99% of it, in 2017 we're expecting to gather around 50 petabytes of data. That's 50 million gigabytes, the equivalent to nearly 15 million high-definition (HD) movies."
  6. ↑ Worldwide LHC Computing Grid main page 2017: "WLCG is the world's largest computing grid. It is supported by many associated national and international grids across the world, such as European Grid Initiative (Europe-based) and Open Science Grid (US-based), as well as many other regional grids."
  7. ↑ LHC Computing Grid: Technical Design Report (PDF). The LCG TDR Editorial Board. 20 June 2005. ISBN   978-92-9083-253-9 . Retrieved 2 October 2011.{{cite book}}: |work= ignored (help)
  8. ↑ "LHC GridFest". CERN. 2008.
  9. ↑ Jonathan Leake (6 April 2008). "Coming soon: superfast internet". The Times. London. Archived from the original on August 5, 2011. Retrieved 25 January 2013.
  10. ↑ "The Grid: separating fact from fiction". CERN. May 2008. Retrieved 25 January 2013. Adapted from an article originally published in Symmetry Breaking.
  11. 1 2 Geoff Brumfiel (19 January 2011). "High-energy physics: Down the petabyte highway". Nature. 469 (7330): 282–283. Bibcode:2011Natur.469..282B. doi: 10.1038/469282a . PMID   21248814.
  12. ↑ "The Grid: A system of tiers". CERN. Retrieved 2 October 2017.
  13. ↑ "Network transfer architecture". CERN. Retrieved 2 October 2011.
  14. 1 2 final-draft-4-key Archived May 26, 2008, at the Wayback Machine
  15. ↑ Brodkin, Jon (28 April 2008). "Parallel Internet: Inside the Worldwide LHC computing grid". Techworld.com.
  16. 1 2 CERN. "Linux @ CERN: /linux/nextversion.shtml". linux.web.cern.ch. Retrieved 2016-02-07.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.