OpenSFS

Last updated
OpenSFS
Founded2010 (2010)
Type 501(c)(6)
Location
Key people
Stephen Simms [1]
Website www.opensfs.org

Open Scalable File Systems, Inc. (OpenSFS) is a nonprofit organization promoting the Lustre file system. OpenSFS was founded in 2010 to ensure Lustre remains vendor-neutral, open, and free. [2]

Contents

History

The Lustre is a high-performance parallel file system deployed in computational data centers including many TOP500 systems. It first started development in 1999 [3] under the Accelerated Strategic Computing Initiative Path Forward project and initially released in 2003. [4] In September 2007, Sun Microsystems acquired the assets of Cluster File Systems Inc, [5] [6] and was itself acquired by Oracle Corporation in 2010. After announcements from Oracle before and during the 2010 Lustre User Group, [7] ongoing development of Lustre as an open-source project was in question, prompting most Lustre developers to leave Oracle. [8] OpenSFS was founded in October 2010 to steward an open source software Lustre community. Founding members were Cray, DataDirect Networks, Lawrence Livermore National Laboratory, and Oak Ridge National Laboratory. [9] [10] In April 2013 Norman Morse, who had been CEO since it was founded, resigned and was replaced by Galen Shipman of ORNL. [11] In 2015, Charlie Carrol of Cray replaced Shipman as chairman. At the Lustre BOF at Supercomuting'16, Stephen Simms announced that stewardship of OpenSFS had been transferred from the remaining board members, Cray, Intel, and Seagate, to become a more user-driven organization. Simms assumed the role of interim president until board elections at LUG 2017 and then returned in a permanent capacity after elections at LUG 2019. [1]

Releases

In 2011, Lustre 2.1 was the first community release endorsed by OpenSFS. OpenSFS began direct funding of community releases in early 2012, focused on introducing new features and targeted every six months. Maintenance releases are targeted every three months. [12] OpenSFS solicited proposals in February 2013 for Lustre feature development, parallel file system tools, addressing Lustre technical issues, and parallel file system incubators. [13] [14]

OpenSFS-funded releases included Lustre 2.5 in October 2013, containing a Lustre+HSM integration capability. [15] [16] [17] [18] In 2017 it was announced that Lustre releases would adopt a Long Term Support (LTS) model with Lustre 2.10 being the first LTS release. [19] At SC18 it was announced that Lustre 2.12 would be the next LTS release. [20] Matters relating to the Lustre community releases are discussed at the OpenSFS Lustre Working Group. [21]

Lustre User Group

Since 2011 OpenSFS has been in charge of organizing the annual Lustre User Group (LUG) event, traditionally held in April, for discussion and seminars on Lustre. [22] The 2020 LUG was replaced by a webinar series in light of restrictions around travel and group meetings due to the global COVID-19 pandemic. [23]

Related Research Articles

<span class="mw-page-title-main">Java (programming language)</span> Object-oriented programming language

Java is a high-level, class-based, object-oriented programming language that is designed to have as few implementation dependencies as possible. It is a general-purpose programming language intended to let programmers write once, run anywhere (WORA), meaning that compiled Java code can run on all platforms that support Java without the need to recompile. Java applications are typically compiled to bytecode that can run on any Java virtual machine (JVM) regardless of the underlying computer architecture. The syntax of Java is similar to C and C++, but has fewer low-level facilities than either of them. The Java runtime provides dynamic capabilities that are typically not available in traditional compiled languages. As of 2019, Java was one of the most popular programming languages in use according to GitHub, particularly for client–server web applications, with a reported 9 million developers.

<span class="mw-page-title-main">Sun Microsystems</span> American computer company, 1982–2010

Sun Microsystems, Inc. was an American technology company that sold computers, computer components, software, and information technology services and created the Java programming language, the Solaris operating system, ZFS, the Network File System (NFS), and SPARC microprocessors. Sun contributed significantly to the evolution of several key computing technologies, among them Unix, RISC processors, thin client computing, and virtualized computing. Notable Sun acquisitions include Cray Business Systems Division, Storagetek, and Innotek GmbH, creators of VirtualBox. Sun was founded on February 24, 1982. At its height, the Sun headquarters were in Santa Clara, California, on the former west campus of the Agnews Developmental Center.

Cray Inc., a subsidiary of Hewlett Packard Enterprise, is an American supercomputer manufacturer headquartered in Seattle, Washington. It also manufactures systems for data storage and analytics. Several Cray supercomputer systems are listed in the TOP500, which ranks the most powerful supercomputers in the world.

Oracle Grid Engine, previously known as Sun Grid Engine (SGE), CODINE or GRD, was a grid computing computer cluster software system, acquired as part of a purchase of Gridware, then improved and supported by Sun Microsystems and later Oracle. There have been open source versions and multiple commercial versions of this technology, initially from Sun, later from Oracle and then from Univa Corporation.

<span class="mw-page-title-main">OpenSolaris</span> Open source operating system from Sun Microsystems based on Solaris

OpenSolaris is a discontinued open-source computer operating system based on Solaris and created by Sun Microsystems. It was also, perhaps confusingly, the name of a project initiated by Sun to build a developer and user community around the eponymous operating system software.

Lustre is a type of parallel distributed file system, generally used for large-scale cluster computing. The name Lustre is a portmanteau word derived from Linux and cluster. Lustre file system software is available under the GNU General Public License and provides high performance file systems for computer clusters ranging in size from small workgroup clusters to large-scale, multi-site systems. Since June 2005, Lustre has consistently been used by at least half of the top ten, and more than 60 of the top 100 fastest supercomputers in the world, including the world's No. 1 ranked TOP500 supercomputer in November 2022, Frontier, as well as previous top supercomputers such as Fugaku, Titan and Sequoia.

Fortress is a discontinued experimental programming language for high-performance computing, created by Sun Microsystems with funding from DARPA's High Productivity Computing Systems project. One of the language designers was Guy L. Steele Jr., whose previous work includes Scheme, Common Lisp, and Java.

The Oracle Cluster File System is a shared disk file system developed by Oracle Corporation and released under the GNU General Public License. The first version of OCFS was developed with the main focus to accommodate Oracle's database management system that used cluster computing. Because of that it was not a POSIX-compliant file system. With version 2 the POSIX features were included.

<span class="mw-page-title-main">Java (software platform)</span> Set of computer software and specifications

Java is a set of computer software and specifications developed by James Gosling at Sun Microsystems, which was later acquired by the Oracle Corporation, that provides a system for developing application software and deploying it in a cross-platform computing environment. Java is used in a wide variety of computing platforms from embedded devices and mobile phones to enterprise servers and supercomputers. Java applets, which are less common than standalone Java applications, were commonly run in secure, sandboxed environments to provide many features of native applications through being embedded in HTML pages.

<span class="mw-page-title-main">Chapel (programming language)</span> Parallel programming language

Chapel, the Cascade High Productivity Language, is a parallel programming language that was developed by Cray, and later by Hewlett Packard Enterprise which acquired Cray. It was being developed as part of the Cray Cascade project, a participant in DARPA's High Productivity Computing Systems (HPCS) program, which had the goal of increasing supercomputer productivity by 2010. It is being developed as an open source project, under version 2 of the Apache license.

OpenJDK is a free and open-source implementation of the Java Platform, Standard Edition. It is the result of an effort Sun Microsystems began in 2006. The implementation is licensed under the GPL-2.0-only with a linking exception. Were it not for the GPL linking exception, components that linked to the Java class library would be subject to the terms of the GPL license. OpenJDK is the official reference implementation of Java SE since version 7.

<span class="mw-page-title-main">Orca (assistive technology)</span> Accessibility software

Orca is a free and open-source, flexible, extensible screen reader from the GNOME project for individuals who are blind or visually impaired. Using various combinations of speech synthesis and braille, Orca helps provide access to applications and toolkits that support the AT-SPI.

<span class="mw-page-title-main">Univa</span> Software company

Univa was a software company that developed workload management and cloud management products for compute-intensive applications in the data center and across public, private, and hybrid clouds, before being acquired by Altair Engineering in September 2020.

<span class="mw-page-title-main">Blue Waters</span> Supercomputer at the University of Illinois at Urbana-Champaign, United States

Blue Waters was a petascale supercomputer operated by the National Center for Supercomputing Applications (NCSA) at the University of Illinois at Urbana-Champaign. On August 8, 2007, the National Science Board approved a resolution which authorized the National Science Foundation to fund "the acquisition and deployment of the world's most powerful leadership-class supercomputer." The NSF awarded $208 million for the Blue Waters project.

Univa Grid Engine (UGE) is a batch-queuing system, forked from Sun Grid Engine (SGE). The software schedules resources in a data center applying user-configurable policies to help improve resource sharing and throughput by maximizing resource utilization. The product can be deployed to run on-premises, using IaaS cloud computing or in a hybrid cloud environment.

<span class="mw-page-title-main">OpenZFS</span> Umbrella project that develops the ZFS filesystem as an open-source project

OpenZFS is a free and open-source storage platform licensed under CDDL, that encompasses the functionality of traditional filesystems and logical volume manager. It includes protection against data corruption, support for high storage capacities, efficient data compression, snapshots and copy-on-write clones, continuous integrity checking and automatic repair, encryption, remote replication with ZFS send and receive, and RAID-Z. The OpenZFS project brings together developers from the illumos, Linux, FreeBSD and macOS platforms, and a wide range of companies via the annual OpenZFS Developer Summit.

The HPCGbenchmark is a supercomputing benchmark test proposed by Michael Heroux from Sandia National Laboratories, and Jack Dongarra and Piotr Luszczek from the University of Tennessee. It is intended to model the data access patterns of real-world applications such as sparse matrix calculations, thus testing the effect of limitations of the memory subsystem and internal interconnect of the supercomputer on its computing performance. Because it is internally I/O bound, HPCG testing generally achieves only a tiny fraction of the peak FLOPS the computer could theoretically deliver.

The Cray XC50 is a massively parallel multiprocessor supercomputer manufactured by Cray. The machine can support Intel Xeon processors, as well as Cavium ThunderX2 processors, Xeon Phi processors and NVIDIA Tesla P100 GPUs. The processors are connected by Cray's proprietary "Aries" interconnect, in a dragonfly network topology. The XC50 is an evolution of the XC40, with the main difference being the support of Tesla P100 processors and the use of Cray software release CLE 6 or 7.

Peter J. Braam is a Dutch-American computer scientist, mathematician and entrepreneur focused on large-scale computing. As an academic, Braam held senior faculty positions at the University of Utah, Oxford, Carnegie Mellon, and visiting or adjunct positions at the University of British Columbia, the Chinese Academy of Sciences and the University of Cambridge.

Harriet Coverston is an American computer scientist and software developer focused on large-scale secondary storage environments, who has previously participated to various kernel developments in HPC systems. Harriet is an expert in large scale archiving systems, having participated to several large projects and product developments.

References

  1. 1 2 "OpenSFS Update LUG 2019" (PDF). OpenSFS. June 11, 2019. Retrieved September 16, 2020.
  2. ↑ "About Us". OpenSFS. Retrieved 1 October 2013.
  3. ↑ Peter J. Braam (August 4, 2002). "Lustre, The Inter-Galactic File System" (PDF). Presentation slides. Lawrence Livermore National Laboratory. Archived from the original (PDF) on May 15, 2013. Retrieved September 23, 2013.
  4. ↑ R. Kent Koeninger (June 2003). "The Ultra-Scalable HPTC Lustre Filesystem" (PDF). Slides for presentation at Cluster World 2003. Retrieved September 23, 2013.
  5. ↑ Britta Wülfing (September 13, 2007). "Sun Assimilates Lustre Filesystem". Linux Magazine. Retrieved September 23, 2013.
  6. ↑ "Sun Microsystems Expands High Performance Computing Portfolio with Definitive Agreement to Acquire Assets of Cluster File Systems, Including the Lustre File System". Press release. Sun Microsystems. September 12, 2007. Archived from the original on October 2, 2007. Retrieved September 23, 2013.
  7. ↑ "LUG Keynote Presentation" (PDF). April 15, 2010. Retrieved December 8, 2016.
  8. ↑ Rich Brueckner (January 10, 2011). "Oracle has Kicked Lustre to the Curb". Inside HPC. Retrieved October 25, 2016.
  9. ↑ Rich Brueckner (October 19, 2010). "OpenSFS Forms to Help Lustre Move On From the Dark Tower". Inside HPC. Retrieved October 25, 2016.
  10. ↑ Nicole Hemsoth (November 22, 2011). "Lustre Vendors Consider File System's Future". Inside HPC. Retrieved October 25, 2016.
  11. ↑ Rich Brueckner (April 16, 2013). "LUG 2013 Kicks Off with Surprise Announcement from OpenSFS". Inside HPC. Retrieved October 25, 2016.
  12. ↑ "Lustre Releases". HPDD Community Wiki. Intel. Retrieved October 25, 2016.
  13. ↑ Rich Brueckner (February 21, 2013). "With New RFP, OpenSFS to Invest in Critical Open Source Technologies for HPC". Inside HPC. Retrieved October 25, 2016.
  14. ↑ "OpenSFS Increases Investment in Open Source for HPC". Press release. HPC Wire. February 22, 2013. Archived from the original on March 5, 2013. Retrieved October 25, 2016.
  15. ↑ Prickett Morgan, Timothy (5 November 2013). "OpenSFS Announces Availability of Lustre 2.5". EnterpriseTech.
  16. ↑ Brueckner, Rich (5 November 2013). "Video: New Lustre 2.5 Release Offers HSM Capabilities". Inside Big Data. Retrieved 11 December 2013.
  17. ↑ Hemsoth, Nicole. "Lustre Gets Business Class Upgrade with HSM". HPCwire. Archived from the original on 17 December 2013. Retrieved 11 December 2013.
  18. ↑ "Lustre 2.5". Scientific Computing World. 12 November 2013. Retrieved 11 December 2013.
  19. ↑ "OpenSFS Offers Maintenance Release 2.10.1 for the Lustre File System". Press release (Press release). Global News Wire. October 22, 2017. Retrieved September 17, 2020.
  20. ↑ "Lustre Roadmap & Community Update". Inside HPC. January 11, 2019. Retrieved September 17, 2020.
  21. ↑ "Lustre Working Group". OpenSFS. September 17, 2020. Retrieved September 17, 2020.
  22. ↑ "Live Report from LUG 2016 Day 3". Inside HPC. April 9, 2016. Retrieved October 25, 2016.
  23. ↑ "Lustre Webinar September 2020". OpenSFS. September 9, 2020. Retrieved September 17, 2020.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.