StorNext File System

Last updated

StorNext File System (SNFS), colloquially referred to as StorNext is a shared disk file system made by Quantum Corporation. StorNext enables multiple Windows, Linux and Apple workstations to access shared block storage over a Fibre Channel network. With the StorNext file system installed, these computers can read and write to the same storage volume at the same time enabling what is known as a "file-locking SAN." StorNext is used in environments where large files must be shared, and accessed simultaneously by users without network delays, or where a file must be available for access by multiple readers starting at different times. Common use cases include multiple video editor environments in feature film, television and general video post production. [1]

Contents

History

The original name of StorNext was CentraVision File System (CVFS). It was created by MountainGate Imaging Systems Corporation to provide fast data transfer between Windows and SGI's IRIX computers. [2] Advanced Digital Information Corporation acquired MountainGate in September 1999, added additional client types, and changed the name to StorNext File System. [3] The first new clients were Solaris and Linux. In August 2006, Quantum acquired ADIC and added StorNext to its product family. [4] In January 2021, Quantum introduced the H-Series, a converged infrastructure that virtually runs file, block, and client services, providing on-premise storage for media production workflows. [5] In April 2022, Quantum released the H4000 Essential, a shared storage and collaboration platform for small, independent creative teams. It combines StorNext 7 software and CatDV asset management for automatic content indexing, discovery, and workflow collaboration. [6]

Infrastructure

StorNext has both software and hardware elements. On the front end, the filesystem is managed by usually two Metadata controllers, a primary and a failover or a metadata appliance. These MDC's act as the traffic director for the block-level filesystem with no data-overhead typically associated with NAS configured network shares.

Fibre Channel connectivity is a key element of most StorNext filesystem implementations. This is often referred to as "Production SAN" or "Production Storage Workspace." In verticals such as oil & gas, InfiniBand connectivity is sometimes used.

Client systems are not required to run the same operating system to access a shared filesystem containing StorNext data. As of January 2008, the operating systems with available client software are Microsoft Windows, macOS (as Xsan developed by Apple), Red Hat Linux, SuSE Linux, HP-UX, Solaris, AIX, and IRIX.

Client systems can be attached either directly to the SAN or via an IP gateway, called a DLC (Distributed LAN Controller). Two or more DLCs can be configured for failover and/or load balancing. While DLC is an IP based protocol, it has been customized for data traffic, making it more efficient (and higher performance) than traditional NAS. In some environments, users have also used the DLC infrastructure to enable lower performance file sharing via NFS or CIFS. Using all three capabilities, customers can create three tiers of front-end client performance: SAN, native DLC, and NAS, all leveraging a common file sharing architecture.

Quantum offers customers two choices for hardware infrastructure for StorNext: customized configurations, using the StorNext software on independently selected hardware; or, the use of the StorNext Appliances and Production Systems, a set of pre-configured solutions from Quantum which are said to be optimized for particular use cases (such as 4K editing). The latter solutions can include embedded technical support. [7]

Media and entertainment

A common application are television and feature film post-production as many multiple editors can access the same set of video data non-destructively. [8] [9]

StorNext has also been leveraged for high end motion and geoscience imagery in both commercial and public sector use cases, [10] and for high density forensic data, such as in cybersecurity. [11]


Archive integration

While colloquially, the StorNext File System is known as 'StorNext', the entire StorNext product is actually the combination of two technologies: the StorNext File System, and the optional StorNext Storage Manager. The StorNext Storage Manager is a policy based data management system that can copy, migrate and/or archive data from the StorNext File System into a variety of storage devices in multiple locations. Data can be tiered into disk, a Quantum Lattus object store, a robotic tape library, or even exported into an offline vault. Regardless of where the data resides, it is all maintained in a single namespace. Customers typically use this capability for three use cases. Some media customers use Storage Manager's policy tiering capability to enable the extension of primary disk storage into object storage or very high performance tape. With the introduction of Lattus-M object storage in 2013, Quantum introduced the capability to archive data durably (at greater than 11 9s) on disk, at very high throughput. Each Lattus-M disk controller can support up to 3 Gbit/s of single streaming performance for video or large files; and these controllers can be scaled horizontally to add performance as required. This has made the combination of StorNext and Lattus-M attractive for use cases such as rapid restore of video or motion imagery, or content distribution. Many customers also use Storage Manager to create granular and efficient data protection (as many versions of policy-selected files can be copied to a second data location or media without the need for a time and resource consuming 'file-walker', avoiding the pain of backup). Finally, administrators use Storage Manager as an HSM for migrating data between tiers (particularly to tape) for cost effective archive. Tapes created by Storage Manager can optionally be written in the LTO industry standard format (LTFS) to enable easy interchange.

See also

Related Research Articles

XFS is a high-performance 64-bit journaling file system created by Silicon Graphics, Inc (SGI) in 1993. It was the default file system in SGI's IRIX operating system starting with its version 5.3. XFS was ported to the Linux kernel in 2001; as of June 2014, XFS is supported by most Linux distributions; Red Hat Enterprise Linux uses it as its default file system.

Journaled File System (JFS) is a 64-bit journaling file system created by IBM. There are versions for AIX, OS/2, eComStation, ArcaOS and Linux operating systems. The latter is available as free software under the terms of the GNU General Public License (GPL). HP-UX has another, different filesystem named JFS that is actually an OEM version of Veritas Software's VxFS.

<span class="mw-page-title-main">Network-attached storage</span> Computer data storage server

Network-attached storage (NAS) is a file-level computer data storage server connected to a computer network providing data access to a heterogeneous group of clients. The term "NAS" can refer to both the technology and systems involved, or a specialized device built for such functionality.

Quantum Corporation is a data storage, management, and protection company that provides technology to store, manage, archive, and protect video and unstructured data throughout the data life cycle. Their products are used by enterprises, media and entertainment companies, government agencies, big data companies, and life science organizations. Quantum is headquartered in San Jose, California and has offices around the world, supporting customers globally in addition to working with a network of distributors, VARs, DMRs, OEMs and other suppliers.

In computing, the Global File System 2 or GFS2 is a shared-disk file system for Linux computer clusters. GFS2 allows all members of a cluster to have direct concurrent access to the same shared block storage, in contrast to distributed file systems which distribute data throughout the cluster. GFS2 can also be used as a local file system on a single computer.

The Write Anywhere File Layout (WAFL) is a proprietary file system that supports large, high-performance RAID arrays, quick restarts without lengthy consistency checks in the event of a crash or power failure, and growing the filesystems size quickly. It was designed by NetApp for use in its storage appliances like NetApp FAS, AFF, Cloud Volumes ONTAP and ONTAP Select.

<span class="mw-page-title-main">Xsan</span> Storage area network by Apple

Xsan is Apple Inc.'s storage area network (SAN) or clustered file system for macOS. Xsan enables multiple Mac desktop and Xserve systems to access shared block storage over a Fibre Channel network. With the Xsan file system installed, these computers can read and write to the same storage volume at the same time. Xsan is a complete SAN solution that includes the metadata controller software, the file system client software, and integrated setup, management and monitoring tools.

Lustre is a type of parallel distributed file system, generally used for large-scale cluster computing. The name Lustre is a portmanteau word derived from Linux and cluster. Lustre file system software is available under the GNU General Public License and provides high performance file systems for computer clusters ranging in size from small workgroup clusters to large-scale, multi-site systems. Since June 2005, Lustre has consistently been used by at least half of the top ten, and more than 60 of the top 100 fastest supercomputers in the world, including the world's No. 1 ranked TOP500 supercomputer in November 2022, Frontier, as well as previous top supercomputers such as Fugaku, Titan and Sequoia.

IBM Storage Protect is a data protection platform that gives enterprises a single point of control and administration for backup and recovery. It is the flagship product in the IBM Spectrum Protect family.

GPFS is high-performance clustered file system software developed by IBM. It can be deployed in shared-disk or shared-nothing distributed parallel modes, or a combination of these. It is used by many of the world's largest commercial companies, as well as some of the supercomputers on the Top 500 List. For example, it is the filesystem of the Summit at Oak Ridge National Laboratory which was the #1 fastest supercomputer in the world in the November 2019 TOP500 list of supercomputers. Summit is a 200 Petaflops system composed of more than 9,000 POWER9 processors and 27,000 NVIDIA Volta GPUs. The storage filesystem called Alpine has 250 PB of storage using Spectrum Scale on IBM ESS storage hardware, capable of approximately 2.5 TB/s of sequential I/O and 2.2 TB/s of random I/O.

Although all RAID implementations differ from the specification to some extent, some companies and open-source projects have developed non-standard RAID implementations that differ substantially from the standard. Additionally, there are non-RAID drive architectures, providing configurations of multiple hard drives not referred to by RAID acronyms.

A clustered file system (CFS) is a file system which is shared by being simultaneously mounted on multiple servers. There are several approaches to clustering, most of which do not employ a clustered file system. Clustered file systems can provide features like location-independent addressing and redundancy which improve reliability or reduce the complexity of the other parts of the cluster. Parallel file systems are a type of clustered file system that spread data across multiple storage nodes, usually for redundancy or performance.

The Linear Tape File System (LTFS) is a file system that allows files stored on magnetic tape to be accessed in a similar fashion to those on disk or removable flash drives. It requires both a specific format of data on the tape media and software to provide a file system interface to the data.

Next3 is a journaling file system for Linux based on ext3 which adds snapshots support, yet retains compatibility to the ext3 on-disk format. Next3 is implemented as open-source software, licensed under the GPL license.

BeeGFS is a parallel file system, developed and optimized for high-performance computing. BeeGFS includes a distributed metadata architecture for scalability and flexibility reasons. Its most used and widely known aspect is data throughput.

Blue Whale Clustered file system (BWFS) is a shared disk file system made by Tianjin Zhongke Blue Whale Information Technologies Company in China.

<span class="mw-page-title-main">Dell Fluid File System</span> Filesystem by Dell

Dell Fluid File System, or FluidFS, is a shared-disk filesystem made by Dell that provides distributed file systems to clients. Customers buy an appliance: a combination of purpose-built network-attached storage (NAS) controllers with integrated primary and backup power supplies attached to block level storage via the iSCSI or Fiber Channel protocol. A single Dell FluidFS appliance consists of two controllers operating in concert connecting to the back-end storage area network (SAN). Depending on the storage capacity requirements and user preference, FluidFS version 4 NAS appliances can be used with Compellent or EqualLogic SAN arrays. The EqualLogic FS7600 and FS7610 connect to the client network and to Dell's EqualLogic arrays with either 1 Gbit/s (FS7600) or 10 Gbit/s (FS7610) iSCSI protocol. For Compellent, FluidFS is available with either 1 Gbit/s or 10 Gbit/s iSCSI connectivity to the client network and connection to the backend Compellent SAN can be either 8 Gbit/s Fibre Channel or 10 Gbit/s iSCSI.

Nirvana was virtual object storage software developed and maintained by General Atomics.

ONTAP or Data ONTAP or Clustered Data ONTAP (cDOT) or Data ONTAP 7-Mode is NetApp's proprietary operating system used in storage disk arrays such as NetApp FAS and AFF, ONTAP Select, and Cloud Volumes ONTAP. With the release of version 9.0, NetApp decided to simplify the Data ONTAP name and removed the word "Data" from it, removed the 7-Mode image, therefore, ONTAP 9 is the successor of Clustered Data ONTAP 8.

References

  1. "Create. Innovate. Protect. On Quantum".
  2. trademarkia.com, CentraVision
  3. "thefreelibrary.com, ADIC Acquires SAN Software Company; High Performance File Sharing to Enhance Storage Solutions. EDMOND, Wash. (BUSINESS WIRE) Sept. 20, 1999". Archived from the original on 2014-09-03. Retrieved 2014-08-29.
  4. CRN, Quantum To Acquire ADIC, byJoseph F. Kovar, May 3, 2006
  5. Mellor, Chris (2021-01-27). "Quantum upgrades hybrid storage appliance". Blocks and Files. Retrieved 2022-09-07.
  6. Smith, Lyle (2022-04-19). "Quantum H4000 Essential and F2100 NVMe Storage Appliances Now Available". StorageReview.com. Retrieved 2022-09-08.
  7. "Home". stornext.com.
  8. "Create. Innovate. Protect. On Quantum".
  9. "Create. Innovate. Protect. On Quantum".
  10. http://www.quantum.com: "Proven Mission Information Workflows for Intelligence and Defense"
  11. "Quantum Cybersecurity Solutions".