IBM Tivoli Storage Manager

Last updated
IBM Storage Protect
Other namesIBM Spectrum Protect, Tivoli Storage Manager
Developer(s) IBM
Stable release
8.1.24 [1] [2] / September 27, 2024;29 days ago (2024-09-27) [3] [4]
Operating system cross-platform
Type backup
License Proprietary
Website ibm.com/products/storage-protect

IBM Storage Protect (formerly IBM Spectrum Protect, Tivoli Storage Manager (TSM)) is a data protection platform that gives enterprises a single point of control and administration for backup and recovery. It is the flagship product in the IBM Spectrum Protect (Tivoli Storage Manager) family.

Contents

It enables backups and recovery for virtual, physical and cloud environments of all sizes.

This product is part of the IBM Spectrum Software Defined Storage suite of products and is unrelated to the Tivoli Management Framework.

History

TSM descended from a project done at IBM's Almaden Research Center around 1988 to back up VM/CMS systems. The first product that emerged was Workstation Data Save Facility (WDSF). WDSF's original purpose was to back up PC/DOS, OS/2, and AIX workstation data onto a VM/CMS (and later MVS) server. WDSF morphed into ADSTAR Distributed Storage Manager (ADSM) and was re-branded Tivoli Storage Manager in 1999.

Photo of an IBM Technical Award from 1991 given to the original Workstation Data Save Facility (WDSF) team at the IBM Almaden Research Center in San Jose, CA, USA. Original IBM Almaden Research WDSF team from an IBM technical award.jpg
Photo of an IBM Technical Award from 1991 given to the original Workstation Data Save Facility (WDSF) team at the IBM Almaden Research Center in San Jose, CA, USA.

The TSM database (through release 5.5) was a bespoke B+ tree database; although the TSM database used many of the same underlying technologies as IBM's Db2, has a SQL engine (for read-only use), and supports access through ODBC, the database had an architectural limit of approximately 530 GB, and 13 GB of log space. Starting with TSM 6.1, released in May 2009, TSM uses a Db2 instance as its database (thus eliminating the architectural limitations of the previous TSM database).

Product details

TSM maintains a relational database (limit 534GB through TSM v5.5, 4TB with TSM v6.3.3+) and recovery log (aka transaction log, limit 13 GB through TSM v5.5, 128GB with TSM v6.1+) for logging, configuration, statistical information, and object metadata. v5.5 DB pages are always 4KB, and partitions every 4MB. Single row inserts only. On average, 20GB of space is consumed for every 25 million objects. Shallow directory structures use less TSM DB space than deeper paths. This database may generally be queried via an emulated SQL-98 compliant interface, or through undocumented SHOW, CREATE or DELETE commands.

Actual user data is managed via a cascading hierarchy of storage media (Primary Storage Pools) presented as raw devices (UNIX), filesystem containers (Windows and Linux), streaming tape or optical media. Additionally, emulated tape from a Virtual Tape Library or EMC Centera WORM archival device is supported. Duplicate copies (backup sets or Copy Storage Pools) of any subset of data may be created on sequential media for redundancy or off-site management.

The 5.5 release of the TSM Server was supported on AIX, HP-UX, Linux, Solaris, Windows Server, and z/OS. The TSM Client of the same release is supported on NetWare, macOS, AIX, HP-UX, Linux, z/OS, Solaris, and Windows 32/64-bit. [5] The 6.1 release of the TSM Server is supported on AIX, HP-UX, Linux, Solaris, and Windows Server, while the TSM Client is supported on the same operating systems as 5.5. [5] On October 21, 2011, TSM 6.3 was released. [6] Version 8.1.21 was released in December 2023.

Components

Tivoli Storage Manager as a system is made up of several different components. The major components of TSM include: TSM Server, TSM Client, TSM Storage Agent, TSM Data Protector, TSM Operation Center and TSM Administration Center.

Data Sources

The most Common data source for TSM is the TSM Client ("TSM Backup/Archive Client" or "B/A Client"). The B/A Client allows backup and restore of data both "selectively" and "incrementally", which is generally known as "Progressive Incremental" or "Incremental Forever", as each unique client+filespace+path+file combination is separately tracked for retention. Further, a separate method is provided by the B/A Client which is known as archive (and retrieve). This method generates groupings of objects to be retained as a single unit. This still differs from traditional full/incremental style backup products in that the files are stored separately or in smaller aggregates rather than as a monolithic image. Additionally, there is no provision for an incremental archive.

Other data injectors include policy-based hierarchical storage management (HSM) components for AIX, Linux and Windows. These allow migration of data from production disk into one or more of the TSM storage hierarchies while maintaining transparent access to that data by the use of DMAPI or NTFS reparse points.

IBM General Parallel File System (GPFS) can use TSM as a storage tier for GPFS' Information Lifecycle Management (ILM) which provides HSM for a GPFS filesystem. A GPFS filesystem can be simultaneously accessed from multiple servers running Linux, Windows, and AIX by using GPFS filesystem software installed on any of these operating system platforms. GPFS provides transparent access to data whether online on disk or migrated to tape by requesting file saves and retrieves from TSM.

Additionally, many applications provide or are provided with TSM API connections allowing the storage of databases, mail systems, system backups and even arbitrary user data within TSM's repository. Aside from TSM's UNIX HSM product, only the "Backup" and "Archive" management facilities are accessed through the client API.

Agents

The TSM architecture makes use of two special-purpose agents. The LAN-Free Storage Agent is a limited function TSM server which is configured as a library client and uses server-to-server communication to coordinate the use of storage resources which are configured to TSM but which are also presented to the storage agent. Usually this LAN-free and server-free backup agent is installed on the specific client; however, it is network accessible and could be utilized to bypass network bottlenecks. One example would be to connect via infiniband between two Bladecenter chassis, where one has SAN attachment to tape, and the other does not. This could bypass limited ethernet bandwidth without having to move the TSM server instance.

The NDMP API agent is used by NetApp devices and other network attached storage (NAS) devices to allow backup access to the appliance itself rather than having to back up the device via an attached NAS client.appliance direct access to shared tape.

Administration

Administrative functions are accessed through the TSM Administrative command line interface tool or via a web based portal application known as the TSM Operations Center.

Subproducts & Other Products

Enterprise Edition Features

Associated Products

IBM's naming convention is to prefix every product name with "IBM Tivoli Storage Manager"; most products require an additional license. See also IBM Tivoli Storage Manager FastBack for more information on IBM's TSM product for block-level, continuous data protection.

Interface Products

Non-Tivoli API Clients

See also

Related Research Articles

<span class="mw-page-title-main">Ingres (database)</span> Database software

Ingres Database is a proprietary SQL relational database management system intended to support large commercial and government applications.

<span class="mw-page-title-main">IBM Db2</span> Relational model database server

Db2 is a family of data management products, including database servers, developed by IBM. It initially supported the relational model, but was extended to support object–relational features and non-relational structures like JSON and XML. The brand name was originally styled as DB2 until 2017, when it changed to its present form.

DataFlex is an object-oriented high-level programming language and a fourth generation visual tool for developing Windows, web and mobile software applications on one framework-based platform. It was introduced and developed by Data Access Corporation beginning in 1982.

IBM Systems Director is an element management system (EMS) first introduced by IBM in 1993 as NetFinity Manager. The software was originally written to run on OS/2 2.0. It has subsequently gone through a number of name changes in the interim. It was changed in 1996 to IBM PC SystemView. Later that same year, it was renamed to TME 10 NetFinity. The following year, it reverted to a slightly altered version of its original name: IBM Netfinity Manager.

<span class="mw-page-title-main">File system</span> Computer filing system

In computing, a file system or filesystem governs file organization and access. A local file system is a capability of an operating system that services the applications running on the same computer. A distributed file system is a protocol that provides file access between networked computers.

Hierarchical storage management (HSM), also known as tiered storage, is a data storage and data management technique that automatically moves data between high-cost and low-cost storage media. HSM systems exist because high-speed storage devices, such as solid-state drive arrays, are more expensive than slower devices, such as hard disk drives, optical discs and magnetic tape drives. While it would be ideal to have all data available on high-speed devices all the time, this is prohibitively expensive for many organizations. Instead, HSM systems store the bulk of the enterprise's data on slower devices, and then copy data to faster disk drives when needed. The HSM system monitors the way data is used and makes best guesses as to which data can safely be moved to slower devices and which data should stay on the fast devices.

EMC NetWorker is an enterprise-level data protection software product from Dell EMC that unifies and automates backup to tape, disk-based, and flash-based storage media across physical and virtual environments for granular and disaster recovery.

Veritas Backup Exec is a data protection software product designed for customers with mixed physical and virtual environments, and who are moving to public cloud services. Supported platforms include VMware and Hyper-V virtualization, Windows and Linux operating systems, Amazon S3, Microsoft Azure and Google Cloud Storage, among others. All management and configuration operations are performed with a single user interface. Backup Exec also provides integrated deduplication, replication, and disaster recovery capabilities and helps to manage multiple backup servers or multi-drive tape loaders.

GPFS is high-performance clustered file system software developed by IBM. It can be deployed in shared-disk or shared-nothing distributed parallel modes, or a combination of these. It is used by many of the world's largest commercial companies, as well as some of the supercomputers on the Top 500 List. For example, it is the filesystem of the Summit at Oak Ridge National Laboratory which was the #1 fastest supercomputer in the world in the November 2019 Top 500 List. Summit is a 200 Petaflops system composed of more than 9,000 POWER9 processors and 27,000 NVIDIA Volta GPUs. The storage filesystem is called Alpine.

Embedded SQL is a method of combining the computing power of a programming language and the database manipulation capabilities of SQL. Embedded SQL statements are SQL statements written inline with the program source code, of the host language. The embedded SQL statements are parsed by an embedded SQL preprocessor and replaced by host-language calls to a code library. The output from the preprocessor is then compiled by the host compiler. This allows programmers to embed SQL statements in programs written in any number of languages such as C/C++, COBOL and Fortran. This differs from SQL-derived programming languages that don't go through discrete preprocessors, such as PL/SQL and T-SQL.

SAP SQL Anywhere is a proprietary relational database management system (RDBMS) product from SAP. SQL Anywhere was known as Sybase SQL Anywhere prior to the acquisition of Sybase by SAP.

<span class="mw-page-title-main">IBM storage</span> Product portfolio of IBM

The IBM Storage product portfolio includes disk, flash, tape, NAS storage products, storage software and services. IBM's approach is to focus on data management.

A clustered file system (CFS) is a file system which is shared by being simultaneously mounted on multiple servers. There are several approaches to clustering, most of which do not employ a clustered file system. Clustered file systems can provide features like location-independent addressing and redundancy which improve reliability or reduce the complexity of the other parts of the cluster. Parallel file systems are a type of clustered file system that spread data across multiple storage nodes, usually for redundancy or performance.

Catalogic DPX is an enterprise-level data protection tool that backs up and restores data and applications for a variety of operating systems. It has data protection, disaster recovery and business continuity planning capabilities. Catalogic DPX protects physical servers or virtual machines on VMWare vSphere and Microsoft Hyper-V hypervisors, supports many database applications, including Oracle, SQL Server, SharePoint, Exchange, and SAP HANA. DPX supports agent-based or agent-less backups. Users can map to and use a backed up version of the database if something goes wrong with the primary version. DPX is managed from a single console and catalog. This allows for centralized control of both tape-based and disk-based data protection jobs across heterogeneous operating systems. DPX can protect data centers, remote sites and supports recovery from DR. DPX can protect data to disk, tape or cloud. It is used for various recovery use cases including file, application, BMR, VM or DR. DPX can spin up VMs from backup images, recover physical servers, bring up applications online from snapshot based backups, it can be used to recover from Ransomware.

StorNext File System (SNFS), colloquially referred to as StorNext is a shared disk file system made by Quantum Corporation. StorNext enables multiple Windows, Linux and Apple workstations to access shared block storage over a Fibre Channel network. With the StorNext file system installed, these computers can read and write to the same storage volume at the same time enabling what is known as a "file-locking SAN." StorNext is used in environments where large files must be shared, and accessed simultaneously by users without network delays, or where a file must be available for access by multiple readers starting at different times. Common use cases include multiple video editor environments in feature film, television and general video post production.

High Performance Storage System (HPSS) is a flexible, scalable, policy-based, software-defined hierarchical storage management (HSM) product developed by the HPSS Collaboration. It provides scalable HSM, archive, and file system services using cluster, LAN and storage area network (SAN) technologies to aggregate the capacity and performance of many computers, disks, disk systems, tape drives, and tape libraries.

Transparent Data Encryption is a technology employed by Microsoft, IBM and Oracle to encrypt database files. TDE offers encryption at file level. TDE enables the encryption of data at rest, encrypting databases both on the hard drive and consequently on backup media. It does not protect data in transit nor data in use. Enterprises typically employ TDE to solve compliance issues such as PCI DSS which require the protection of data at rest.

A stub file is a computer file that appears to the user to be on disk and immediately available for use, but is actually held either in part or entirely on a different storage medium. When a stub file is accessed, device driver software intercepts the access, retrieves the data from its actual location and writes it to the file, then allows the user's access to proceed. Typically, users are unaware that the file's data is stored on a different medium, though they may experience a slight delay when accessing such a file.

NetVault is a set of data protection software developed and supported by Quest Software. NetVault Backup is a backup and recovery software product. It can be used to protect data and software applications in physical and virtual environments from one central management interface. It supports many servers, application platforms, and protocols such as UNIX, Linux, Microsoft Windows, VMware, Microsoft Hyper-V, Oracle, Sybase, Microsoft SQL Server, NDMP, Oracle ACSLS, IBM DAS/ACI, Microsoft Exchange Server, DB2, and Teradata.

References

  1. IBM Storage Protect Downloads - Latest Fix Packs and interim fixes
  2. APARs fixed in the IBM Storage Protect server Version 8.1 fix pack levels
  3. 8.1.24 Server: What's new
  4. 8.1.24 Client: What's new
  5. 1 2 "Tivoli Storage Manager Supported Operating Systems". IBM. 2009-07-23. Retrieved 2009-07-30.
  6. IBM Tivoli Storage Manager (TSM) Client APARs fixed in 6.3.0 and 6.3.0.x - United States
  7. "Home". tsm-pa-solutions.com.