Data Facility Storage Management Subsystem (MVS)

Last updated

Data Facility Storage Management Subsystem [lower-alpha 1] (DFSMS) is a central component of IBM's flagship operating system z/OS. It includes access methods, utilities and program management functions. Data Facility Storage Management Subsystem is also a collective name for a collection of several products, all but two of which are included in the DFSMS/MVS product.

Contents

History

In 1972 IBM announced the first release of the OS/VS2 operating system for the IBM System 370 systems; that release later was known as Single Virtual Storage (SVS). In 1974 IBM announced release 2.0; that release and all subsequent releases became known as Multiple Virtual Storage (MVS). All releases of OS/VS2 were available to no charge because the software cost was bundled with the hardware cost. OS/VS2 Release 3.8 was the last free release of MVS.

In the late seventies and early eighties IBM announced:

5740-XE1 MVS/System Extensions (MVS/SE)
MVS/SE improves the performance and RAS of OS/VS2 (MVS)
5740-AM6 Data Facility Device Support (DFDS) for OS/VS1
5740-AM7 Data Facility Device Support (DFDS) for MVS
DFDS supports an indexed VTOC, and with the proper PTF supports the Speed Matching Buffer on the IBM 3880.
5740-XYQ Data Facility Extended Function (DFEF)
DFEF offers a new type of VSAM catalog, but had reliability problems that were only resolved in DFP.
5740-AM3 Sequential Access Method Extended (SAM-E)
SAM-E improves the performance of BPAM, BSAM and QSAM on direct access storage devices.
5740-AM8 Access Method Services Cryptographic Option
5748-UT2 Offline 3800 Utility

In June 1980, IBM announced MVS/System Product (MVS/SP) as a replacement for MVS/SE.

On October 21, 1981, IBM announced [1] new Kxx models of the 3081, supporting a new architecture known as System/370 Extended Architecture (370-XA). IBM also announced [2] MVS/Extended Architecture (MVS/XA), consisting of MVS/SP Version 2 [3] and a corequisite new product, Data Facility Product [4] (DFP), 5665-284, replacing [lower-alpha 2] five of the products listed above, the linkage editor and the loader.

On May 17, 1983, IBM announced [5] MVS/370 Data Facility Product (MVS/370 DFP), 5665-295, for MVS/SP Version 1 Release 3, replacing [lower-alpha 2] the same five programs as DFP for MVS/XA.

On February 5, 1985, IBM announced [6] MVS/XA Data Facility Product (MVS/XA DFP) Version 2, 5655-XA2, as a replacement for MVS/XA Data Facility Product Version 1, 5665-284. DFP replaced BDAM, BPAM, BSAM, ISAM, QSAM and VSAM.

On February 15, 1988 IBM announced [7] MVS/System Product Version 3 (MVS/ESA), it also announced [8] MVS/Data Facility Product Version 3 (MVS/DFP), 5665-XA3; MVS/SP V3 required either MVS/XA Data Facility Product Version 2, 5655-XA2, or Version 3. More recent releases were corequisites for MVS/ESA SP Version 4 and MVS/ESA SP Version 5.

On April 19, 1988, IBM announced [9] the umbrella term Data Facility Storage Management Subsystem for facilities provided by the programs

In addition to replacing part of the device support in the base MVS/SP, DFP replaces the Linkage Editor and several utility programs and service aids.

DFP is no longer available as a separate product, but has become part of Data Facility Storage Management Subsystem, under the name DFSMSdfp.

On May 19, 1992, IBM announced [10] DFSMS/MVS, 5695-DF1, replacing MVS/Data Facility Product (MVS/DFP) Version 3, 5665-XA3, Data Facility Hierarchical Storage Manager (DFHSM) Version 2, 5665-329 and Data Facility Data Set Services (DFDSS) Version 2, 5665-327. DFSMS/MVS also replaced utilities and service aids. DSDSS and DFHSM became optional chargeable features of DFSMS; DFSORT and RACF remained separate products. While DFSMS/MVS Release 1 still included ISAM, IBM eventually dropped it, but continued to support the ISAM compatibility interface to VSAM. DFSMS/MVS R1 included the optional Removeable Media Manager (DFSMSrmm), which supports both manual tape libraries and the 3495 [11] Tape Library Dataserver.

On March 1, 1994, IBM announced [12] DFSMS/MVS Release 2.

On March 1, 1994, IBM announced [13] DFSMS/MVS Release 3.

On March 1, 1994, IBM announced [14] DFSMS/MVS Release 4.

On March 1, 1994, IBM announced [15] DFSMS/MVS Release 5.

Components

This section describes features of DFSMS from the perspective of z/OS; it does not distinguish between features added by, e.g., DFDS, and features added in the latest release of z/OS.

DFSMSdss

DFSMSdss [lower-alpha 4] is a chargeable feature of DFSMS that can dump and restore selected data sets and selected volumes based on specifications in control statements. It is also referred to in documentation as a data mover. DSS replaces the older DASDR and the dump/restore facilities of IEHDASDR, although the dump formats are not compatible.

DFSMSdfp

DFSMSdfp [lower-alpha 5] replaces the older direct, index and sequential access methods, the utilities and service aids, the linkage editor, the loader and program fetch. It is the component to which new device support code is added. DFSMSdfp adds a number of loosely related facilities.

Indexed VTOC

The VTOC structure inherited from OS/360 uses records with 44 byte keys, and a sequential search using a Search Key Equal/TIC *-8 loop. The VTOC Index (VTOCIX) is an optional data set that indexes Data Set Control Blocks (DSCBs) and allows a faster search.

ICF catalog

The Improved Catalog Facility (ICF) replaces the OS/360 Control Volume (CVOL) and the VSAM catalog with a more resilient catalog structure.

PDSE

Partitoned Data Set Extended (PDSE) is a new type of dataset that resolves several issues with the old PDS organization but that can be read and written by existing BPAM, BSAM and QSAM code.

System Managed Storage

System Managed Storage (SMS) is a set of facilities for controlling the placement, migration and retention of datasets on direct access storage devices that is more flexible than older methods, e.g., VOL=SER specifications in JCL. Prior to SMS, the installations defined unit names during system generation, [lower-alpha 6] and two pools of DASD volumes, called PUBLIC and STORAGE, in a member of the system parameter library. In addition, users had to explicitly define characteristics of new datasets.

With SMS, an installation can define and update several types of lists, described [16] by IBM as

Data Class
Data definition parameters
Storage Class
Availability and accessibility requirements
Management Class
Data migration, backup, and retention attributes
Storage Group
List of storage volumes with common properties
Aggregate Group
Backup or recovery of all data sets in a group in a single operation
Copy Pool

The installation can also define automatic class selection (ACS) rules that can test, e.g., data set name, and select list names based on installation policies and user requests. A common scenario is for the installation to write a storage group ACS routine to ignore any UNIT parameter and to select the storage group, and to write a DATACLASS ACS rule to assign a dataclass that has default DCB parameters, with both making decisions based on the data set name.

When SMS is active, several new parameters are available in dynamic allocation and the DD JCL statement, e.g., DSNTYPE.

The Binder

The Binder is a program similar to the linkage editor that can also manage program objects on a PDSE library.

Remote copy and mirroring

DFSMSdfp provides facilities for using several different protocols to duplicate or mirror DASD volumes to a remote location.

OAM

Object Access Method [17] (OAM) maintains a library of unstructured objects. Such objects are sometimes referred to as BLOBs.

DFSORT

DFSORT is a sort/merge utility that is part of the DFSMS family but not part of the DFSMS/MVS product.

DFSMShsm

DFSMShsm, originally Hierarchical Storage Manager (HSM), 5740-XRB, and later Data Facility Hierarchical Storage Manager Version 2 (DFHSM), 5665-329, before becoming an optional component of DFSMS, is a utility for archiving and retrieving datasets. It migrates data from faster storage to less expensive storage, either based on time stamps or explicit requests. It uses DFSMSdss as a data mover.

RACF

RACF is a security program that is part of the DFSMS family but not part of the DFSMS/MVS product. It includes an API called SAF that allows applications to do authentication and to check access privileges, and also includes an interface to LDAP.

DFSMSrmm

The Removable Media Manager (DFSMSrmm) controls libraries of tapes, whether manually mounted on tape drive or stored in an automated tape library.

Notes

  1. While the syntax for an Automatic Class Selection (ACS) is similar, Data Facility Storage Management Subsystem/VM in z/VM manages a different set of resources and uses different code for I/O.
  2. 1 2 DFP replace these products in their entirety
    • 5740-AM7 Data Facility Device Support (DFDS)
    • 5740-XYQ Data Facility Extended Function (DFEF)
    • 5740-AM3 Sequential Access Method Extended (SAM-E)
    • 5740-AM8 Access Method Services Cryptographic Option
    • 5748-UT2 Offline 3800 Utility
  3. DSS cannot read dumps produced by IEHDASDR or by 5740-UT1, Direct Access Storage Dump Restore (DASDR).
  4. Originally a separate product called Data Facility Data Set Services (DFDSS), 5740-UT3.
  5. Originally called Data Facility Product.
  6. Eventually IBM replaced the sysgenn method of defining device names with the new MVSCP and HCD programs.

Related Research Articles

<span class="mw-page-title-main">MVS</span> Operating system for IBM mainframes

Multiple Virtual Storage, more commonly called MVS, is the most commonly used operating system on the System/370, System/390 and IBM Z IBM mainframe computers. IBM developed MVS, along with OS/VS1 and SVS, as a successor to OS/360. It is unrelated to IBM's other mainframe operating system lines, e.g., VSE, VM, TPF.

z/OS 64-bit operating system for IBM mainframes

z/OS is a 64-bit operating system for IBM z/Architecture mainframes, introduced by IBM in October 2000. It derives from and is the successor to OS/390, which in turn was preceded by a string of MVS versions. Like OS/390, z/OS combines a number of formerly separate, related products, some of which are still optional. z/OS has the attributes of modern operating systems but also retains much of the older functionality that originated in the 1960s and is still in regular use—z/OS is designed for backward compatibility.

<span class="mw-page-title-main">OS/390</span> Operating system for IBM mainframes

OS/390 is an IBM operating system for the System/390 IBM mainframe computers.

A direct-access storage device (DASD) is a secondary storage device in which "each physical record has a discrete location and a unique address". The term was coined by IBM to describe devices that allowed random access to data, the main examples being drum memory and hard disk drives. Later, optical disc drives and flash memory units are also classified as DASD.

<span class="mw-page-title-main">IBM System/370</span> Family of mainframe computers 1970–1990

The IBM System/370 (S/370) is a range of IBM mainframe computers announced as the successors to the System/360 family on June 30, 1970. The series mostly maintains backward compatibility with the S/360, allowing an easy migration path for customers; this, plus improved performance, were the dominant themes of the product announcement.

This article presents a timeline of events in the history of computer operating systems from 1951 to the current day. For a narrative explaining the overall developments, see the History of operating systems.

<span class="mw-page-title-main">VM (operating system)</span> Family of IBM operating systems

VM is a family of IBM virtual machine operating systems used on IBM mainframes System/370, System/390, zSeries, System z and compatible systems, including the Hercules emulator for personal computers.

Virtual Storage Access Method (VSAM) is an IBM direct-access storage device (DASD) file storage access method, first used in the OS/VS1, OS/VS2 Release 1 (SVS) and Release 2 (MVS) operating systems, later used throughout the Multiple Virtual Storage (MVS) architecture and now in z/OS. Originally a record-oriented filesystem, VSAM comprises four data set organizations: key-sequenced (KSDS), relative record (RRDS), entry-sequenced (ESDS) and linear (LDS). The KSDS, RRDS and ESDS organizations contain records, while the LDS organization contains a sequence of pages with no intrinsic record structure, for use as a memory-mapped file.

<span class="mw-page-title-main">CICS</span> IBM mainframe transaction monitor

IBM CICS is a family of mixed-language application servers that provide online transaction management and connectivity for applications on IBM mainframe systems under z/OS and z/VSE.

z/OS UNIX System Services is a base element of z/OS. z/OS UNIX is a certified UNIX operating system implementation optimized for mainframe architecture. It is the first UNIX 95 to not be derived from the AT&T source code. Through integration with the rest of z/OS, additional Time Sharing Option (TSO) commands are available alongside the usual UNIX services, making it possible to process UNIX files using ISPF. Extensions in JCL make it possible to use these files in batch processing.

This article discusses support programs included in or available for OS/360 and successors. IBM categorizes some of these programs as utilities and others as service aids; the boundaries are not always consistent or obvious. Many, but not all, of these programs match the types in utility software.

The Job Entry Subsystem (JES) is a component of IBM's MVS mainframe operating systems that is responsible for managing batch workloads. In modern times, there are two distinct implementations of the Job Entry System called JES2 and JES3. They are designed to provide efficient execution of batch jobs.

Hierarchical storage management (HSM), also known as tiered storage, is a data storage and data management technique that automatically moves data between high-cost and low-cost storage media. HSM systems exist because high-speed storage devices, such as solid-state drive arrays, are more expensive than slower devices, such as hard disk drives, optical discs and magnetic tape drives. While it would be ideal to have all data available on high-speed devices all the time, this is prohibitively expensive for many organizations. Instead, HSM systems store the bulk of the enterprise's data on slower devices, and then copy data to faster disk drives when needed. The HSM system monitors the way data is used and makes best guesses as to which data can safely be moved to slower devices and which data should stay on the fast devices.

<span class="mw-page-title-main">OS/VS1</span> IBM operating system

Operating System/Virtual Storage 1, or OS/VS1, is a discontinued IBM mainframe computer operating system designed to be run on IBM System/370 hardware. It was the successor to the Multiprogramming with a Fixed number of Tasks (MFT) option of System/360's operating system OS/360. OS/VS1, in comparison to its predecessor, supported virtual memory. OS/VS1 was generally available during the 1970s and 1980s, and it is no longer supported by IBM.

The history of IBM mainframe operating systems is significant within the history of mainframe operating systems, because of IBM's long-standing position as the world's largest hardware supplier of mainframe computers. IBM mainframes run operating systems supplied by IBM and by third parties.

<span class="mw-page-title-main">OS/360 and successors</span> Operating system for IBM S/360 and later mainframes

OS/360, officially known as IBM System/360 Operating System, is a discontinued batch processing operating system developed by IBM for their then-new System/360 mainframe computer, announced in 1964; it was influenced by the earlier IBSYS/IBJOB and Input/Output Control System (IOCS) packages for the IBM 7090/7094 and even more so by the PR155 Operating System for the IBM 1410/7010 processors. It was one of the earliest operating systems to require the computer hardware to include at least one direct access storage device.

<span class="mw-page-title-main">System Generation (OS)</span> Process for configuring some IBM operating systems

System Generation (SysGen) is a two-stage process for installing or updating OS/360, OS/VS1, OS/VS2 (SVS), OS/VS2 (MVS) and chargeable systems derived from them. There are similar processes for, e.g., DOS/360, which this article does not cover. Also, some of the details have changed between releases of OS/360 and many details do not carry over to later systems.

<span class="mw-page-title-main">OS/VS2 (SVS)</span> Operating system

Single Virtual Storage (SVS) refers to Release 1 of Operating System/Virtual Storage 2 (OS/VS2); it is the successor system to the MVT option of Operating System/360. OS/VS2 (SVS) was a stopgap measure pending the availability of MVS, although IBM provided support and enhancements to SVS long after shipping MVS.

IBM's Hierarchical File System (HFS) is a POSIX-style hierarchical file system for the MVS/ESA/SP through z/OS operating systems.

The term IBM platform could refer to any of the hardware and operating systems below.

References

  1. "3081 Processor Complex Models K16, K24 and K32 - New System/370 Extended Architecture (370-XA) Added to 3081". IBM (Announcement Letter). October 21, 1981. ZG81-0263.
  2. "MVS/XA System Overview - New Levels of System Function Provided by MVS/Extended Architecture (XA)". IBM (Announcement Letter). October 21, 1981. LTR ZP81-0789.
  3. "System/370 Extended Architecture Supported by MVS/System Product Version 2". IBM (Announcement Letter). 9 December 1981. LTR ZP81-0794.
  4. "Data Facility Product Release 1". IBM (Announcement Letter). October 21, 1981. LTR ZP81-0798.
  5. "MVS/370 Data Facility Product". IBM (Announcement Letter). May 17, 1983. LTR 283-141.
  6. "Multiple Virtual Storage Extended Architecture (MVS/XA) Data Facility Product (DFP) Version 2 Release 1". IBM (Announcement Letter). February 5, 1985. LTR 285-030.
  7. "Enterprise Systems Architecture/370 and MVS System Product Version 3". IBM (Announcement Letter). February 15, 1988. LTR 288-059.
  8. "MVS/Data Facility Product (MVS/DFP), Version 3". IBM (Announcement Letter). February 15, 1988. LTR 288-060.
  9. "Data Facility Storage Management Subsystem Overview". IBM (Announcement Letter). April 19, 1988. LTR 288-200.
  10. "IBM DFSMS/MVS Version 1 Release 1". IBM (Announcement Letter). May 19, 1992. LTR 292-260.
  11. "IBM 3495 Tape Library Dataserver and IBM 3490 Library Attachment". IBM (Announcement Letter). May 19, 1992. LTR 192-124.
  12. "IBM DFSMS/MVS Version 1 Release 2". IBM (Announcement Letter). March 1, 1994. LTR ZP94-0202.
  13. "IBM DFSMS/MVS Version 1 Release 3". IBM (Announcement Letter). May 30, 1995. LTR AZ5=607.
  14. "IBM DFSMS/MVS Version 1 Release 4". IBM (Announcement Letter). September 10, 1996. LTR 296-347.
  15. "IBM DFSMS/MVS Version 1 Release 5". IBM (Announcement Letter). June 9, 1997. LTR A97-0608.
  16. "SMS Classes and Groups" (PDF). z/OS 2.5 DFSMS Introduction (PDF). IBM. September 30, 2021. pp. 18–21. SC23-6851-50.
  17. "IBM MVS/Data Facility Product (MVS/DFP) Version 3 - Object Access Method". IBM (Announcement Letter). June 28, 1988. LTR 288-340.