Developer(s) | ISO/IEC, Ecma International, OSTA |
---|---|
Full name | Universal Disk Format |
Introduced | 1995 |
Partition IDs | Not assigned but suggested: [1] 0x07 (MBR) EBD0A0A2-B9E5-4433-87C0-68B6B72699C7 (GPT) |
Limits | |
Max volume size | 2 TiB (with 512-byte sectors), 8 TiB (with 2 KiB sectors, like most optical discs), 16 TiB (with 4 KiB sectors) [lower-alpha 1] [2] |
Max file size | 16 EiB |
Max filename length | 255 bytes (path 1023 bytes [lower-alpha 2] ) |
Allowed filename characters | Any 16-bit Unicode Code point excluding U+FEFF and U+FFFE |
Features | |
Dates recorded | creation, archive, modification (mtime), attribute modification (ctime), access (atime) |
Date range |
|
Date resolution | Microsecond |
Forks | Yes |
Attributes | Various |
File system permissions | POSIX |
Transparent compression | No |
Other | |
Supported operating systems | Various |
Universal Disk Format (UDF) is an open, vendor-neutral file system for computer data storage for a broad range of media. In practice, it has been most widely used for DVDs and newer optical disc formats, supplanting ISO 9660. Due to its design, it is very well suited to incremental updates on both write-once and re-writable optical media. UDF was developed and maintained by the Optical Storage Technology Association (OSTA).
In engineering terms, Universal Disk Format is a profile of the specifications known as ISO/IEC 13346 and ECMA-167. [4]
Normally, authoring software will master a UDF file system in a batch process and write it to optical media in a single pass. But when packet writing to rewritable media, such as CD-RW, UDF allows files to be created, deleted and changed on-disc just as a general-purpose filesystem would on removable media like floppy disks and flash drives. This is also possible on write-once media, such as CD-R, but in that case the space occupied by the deleted files cannot be reclaimed (and instead becomes inaccessible).
Multi-session mastering is also possible in UDF, though some implementations may be unable to read disks with multiple sessions. [lower-alpha 3]
Optical discs |
---|
The Optical Storage Technology Association standardized the UDF file system to form a common file system for all optical media: both for read-only media and for re-writable optical media. When first standardized, the UDF file system aimed to replace ISO 9660, allowing support for both read-only and writable media. After the release of the first version of UDF, the DVD Consortium adopted it as the official file system for DVD-Video and DVD-Audio. [5]
UDF shares the basic volume descriptor format with ISO 9660. A "UDF Bridge" format is defined since 1.50 so that a disc can also contain a ISO 9660 file system making references to files on the UDF part. [6]
Multiple revisions of UDF have been released: [5] [7]
UDF Revisions are internally encoded as binary-coded decimals; Revision 2.60, for example, is represented as 0x0260. [13] : 23 In addition to declaring its own revision, compatibility for each volume is defined by the minimum read and minimum write revisions, each signalling the requirements for these operations to be possible for every structure on this image. A "maximum write" revision additionally records the highest UDF support level of all the implementations that has written to this image. [13] : 34 For example, a UDF 2.01 volume that does not use Stream Files (introduced in UDF 2.00) but uses VAT (UDF 1.50) created by a UDF 2.60-capable implementation may have the revision declared as 0x0201, the minimum read revision set to 0x0150, the minimum write to 0x0150, and the maximum write to 0x0260.
The UDF standard defines three file system variations, called "builds". These are:
Introduced in the first version of the standard, this format can be used on any type of disk that allows random read/write access, such as hard disks, DVD+RW and DVD-RAM media. Metadata (up to v2.50) and file data is addressed more or less directly. In writing to such a disk in this format, any physical block on the disk may be chosen for allocation of new or updated files.
Since this is the basic format, practically any operating system or file system driver claiming support for UDF should be able to read this format.
Write-once media such as DVD-R and CD-R have limitations when being written to, in that each physical block can only be written to once, and the writing must happen incrementally. Thus the plain build of UDF can only be written to CD-Rs by pre-mastering the data and then writing all data in one piece to the media, similar to the way an ISO 9660 file system gets written to CD media.
To enable a CD-R to be used virtually like a hard disk, whereby the user can add and modify files on a CD-R at will (so-called "drive letter access" on Windows), OSTA added the VAT build to the UDF standard in its revision 1.5. The VAT is an additional structure on the disc that allows packet writing; that is, remapping physical blocks when files or other data on the disc are modified or deleted. For write-once media, the entire disc is virtualized, making the write-once nature transparent for the user; the disc can be treated the same way one would treat a rewritable disc.
The write-once nature of CD-R or DVD-R media means that when a file is deleted on the disc, the file's data still remains on the disc. It does not appear in the directory any more, but it still occupies the original space where it was stored. Eventually, after using this scheme for some time, the disc will be full, as free space cannot be recovered by deleting files. Special tools can be used to access the previous state of the disc (the state before the delete occurred), making recovery possible.
Not all drives fully implement version 1.5 or higher of the UDF, and some may therefore be unable to handle VAT builds.
Rewriteable media such as DVD-RW and CD-RW have fewer limitations than DVD-R and CD-R media. Sectors can be rewritten at random (though in packets at a time). These media can be erased entirely at any time, making the disc blank again, ready for writing a new UDF or other file system (e.g., ISO 9660 or CD Audio) to it. However, sectors of -RW media may "wear out" after a while, meaning that their data becomes unreliable, through having been rewritten too often (typically after a few hundred rewrites, with CD-RW).
The plain and VAT builds of the UDF format can be used on rewriteable media, with some limitations. If the plain build is used on a -RW media, file-system level modification of the data must not be allowed, as this would quickly wear out often-used sectors on the disc (such as those for directory and block allocation data), which would then go unnoticed and lead to data loss. To allow modification of files on the disc, rewriteable discs can be used like -R media using the VAT build. This ensures that all blocks get written only once (successively), ensuring that there are no blocks that get rewritten more often than others. This way, a RW disc can be erased and reused many times before it should become unreliable. However, it will eventually become unreliable with no easy way of detecting it. When using the VAT build, CD-RW/DVD-RW media effectively appears as CD-R or DVD+/-R media to the computer. However, the media may be erased again at any time.
The spared build was added in revision 1.5 to address the particularities of rewriteable media. This build adds an extra Sparing Table in order to manage the defects that will eventually occur on parts of the disc that have been rewritten too many times. This table keeps track of worn-out sectors and remaps them to working ones. UDF defect management does not apply to systems that already implement another form of defect management, such as Mount Rainier (MRW) for optical discs, or a disk controller for a hard drive.
The tools and drives that do not fully support revision 1.5 of UDF will ignore the sparing table, which would lead them to read the outdated worn-out sectors, leading to retrieval of corrupted data.
An overhead that is spread over the entire disc reserves a portion of the data storage space, limiting the usable capacity of a CD-RW with e.g. 650 MB of original capacity to around 500 MB. [14]
The UDF specifications [5] allow only one Character Set OSTA CS0, which can store any Unicode Code point excluding U+FEFF and U+FFFE. Additional character sets defined in ECMA-167 are not used. [4] : 7.2
Since Errata DCN-5157, the range of code points was expanded to all code points from Unicode 4.0 (or any newer or older version), which includes Plane 1-16 characters such as Emoji. DCN-5157 also recommends normalizing the strings to Normalization Form C. [15]
The OSTA CS0 character set stores a 16-bit Unicode string "compressed" into 8-bit or 16-bit units, preceded by a single-byte "compID" tag to indicate the compression type. The 8-bit storage is functionally equivalent to ISO-8859-1, and the 16-bit storage is UTF-16 in big endian. 8-bit-per-character file names save space because they only require half the space per character, so they should be used if the file name contains no special characters that can not be represented with 8 bits only. [16]
The reference algorithm neither checks for forbidden code points nor interprets surrogate pairs, so like NTFS the string may be malformed. [5] : 2.1.2, 6.4 (No specific form of storage is specified by DCN-5157, but UTF-16BE is the only well-known method for storing all of Unicode while being mostly backward compatible with UCS-2.) [15]
This section needs to be updated. The reason given is: For many operating systems, the information is a decade old and may or may not reflect the current situation accurately.(November 2020) |
Many DVD players do not support any UDF revision other than version 1.02. Discs created with a newer revision may still work in these players if the ISO 9660 bridge format is used. Even if an operating system claims to be able to read UDF 1.50, it still may only support the plain build and not necessarily either the VAT or Spared UDF builds.
Mac OS X 10.4.5 claims to support Revision 1.50 (see man mount_udf), yet it can only mount disks of the plain build properly and provides no virtualization support at all. It cannot mount UDF disks with VAT, as seen with the Sony Mavica issue. [17] [18] Releases before 10.4.11 mount disks with Sparing Table but does not read its files correctly. Version 10.4.11 fixes this problem. [19] [20]
Similarly, Windows XP Service Pack 2 (SP2) cannot read DVD-RW discs that use the UDF 2.00 sparing tables as a defect management system. [21] This problem occurs if the UDF defect management system creates a sparing table that spans more than one sector on the DVD-RW disc. Windows XP SP2 can recognize that a DVD is using UDF, but Windows Explorer displays the contents of a DVD as an empty folder. A hotfix is available for this [22] and is included in Service Pack 3. [21]
Due to the default UDF versions and options, a UDF partition formatted by Windows cannot be written under macOS. On the other hand, a partition formatted by macOS cannot be directly written by Windows, due to the requirement of a MBR partition table. In addition, Linux only supports writing to UDF 2.01. A script for Linux and macOS called format-udf
handles these incompatibilities by using UDF 2.01 and adding a fake MBR; [23] for Windows the best solution is using the command-line tool format /FS:UDF /R:2.01
.
| |||||||||
UDF revision (read + write) | Non-plain | ||||||||
---|---|---|---|---|---|---|---|---|---|
Operating system | 1.02 | 1.50 | 2.0x | 2.50 | 2.60 | VAT | Sparing tables | Note | |
AIX 5.2, 5.3, 6.1 | Yes | Yes | No | No | 1.5 is default [24] | ||||
AmigaOS 4.0 | Yes | Yes | |||||||
BeOS/magnussoft ZETA/Haiku | Yes | Yes | Yes | Yes | Yes | ||||
OS/2 (including eComStation and ArcaOS) | Yes | Additional fee drivers on OS/2. | |||||||
FreeBSD 5.0 and newer | read only | read only [25] | No | No | No | No | Yes | ||
Linux kernel 2.2 | No | No | No | No | No | No | No | ||
Linux kernel 2.4 | Yes | Yes | Yes [lower-alpha 5] | No | No | Yes | Yes | ||
Linux kernel 2.6.0–2.6.25 | Yes | Yes | Yes | No | No | Yes | Yes | Kernel versions prior to 2.6.10 supported fewer media types. | |
Linux kernel 2.6.26 and newer | Yes | Yes | Yes | read only [26] | read only [13] : 10 | Yes | Yes | Permission-related mounting options added in 2.6.30. [27] Auto-detection of UDF file system on hard disk is supported since version 2.6.30. Auto-detection of UDF file system on disk images was fixed in 4.11. | |
Mac OS 8.1–8.5 | Yes | No | No | No | No | No | No | Some earlier versions of Mac OS, such as 7.5, 7.6, and 8.0 are also supported via third-party utilities, along with additional UDF version support for 8.1 and 8.5. [lower-alpha 6] | |
Mac OS 8.6, Mac OS 9 | Yes | Yes | No | No | No | No | No | Additional UDF version support via third-party utilities. [lower-alpha 6] | |
Mac OS X 10.0–10.3 | Yes | Yes [28] | No [28] | No | No | No | No | ||
Mac OS X 10.4 | Yes | Yes | Yes | No [lower-alpha 7] [29] | No [lower-alpha 8] | No | Yes [lower-alpha 9] | Can create UDF 1.50 (plain build) volumes using the drutil utility. | |
Mac OS X 10.5 and newer | Yes | Yes | Yes | Yes [30] [29] | read only [30] [31] | Yes | Yes | To create, use newfs_udf utility. | |
NetBSD 4.0 | read only [32] | read only | read only | read only | read only | Yes | Yes | Reading multi-session VAT, spared and metapartition variants from all CD, DVD and BD variants as well as HDD and Flash media. | |
NetBSD 5.0 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Write support for all builds and media including multi-session VAT. [33] Create new with newfs_udf .Limited writing on 2.50/2.60 (due to needing pre-allocated, fixed sized metadata partition). [34] | |
NetWare 5.1 | |||||||||
NetWare 6 | |||||||||
OpenBSD 3.8–3.9 | read only [35] | No | No | No | No | No | No | ||
OpenBSD 4.0–4.6 | read only | read only [36] | No | No | No | Yes [36] | No | ||
OpenBSD 4.7 | read only | read only | read only | read only [37] | read only [37] | Yes | Yes | ||
Solaris 7 11/99+ | Yes | Yes | |||||||
Solaris 8/9/10 | Yes | Yes | |||||||
DOS, FreeDOS, Windows 3.11, Windows 95, Windows 95 OSR2+ and other DOS based OS | No [38] | No | No | No | No | No | No | No native support. Filesystems that have an ISO9660 backward compatibility structure can be read. | |
Windows 98, Windows Me | read only and only for CD/DVD optical disks [39] [40] [41] [38] | No | No | No | No | No | No | Additional read/write support via third party utilities [lower-alpha 10] | |
Windows 2000 | read only [41] [42] [43] [44] [38] | read only | No | No | No | No | No | Additional read/write support via third party utilities [lower-alpha 10] | |
Windows XP/Server 2003 | read only [43] [44] [38] | read only | read only | No | No | Yes | Yes [lower-alpha 11] | Additional read/write support via third party utilities [lower-alpha 10] | |
Windows Vista | Yes [45] [46] [44] [38] | Yes | Yes | Yes | read only [45] [46] [44] [38] | Yes | Yes | Referred to by Microsoft as Live File System. Requires fake MBR partition on non-optical devices. | |
Windows 7 and newer | Yes [38] | Yes | Yes | Yes | Yes | Yes | Yes | ||
Operating system | 1.02 | 1.50 | 2.0x | 2.50 | 2.60 | VAT | Sparing tables | Note | |
UDF revision (read + write) | Non-plain |
ISO 9660 is a file system for optical disc media. The file system is an international standard available from the International Organization for Standardization (ISO). Since the specification is available for anybody to purchase, implementations have been written for many operating systems.
An optical disc is a flat, usually disc-shaped object that stores information in the form of physical variations on its surface that can be read with the aid of a beam of light. Optical discs can be reflective, where the light source and detector are on the same side of the disc, or transmissive, where light shines through the disc to be detected on the other side.
In computing, an optical disc drive (ODD) is a disc drive that uses laser light or electromagnetic waves within or near the visible light spectrum as part of the process of reading or writing data to or from optical discs. Some drives can only read from certain discs, but recent drives can both read and record, also called burners or writers. Compact discs, DVDs, and Blu-ray discs are common types of optical media which can be read and recorded by such drives.
Mount Rainier (MRW) is a format for writable optical discs which provides the packet writing and defect management. Its goal is the replacement of the floppy disk. It is named after Mount Rainier, a volcano near Seattle, Washington, United States.
A live CD is a complete bootable computer installation including operating system which runs directly from a CD-ROM or similar storage device into a computer's memory, rather than loading from a hard disk drive. A live CD allows users to run an operating system for any purpose without installing it or making any changes to the computer's configuration. Live CDs can run on a computer without secondary storage, such as a hard disk drive, or with a corrupted hard disk drive or file system, allowing data recovery.
An optical disc image is a disk image that contains everything that would be written to an optical disc, disk sector by disc sector, including the optical disc file system. ISO images contain the binary image of an optical media file system, including the data in its files in binary format, copied exactly as they were stored on the disc. The data inside the ISO image will be structured according to the file system that was used on the optical disc from which it was created.
Optical disc authoring, including CD, DVD, and Blu-ray Disc authoring, is the process of assembling source material—video, audio or other data—into the proper logical volume format to then be recorded ("burned") onto an optical disc. This act is sometimes done illegally, by pirating copyrighted material without permission from the original artists.
DVD-RAM is a DVD-based disc specification presented in 1996 by the DVD Forum, which specifies rewritable DVD-RAM media and the appropriate DVD writers. DVD-RAM media have been used in computers as well as camcorders and personal video recorders since 1998.
K3b is a CD, DVD and Blu-ray authoring application by KDE for Unix-like computer operating systems. It provides a graphical user interface to perform most CD/DVD burning tasks like creating an Audio CD from a set of audio files or copying a CD/DVD, as well as more advanced tasks such as burning eMoviX CD/DVDs. It can also perform direct disc-to-disc copies. The program has many default settings which can be customized by more experienced users. The actual disc recording in K3b is done by the command line utilities cdrecord or cdrkit, cdrdao, and growisofs. As of version 1.0, K3b features a built-in DVD ripper.
InCD is a packet writing software developed by Nero AG for Microsoft Windows.
Optical storage refers to a class of data storage systems that use light to read or write data to an underlying optical media. Although a number of optical formats have been used over time, the most common examples are optical disks like the compact disc (CD) and DVD. Reading and writing methods have also varied over time, but most modern systems as of 2023 use lasers as the light source and use it both for reading and writing to the discs. Britannica notes that it "uses low-power laser beams to record and retrieve digital (binary) data."
IMG, in computing, refers to binary files with the .img
filename extension that store raw disk images of floppy disks, hard drives, and optical discs or a bitmap image – .img
.
DVD recordable and DVD rewritable are optical disc recording technologies. Both terms describe DVD optical discs that can be written to by a DVD recorder, whereas only 'rewritable' discs are able to erase and rewrite data. Data is written ('burned') to the disc by a laser, rather than the data being 'pressed' onto the disc during manufacture, like a DVD-ROM. Pressing is used in mass production, primarily for the distribution of home video.
Drive Letter Access (DLA) is a discontinued commercial packet writing application for the Microsoft Windows operating system that allows optical disc data storage devices to be used in a manner similar to floppy disks. DLA is a packet writing technology for CD and DVD media that uses the UDF file system.
CD-RW is a digital optical disc storage format introduced in 1997. A CD-RW compact disc (CD-RWs) can be written, read, erased, and re-written.
The Optical Storage Technology Association (OSTA) was an international trade association formed to promote the use of recordable optical data storage technologies and products. It was responsible for the creation and maintenance of the Universal Disk Format (UDF) file system specification, which was notably adopted for DVD-Video. It was incorporated in California in 1992 and dissolved in 2018.
The Image Mastering Application Programming Interface, or IMAPI, is a component of Microsoft Windows operating system used for CD and DVD authoring and recording.
A CD-ROM is a type of read-only memory consisting of a pre-pressed optical compact disc that contains data computers can read, but not write or erase. Some CDs, called enhanced CDs, hold both computer data and audio with the latter capable of being played on a CD player, while data is only usable on a computer.
Notable software applications that can access or manipulate disk image files are as follows, comparing their disk image handling features.
Live File System is the term Microsoft uses to describe the packet writing method of creating discs in Windows Vista and later, which allows writeable optical media to act like mass storage by replicating its file operations. Live File System lets users manage files on recordable and rewriteable optical discs inside the file manager with the familiar workflow known from mass storage media such as USB flash drives and external hard disk drives.
The output is a drive that can be used for reading/writing across multiple operating system families: Windows, macOS, and Linux. This script should be capable of running in macOS or in Linux.
UDF 1.50 is supported. UDF 2.0 and later is not.
This release note describes changes to the Disc Recording frameworks from OS X version 10.4. The Disc Recording content creation engine now supports writing UDF 2.0 discs in addition to UDF 1.02 and 1.5.
Reading of all UDF revisions (1.02 - 2.60) on both block device (e.g. hard drives and USB drives) and most optical media is supported. Writing to block devices, DVD-RW and DVD+RW is supported with the following exceptions: (1) Cannot write Finder Info, Resource Fork, or other extended attributes in UDF volumes of revision 1.02 and 1.50; (2) Cannot write to mirrored metadata partition.
OS X supports reading UDF revisions 1.02 through 2.60 on both block devices and most optical media, and it supports writing to block devices and to DVD-RW and DVD+RW media using UDF 2.00 through 2.50 (except for mirrored metadata partitions in 2.50).
Added UDF support for optical media and block devices, see mount_udf(8). Read-only for now.
Windows 98 has a new read-only Universal Disk Format (UDF) system, which supports reading media formatted according to UDF specification 1.02.
The 32-bit, protected-mode UDF file system in Windows 98 is implemented according to Revision 1.02 of Universal Disk Format Specification by Optical Storage Technology Association (OSTA). It provides read-only access to UDF-formatted media, such as DVD discs. The UDF file system uses VCACHE and is dynamic, requiring no configuration or static allocation on the part of the user.
Windows NT 5.0 also adds UDF (Universal Disk Format). ... The UDF implementations shipping in both Windows 98 (UDF 1.02) and Windows NT 5.0 (UDF 1.50) are read-only.
The Windows 2000 UDF file system implementation is ISO 13346-compliant and supports UDF versions 1.02 and 1.5. ... the Windows 2000 UDF driver (Udfs.sys) provides read-only support.
The UDF driver supports UDF versions 1.02, version 1.5 on Windows 2000, and versions 2.0 and 2.01 on Windows XP and Windows Server 2003. ... the Windows UDF driver (Udfs.sys) provides read-only support. Windows does not implement support for other UDF features, including named streams, access control lists, or extended attributes.
The UDF driver supports UDF versions up to 2.60. The Windows UDF driver (Udfs.sys) provides read-write support ... when using UDF 2.50 and read-only support when using UDF 2.60. However, Windows does not implement support for certain UDF features such as named streams and access control lists.
The UDF driver supports UDF versions up to 2.60. The Windows UDF driver (Udfs.sys) provides read-write support ... when using UDF 2.50 and read-only support when using UDF 2.60. However, Windows does not implement support for certain UDF features such as named streams and access control lists.