Developer(s) | Microsoft |
---|---|
Full name | Extensible File Allocation Table |
Introduced | November 2006 with Windows Embedded CE 6.0 |
Partition IDs | |
Structures | |
Directory contents | Table |
File allocation | bitmap, linked list |
Bad blocks | Cluster tagging |
Limits | |
Max volume size | 128 PB, 512 TB recommended [1] [nb 1] |
Max file size | 128 PB [nb 2] |
Max no. of files | up to 2,796,202 per directory [2] |
Max filename length | 255 characters |
Allowed filename characters | all Unicode characters except U+0000 (NUL) through U+001F (US)/ (slash)\ (backslash): (colon)* (asterisk)? (question mark)" (quote)< (less than)> (greater than) and | (pipe)(encoding in UTF-16LE)[ citation needed ] |
Features | |
Dates recorded | Creation, last modified, last access |
Date range | 1980-01-01 to 2107-12-31 |
Date resolution | 10 ms |
Forks | No |
Attributes | Read-only, hidden, system, subdirectory, archive |
File system permissions | ACL (Windows CE 6 only) |
Transparent compression | No |
Transparent encryption | Yes, EFS supported in Windows 10 v1607 and Windows Server 2016 or later. |
Other | |
Supported operating systems |
|
exFAT (Extensible File Allocation Table) is a file system introduced by Microsoft in 2006 and optimized for flash memory such as USB flash drives and SD cards. [6] exFAT was proprietary until 28 August 2019, when Microsoft published its specification. [7] Microsoft owns patents on several elements of its design. [2]
exFAT can be used where NTFS is not a feasible solution (due to data-structure overhead), but where a greater file-size limit than that of the standard FAT32 file system (i.e. 4 GB) is required.
exFAT has been adopted by the SD Association as the default file system for SDXC cards larger than 32 GB.
Windows 8 and later versions natively support exFAT boot, and support the installation of the system in a special way to run in the exFAT volume. [8]
exFAT was introduced in late 2006 as part of Windows CE 6.0, an embedded Windows operating system. Support was added to regular Windows with Windows Vista Service Pack 1 and Windows Server 2008, both released on February 4, 2008. An update for Windows XP and Windows Server 2003 was later released.
Most of the vendors signing on for licenses are manufacturers of embedded systems or device manufacturers that produce media formatted with exFAT. The entire File Allocation Table (FAT) family, exFAT included, is used for embedded systems because it is lightweight and is better suited for solutions that have low memory and low power requirements, and can be easily implemented in firmware.
Because file size references are stored in eight instead of four bytes, the file size limit has increased to 16 exabytes (EB) (264 − 1 bytes, or about 1019 bytes, which is otherwise limited by a maximum volume size of 128 PB, [nb 2] or 257 − 1 bytes), raised from 4 GB (232 − 1 bytes) in a standard FAT32 file system. [1] Therefore, for the typical user, this enables seamless interoperability between Windows and macOS platforms for files in excess of 4 GB.
Other specifications, features, and requirements of the exFAT file system include:
.
and ..
directory entries that appear in subdirectories.Windows XP requires update KB955704 to be installed, and Windows Vista requires its SP1 installed. [15] [16] [17] Windows Vista is unable to use exFAT drives for ReadyBoost. Windows 7 removes this limitation, enabling ReadyBoost caches larger than 4 GB. [18] Windows 10 only allows formatting exFAT and NTFS on non-removeable volumes sized larger than 32 GB with the default user interface, and FAT32 format is suggested for smaller volumes; command-line utilities don't accept quick format using FAT32 if volume is larger than 32 GB.
The standard exFAT implementation is not journaled and only uses a single file allocation table and free-space map. FAT file systems instead used alternating tables, as this allowed recovery of the file system if the media was ejected during a write (which occurs frequently in practice with removable media). The optional TexFAT component adds support for additional backup tables and maps, but may not be supported.
The exFAT format allows individual files larger than 4 GB, facilitating long continuous recording of HD video, which can exceed the 4 GB limit in less than an hour. Current digital cameras using FAT32 will break the video files into multiple segments of approximately 2 or 4 GB.
EFS supported in Windows 10 v1607 and Windows Server 2016 or later. [19]
SDXC cards running at UHS-I have a minimum guaranteed write speed of 10 MB/s, and exFAT plays a factor in achieving this throughput through the reduction of the file-system overhead in cluster allocation. This is achieved through the introduction of a separate cluster bitmap where the reservation state of each cluster (reserved/free) is tracked by only one bit, reducing writes to the much larger FAT that originally served this purpose.
Additionally, a single bit in the directory record indicates that the file is contiguous (unfragmented), telling the exFAT driver to ignore the FAT. This optimization is analogous to an extent in other file systems, except that it only applies to whole files, as opposed to contiguous parts of files.
exFAT is supported in Windows XP and Windows Server 2003 with update KB955704, [1] Windows Vista Service Pack 1 and later, [20] Windows Server 2008 and later (except Server Core), [21] macOS starting from 10.6.5, Linux via FUSE or natively starting from kernel 5.4, and iPadOS as well as iOS starting from 13.1. [22] [23] [24]
Companies can integrate exFAT into a specific group of consumer devices, including cameras, camcorders, and digital photo frames for a flat fee. Mobile phones, PCs, and networks have a different volume pricing model. [6]
exFAT is supported in a number of media devices such as modern flat-panel TVs, [25] media centers, and portable media players. [26]
exFAT is the official file system of SDXC cards. Because of this, any device not supporting exFAT, such as the Nintendo 3DS, may not legally advertise itself as SDXC compatible, despite supporting SDXC cards as mass storage devices by formatting the card with FAT32 or a proprietary file system tied to the device in question.
Some vendors of other flash media, including USB pen drives, compact flash (CF) and solid-state drives (SSD) ship some of their high-capacity media pre-formatted with the exFAT file system to ensure compatibility with any given device. For example, Sandisk ships their 256 GB CF cards as exFAT.
Microsoft has entered into licensing agreements with BlackBerry, [27] [28] Panasonic, Sanyo, Sony, Canon, Aspen Avionics, [29] Audiovox, Continental, Harman, LG Automotive [30] and BMW. [31]
Mac OS X Snow Leopard 10.6.5 and later can create, read, write, verify, and repair exFAT file systems. [22] [23]
Linux has support for exFAT via FUSE since 2009. [4] In 2013, Samsung Electronics published a Linux driver for exFAT under GPL. [32] On 28 August 2019, Microsoft published the exFAT specification [7] and released the patent to the Open Invention Network members. [33] The Linux kernel introduced native exFAT support with the 5.4 release in November 2019. [34]
Volume size | Cluster size | Cluster count |
---|---|---|
7 MB to <256 MB | 4 KB | < | 65,536
256 MB to < | 32 GB32 KB | < | 1,048,576
[upper-alpha 1] [upper-alpha 2] | 32 GB to <512 GB128 KB | < | 4,194,304
512 GB to < | 1 TB256 KB | |
1 TB to < 2 TB | 512 KB | |
2 TB to < 4 TB | 1 MB | |
4 TB to < 8 TB | 2 MB | |
8 TB to < 16 TB | 4 MB | |
16 TB to < 32 TB | 8 MB | |
32 TB to < 64 TB | 16 MB | |
64 TB to <512 TB | 32 MB | <16,777,216 |
Notes: |
exFAT employs a filename hash-based lookup phase to speed certain cases, which is described in US patent Quick File Name Lookup Using Name Hash. [2] Appendix A of the document contains details helpful in understanding the file system.
Like NTFS, exFAT can pre-allocate disk space for a file by just marking arbitrary space on disk as "allocated". For each file, exFAT uses two separate 64-bit fields in the directory: the valid data length (VDL), which indicates the real size of the file, and the physical data length.
To provide improvement in the allocation of cluster storage for a new file, Microsoft incorporated a method to pre-allocate contiguous clusters and bypass the use of updating the FAT table, which was patented December 10, 2013. [36] One feature of exFAT (used in the exFAT implementation within embedded systems) provides atomic transactions for the multiple steps of updating the file-system metadata. The feature called Transaction Safe FAT, or TexFAT, was granted a patent on November 3, 2009. [37]
exFAT and the rest of the FAT family of file systems do not use indexes for file names, unlike NTFS, which uses B-trees for file searching. When a file is accessed, the directory must be sequentially searched until a match is found. For file names shorter than 16 characters in length, one file name record is required but the entire file is represented by three 32-byte directory records. This is called a directory file set, and a 256 MB sub-directory can hold up to 2,796,202 file sets. (If files have longer names, this number will decrease, but this is the maximum based on the minimal three-record file set.) To help improve the sequential searching of the directories (including the root) a hash value of the file name is derived for each file and stored in the directory record. When searching for a file, the file name is first converted to upper case using the upcase table (file names are case-insensitive) and then hashed using a proprietary patented algorithm into a 16-bit (2-byte) hash value. Each record in the directory is searched by comparing the hash value. When a match is found, the file names are compared to ensure that the proper file was located in case of hash collisions. This improves performance because only 2 bytes have to be compared for each file. This significantly reduces the CPU load because most file names are more than 2 characters (bytes) in size and virtually every comparison is performed on only 2 bytes at a time until the intended file is located.
exFAT introduces metadata integrity through the use of checksums. There are three checksums currently in use.
When the file system is mounted, and the integrity check is conducted, these hashes are verified. Mounting also includes comparison of the version of the exFAT file system by the driver to make sure the driver is compatible with the file system it is trying to mount, and to make sure that none of the required directory records are missing (for example, the directory record for the upcase table and allocation bitmap are required, and the file system can't run if they are missing). If any of these checks fail, the file system should not be mounted, although in certain cases it may mount read-only.
The file system provides extensibility through template-based metadata definitions using generic layouts and generic patterns. [38] [39]
exFAT contains a few features that, according to Microsoft, makes it flash-friendly:
The first feature requires support from the formatting software. Compliant implementations will follow existing offsets. The OEM parameter may be ignored. Implementations may also use TRIM to reduce wear.
Boundary alignment (format) | OEM parameters (use) | TRIM (use) | Note | |
---|---|---|---|---|
Windows CE | Yes | Yes | Unknown | |
Windows Desktop and Server | Yes | Yes | No | |
Linux kernel | since 5.7 [41] | ignored | since 5.13 [42] | exfatprogs [43] is assumed to be used for formatting. |
exFAT was a proprietary file system until 2019, when Microsoft released the specification and allowed OIN members to use their patents. [44] This lack of documentation along with the threat of a patent infringement lawsuit, as happened previously when Microsoft sued various companies over the VFAT long file name patent (before it expired), hampered the development of free and open-source drivers for exFAT, and led to a situation where Linux distributions could not even tell users how to get an exFAT driver. Accordingly, exFAT official support was effectively limited to Microsoft's own products and those of Microsoft's licensees. This, in turn, inhibited exFAT's adoption as a universal exchange format, as it was safer and easier for vendors to rely on FAT32 than it was to pay Microsoft or risk being sued.
Interoperability requires that certain results be achieved in a particular, predefined way (an algorithm). For exFAT, this potentially requires every implementation to perform certain procedures in exactly the same way as Microsoft's implementation. Some of the procedures used by Microsoft's implementation are patented, and these patents are owned by Microsoft. [45] A license to use these algorithms can be purchased from Microsoft, [46] [45] and some companies – including Apple, Google and Samsung – have done so. [47] However, in the open-source ecosystem, users have typically responded to vendors being unwilling to pay for patent licenses by procuring an implementation for themselves from unofficial sources. For example, this is what happened with LAME when MP3 patents were still valid. (Alternatively, the user may decide that the feature is unimportant to them.)
Regardless of whether open-source or not, Microsoft stated that "a license is required in order to implement exFAT and use it in a product or device". [45] Unlicensed distribution of an exFAT driver would make the distributor liable for financial damages if the driver is found to have violated Microsoft's patents. [48] [49] While the patents may not be enforceable, this can only be determined through a legal process, which is expensive and time-consuming. It may also be possible to achieve the intended results without infringing Microsoft's patents. [50] In October 2018, Microsoft released 60,000 patents to the Open Invention Network members for Linux systems, but exFAT patents were not initially included at the time. There was, however, discussion within Microsoft over whether Microsoft should allow exFAT in Linux devices, [51] [52] which eventually resulted in Microsoft publishing the official specification for open usage [7] and releasing the exFAT patents to the OIN in August 2019. [33]
A FUSE-based implementation named fuse-exfat, or exfat-fuse, [4] with read/write support is available for FreeBSD, multiple Linux distributions, and older versions of Mac OS X. It supports TRIM. [53] [54] [55] [56] [57] An implementation called exFATFileSystem, based on fuse-exfat, is available for AmigaOS 4.1. [58]
A Linux kernel implementation by Samsung Electronics is available. [59] It was initially released on GitHub unintentionally, [60] and later released officially by Samsung in compliance with the GPLv2 in 2013. [61] [62] (This release does not make exFAT royalty-free, as licensing from Samsung does not remove Microsoft's patent rights.) [63] [64] A version of this driver was first incorporated into version 5.4 of the Linux kernel. [65] [66] [67] A much newer version of the driver, with several bug fixes and improved reliability, was incorporated into kernel 5.7. [68] [41] Prior to its being merged into the Linux kernel, this newer version had already seen adoption on Android smartphones and continued to be used on both Linux and Android thereafter. [69] [70]
Proprietary read/write solutions licensed and derived from the Microsoft exFAT implementation are available for Android, [71] Linux, and other operating systems from Paragon Software Group and Tuxera.
XCFiles (from Datalight) is a proprietary, full-featured implementation, intended to be portable to 32-bit systems. [72] Rtfs (from EBS Embedded Software) is a full-featured implementation for embedded devices. [73]
Two experimental, unofficial solutions are available for DOS. The loadable USBEXFAT driver requires Panasonic's USB stack for DOS and only works with USB storage devices; the open-source EXFAT executable is an exFAT file-system reader and requires the HX DOS extender to work. [74] There are no native exFAT real-mode DOS drivers, which would allow usage of, or booting from, exFAT volumes.
The renaming of ExFAT file system labels is natively supported by Microsoft Windows Explorer, while Linux relies on the exfatlabel
and tune.exfat
tools (both part of exfatprogs). [75]
New Technology File System (NTFS) is a proprietary journaling file system developed by Microsoft. Starting with Windows NT 3.1, it is the default file system of the Windows NT family. It superseded File Allocation Table (FAT) as the preferred filesystem on Windows and is supported in Linux and BSD as well. NTFS reading and writing support is provided using a free and open-source kernel implementation known as NTFS3 in Linux and the NTFS-3G driver in BSD. By using the convert
command, Windows can convert FAT32/16/12 into NTFS without the need to rewrite all files. NTFS uses several files typically hidden from the user to store metadata about other files stored on the drive which can help improve speed and performance when reading data. Unlike FAT and High Performance File System (HPFS), NTFS supports access control lists (ACLs), filesystem encryption, transparent compression, sparse files and file system journaling. NTFS also supports shadow copy to allow backups of a system while it is running, but the functionality of the shadow copies varies between different versions of Windows.
File Allocation Table (FAT) is a file system developed for personal computers and was the default filesystem for MS-DOS and Windows 9x operating systems. Originally developed in 1977 for use on floppy disks, it was adapted for use on hard disks and other devices. The increase in disk drives capacity required three major variants: FAT12, FAT16 and FAT32. FAT was replaced with NTFS as the default file system on Microsoft operating systems starting with Windows XP. Nevertheless, FAT continues to be used on flash and other solid-state memory cards and modules, many portable and embedded devices because of its compatibility and ease of implementation.
Linux has several filesystem drivers for the File Allocation Table (FAT) filesystem format. These are commonly known by the names used in the mount
command to invoke particular drivers in the kernel: msdos, vfat, and umsdos.
GNU GRUB is a boot loader package from the GNU Project. GRUB is the reference implementation of the Free Software Foundation's Multiboot Specification, which provides a user the choice to boot one of multiple operating systems installed on a computer or select a specific kernel configuration available on a particular operating system's partitions.
Large-file support (LFS) is the term frequently applied to the ability to create files larger than either 2 or 4 GiB on 32-bit filesystems.
X.Org Server is the free and open-source implementation of the X Window System (X11) display server stewarded by the X.Org Foundation.
The Installable File System (IFS) is a filesystem API in MS-DOS/PC DOS 4.x, IBM OS/2 and Microsoft Windows that enables the operating system to recognize and load drivers for file systems.
Unified Extensible Firmware Interface is a specification that defines the architecture of the platform firmware used for booting the computer hardware and its interface for interaction with the operating system. Examples of firmware that implement the specification are AMI Aptio, Phoenix SecureCore, TianoCore EDK II, InsydeH2O. UEFI replaces the BIOS which was present in the boot ROM of all personal computers that are IBM PC compatible, although it can provide backwards compatibility with the BIOS using CSM booting. Intel developed the original Extensible Firmware Interface (EFI) specification. Some of the EFI's practices and data formats mirror those of Microsoft Windows. In 2005, UEFI deprecated EFI 1.10.
The Direct Rendering Manager (DRM) is a subsystem of the Linux kernel responsible for interfacing with GPUs of modern video cards. DRM exposes an API that user-space programs can use to send commands and data to the GPU and perform operations such as configuring the mode setting of the display. DRM was first developed as the kernel-space component of the X Server Direct Rendering Infrastructure, but since then it has been used by other graphic stack alternatives such as Wayland and standalone applications and libraries such as SDL2 and Kodi.
A free and open-source graphics device driver is a software stack which controls computer-graphics hardware and supports graphics-rendering application programming interfaces (APIs) and is released under a free and open-source software license. Graphics device drivers are written for specific hardware to work within a specific operating system kernel and to support a range of APIs used by applications to access the graphics hardware. They may also control output to the display if the display driver is part of the graphics hardware. Most free and open-source graphics device drivers are developed by the Mesa project. The driver is made up of a compiler, a rendering API, and software which manages access to the graphics hardware.
DriveSpace is a disk compression utility supplied with MS-DOS starting from version 6.0 in 1993 and ending in 2000 with the release of Windows Me. The purpose of DriveSpace is to increase the amount of data the user could store on disks by transparently compressing and decompressing data on-the-fly. It is primarily intended for use with hard drives, but use for floppy disks is also supported. This feature was removed in Windows XP and later.
The following tables compare general and technical information for a number of file systems.
The Linux Unified Key Setup (LUKS) is a disk encryption specification created by Clemens Fruhwirth in 2004 and originally intended for Linux.
In Unix-like operating systems, a device file or special file is an interface to a device driver that appears in a file system as if it were an ordinary file. There are also special files in DOS, OS/2, and Windows. These special files allow an application program to interact with a device by using its device driver via standard input/output system calls. Using standard system calls simplifies many programming tasks, and leads to consistent user-space I/O mechanisms regardless of device features and functions.
Mode setting is a software operation that activates a display mode for a computer's display controller by using VESA BIOS Extensions or UEFI Graphics extensions.
Tuxera Inc. is a Finnish company that develops and sells file systems, flash management and networking software. The company was founded in 2008 and is headquartered in Espoo, Finland. Tuxera's other offices are located in the US, South Korea, Japan, Hungary, Germany, Taiwan and China.
The FAT file system is a file system used on MS-DOS and Windows 9x family of operating systems. It continues to be used on mobile devices and embedded systems, and thus is a well suited file system for data exchange between computers and devices of almost any type and age from 1981 through the present.
Windows Subsystem for Linux (WSL) is a feature of Windows that allows developers to run a Linux environment without the need for a separate virtual machine or dual booting. There are two versions of WSL: WSL 1 and WSL 2. WSL 1 was first released on August 2, 2016, and acts as a compatibility layer for running Linux binary executables by implementing Linux system calls on the Windows kernel. It is available on Windows 10, Windows 10 LTSB/LTSC, Windows 11, Windows Server 2016, Windows Server 2019 and Windows Server 2022.
EROFS is a lightweight read-only file system initially developed by Huawei for the Linux kernel and now maintained by an open-source community from all over the world.
Description of the exFAT file system driver update package [for Windows XP and Windows Server 2003]