Virtual folder

Last updated

In computing, a virtual folder generally denotes an organizing principle for files that is not dependent on location in a hierarchical directory tree. Instead, it consists of software that coalesces results from a data store, which may be a database or a custom index, and presents them visually in the format in which folder views are presented. A virtual folder can be thought of as a view that lists all files tagged with a certain tag, and thus a simulation of a folder whose dynamic contents can be assembled on the fly, when requested. It is related in concept to several other topics in computer science, with names including saved search, saved query, and filtering.

Contents

Technology

Virtual folders provide a means for making it easier for users to find files that are content-related, such as by project. The user needs to specify criteria and all files matching the criteria are dynamically aggregated into the virtual folder. Files in a virtual folder are not limited to any single physical location on the hard drive, as is the case with traditional folders, but can be in any location. In fact, files in a virtual folder do not even need to be stored as files on the hard drive. They may be on a network share or in a custom application datastore such as e-mail inbox or even a database.

Documents cannot be "stored" in a virtual folder, since physically a virtual folder is just a file storing a search query. Any attempt to store a file in a virtual folder, depending on the implementation, is redirected to some physical store.

Most implementations speed up searching by pre-indexing the hard drive, or the locations where the search has to be performed. So when searching is to be done, the index, which is a representation of the entire data suitable for fast searching, is used. Since the entire folder hierarchy is not accessed, the search is completed much faster.

Implementations

Virtual folders are a well-established construct in operating systems. BeOS included a version of virtual folders referred to as "saved queries", that has since influenced the development of virtual folder features in operating systems like Mac OS X, Windows and Linux. These virtual folders are populated dynamically by executing a search on the entire file system, or a subset of it, or by using the cached version of the search.

History

BeOS

The initial developer preview of the operating system, released in October 1995, included database-like functionality to make it easier for users to manage their files. To do this the filesystem indexes certain file attributes to allow for fast searching. By default the filesystem indexes the filename, size and last modified timestamp automatically, but could also create indexes for other attributes when told to by either an application or by the user. [1]

When a user performs a file search, a file is created in the folder "/boot/home/queries" with a name derived from the content of the query and the date and time of the search, such as "Name = Western Infirmary - Mar 21, 11:59:40 PM". The query criteria of the search is stored in an attribute of the file called "qrystr". [2] When the file is opened, the filesystem indexes were queried and a Tracker window is opened with an up-to-date list of files that match the criteria.

Additional features were added to search with subsequent releases. Release 2 introduced the ability to edit saved queries, [3] and Release 3 gave the users the chance to define their own names for saved queries. [4] Before Release 4 in 1998, all queries were stored indefinitely. However, with R4, the BeOS developers introduced a seven-day limit on all queries. If a user wanted a query to stay around longer, they could uncheck a "Temporary" flag in the Find dialog. [5]

macOS

In April 2005, Apple released Mac OS X v10.4, with their implementation of virtual folders called Smart Folders. These folders are dynamically updated by the Spotlight engine to contain content that match certain criteria. For example, this could be used to give you a folder containing all the Word documents containing the word "shpadoinkle" that have been edited within the last 7 days. Smart Folders are created by saving a Spotlight search, which records the search criteria in a Property list file with a .savedSearch extension and, by default, saves them in the "/Users/username/Library/Saved Searches" folder.

Dominic Giampaolo, one of the lead developers of the BeOS filesystem, was also involved in adding a virtual folder system in Apple Inc.'s Mac OS X operating system. [6]

There are many variants of the Smart Folder concept that can be seen in applications that use the Spotlight engine, usually identified by a gear symbol on a purple-hued icon. Examples include: Smart Mailboxes in Mail and Smart Groups in Address Book.

Before Spotlight earlier versions of macOS had a similar concept in the iApps (iTunes and iPhoto), but these did not use the system-wide Spotlight engine.

Microsoft Windows

Saved Searches

Saved Searches are recognizable by their distinctive icon and blue color; folders are yellow Folders Vista.png
Saved Searches are recognizable by their distinctive icon and blue color; folders are yellow
Internals of a Saved Search, which display the search query stored in as a .search-ms file. Search-ms.png
Internals of a Saved Search, which display the search query stored in as a .search-ms file.

Windows Vista released in November 2006 introduced virtual folders to the Windows platform with the introduction of Saved Searches, [lower-alpha 1] [lower-alpha 2] which present items based on their properties rather than folder hierarchies on disk. [8] [10] Saved Searches are not folders — they do not store items — they instead are XML files that retain a query for utilization by Windows Search. [7] Saved Searches can be defined based on customizable parameters including dates, metadata, names, locations to search (called the scopes), and item types. [11] When a Saved Search is created, the query retains the presentation layout that appeared when the search was first performed such that subsequent searches will present identical arrangements of items. [7] Saved Searches can also be constructed on other Saved Searches (query composition). [12] [13]

By default, Windows Vista references the disk partition and user profile of a created Saved Search as part of its scope, which inhibits their ability to return content from different machines or partitions when transferred to other machines. Microsoft released a SearchMelt Creator utility that changes the scope of Saved Searches to reference the %USERPROFILE% environment variable, which allows them to operate on other machines or profiles; users can also edit Saved Searches manually to reference %USERPROFILE% to facilitate sharing. [14]

Saved Searches additionally allow users to create stacks of data, which are collections of items assembled by properties such as document authors. The same content can appear in more than one stack. Users can, by way of example, first navigate to a specific author stack then to a keyword stack, or to the same keyword stack and to the same author stack without creating new folders or changing the underlying location on disk, which frees users from the limitation of a hierarchical folder structure where one item can only be stored in one location [15] — this liberation from folder hierarchies was a primary benefit and differentiator of WinFS. [16]

All Documents, All Music, All Pictures and Videos and associated Saved Searches in the navigation pane of Windows Vista Beta 1 Windows Vista Beta 1 Virtual Folders.png
All Documents, All Music, All Pictures and Videos and associated Saved Searches in the navigation pane of Windows Vista Beta 1

"We actually considered at one time not having folders. It was all going to be virtualized storage with search queries and so on. We would just completely abstract the file organization stuff from the physical folders and disk structure. But that was too much of a leap over the chasm, too confusing for users."

Greg Sullivan [17]

Pre-release builds of Windows Vista offered significantly different metadata and namespace functionality in contrast to the functionality of the build of Windows Vista released to manufacturing. Microsoft constructed several Saved Searches as part of its goals for a new user profile namespace, which replaced traditional user profile folders. Documents, My Music, and My Pictures on the Start menu were replaced by Saved Searches — All Documents, All Music, and All Pictures and Videos — that searched for documents, music, and photos and videos, respectively, with several other Saved Searches for specific content (e.g., authors for documents) also displayed in the navigation pane of Windows Explorer. When viewing All Music or traditional folders with music, for example, the navigation pane would include Saved Searches for all music, albums, artists, genres, favorite music, and ratings. [12] [18] [19] Stacks in Saved Searches in pre-release builds of Windows Vista could also be created by users, or write properties to data by drag-and-drop — in a feature known as metadata painting, dragging a document onto an author stack, for example, would assign that author to the document. [20] In later builds, Microsoft replaced these Saved Searches with a single Library Saved Search that aggregated content from all locations with subqueries for individual types (e.g., the Music Library searched Library for all music). [12] Microsoft had sought to include metadata painting and user profile namespace virtual folders since the development of WinFS; [21] the objective was for Saved Searches to become the primary way users interact with data. [17] [21] Microsoft reportedly received extensive feedback that these changes were confusing — having Saved Searches in the new user profile namespace caused users to believe there were several folders with similar names. [17]

Accordingly, Microsoft removed the Library Saved Search and its associated subqueries; however, Windows Vista still includes Recent Documents, Recent E-mail,Recent Music,Recent Pictures and Videos, and Recently Changed Saved Searches, all of which use a single Indexed Locations Saved Search in accordance with the previous Library concept. [12] These Saved Searches were previously known as Last 30 Days Documents, Last 7 Days Email, Fresh Tracks, and Last 30 Days Pictures and Videos. [22]

Libraries

Windows 7 introduces Libraries to display and organize content. Similar to Saved Searches, a Library is an XML file with a unique extension — .library-ms extension — and it is a collection of files organized by specified locations. Unlike Saved Searches, however, users must specify folder locations, and Libraries can display content that does not match the type of the Library (e.g., the Pictures Library may display a document if any subfolders include documents). Libraries have a shell namespace extension in Explorer and their XML files can be reused across Windows installations or the network.

GNOME

A saved search in GNOME 2.14 Nautilus-search.png
A saved search in GNOME 2.14

In GNOME 2.14, a saved search is a virtual folder whose contents are the result of a Nautilus search, which has multiple backends. The contents of these folders are determined dynamically when the folder is opened, and updated automatically when files are created or modified.

Other implementations

Email clients

Virtual folders are also a well-established construct in email clients. In early 1991, the Emacs-based mail reader VM provided a virtual folder facility in its version 5.09. [23] [24] VM allows the users to define virtual folders using rules, taking their mail content from one or more physical folders and based on selection criteria dealing with dates, authors, recipient, subject, message body etc. Virtual folders can also be created interactively and take content from previously defined virtual folders, thereby cascading the selection criteria. The Evolution email client created by Helix Code in 2000, also incorporated virtual folders. Folders can be created that automatically list e-mails matching user-defined rules, for example all e-mail from a particular address or all e-mail that includes a specific keyword. [25] [26] The Opera web browser released a new mail client (beta in November 2002, final version in Jan 2003), M2 in which virtual folders (called access points) were used for all email management. Virtual folders were automatically made for active contacts, for attachments and for assigned labels. Virtual folders were also automatically generated whenever a search was performed, and manual virtual folders could use multiple logical mail header rules for their construction (including using regular expressions). Microsoft Outlook 2003 added a similar feature called Search Folders. Gmail, first released in 2004, bases all of its mail management on virtual folders accessed via labels. Mozilla Thunderbird also has the ability to create search folders and from version 1.5 allowed the search to be done over more than one email account. [27]

Music clients

In July 2002, Apple announced version 3 of iTunes which includes Smart Playlists which can be considered a variant of a virtual folder.[ clarification needed ] The only difference is that the search executed on accessing them is not on the file system's folder hierarchy, but on their internal data-store. [28] Microsoft also added a similar feature to version 9 of Windows Media Player in Windows XP called Auto Playlists in 2003. [29]

See also

Notes

  1. Saved Searches are also referred to as Search Folders [7] and were formerly known as Virtual Folders. [8]
  2. Earlier releases of Windows (including Windows Me [9] and Windows XP [8] [10] ) allowed searches to be saved as .fnd files called Saved Searches, but these files only saved certain search criteria and were not treated as folders; they did not automatically perform queries or rely on a database. With the release of Windows Vista, a .fnd file is referred to as a Legacy Search Query File.

Related Research Articles

New Technology File System (NTFS) is a proprietary journaling file system developed by Microsoft. Starting with Windows NT 3.1, it is the default file system of the Windows NT family. It superseded File Allocation Table (FAT) as the preferred filesystem on Windows and is supported in Linux and BSD as well. NTFS reading and writing support is provided using a free and open-source kernel implementation known as NTFS3 in Linux and the NTFS-3G driver in BSD. By using the convert command, Windows can convert FAT32/16/12 into NTFS without the need to rewrite all files. NTFS uses several files typically hidden from the user to store metadata about other files stored on the drive which can help improve speed and performance when reading data. Unlike FAT and High Performance File System (HPFS), NTFS supports access control lists (ACLs), filesystem encryption, transparent compression, sparse files and file system journaling. NTFS also supports shadow copy to allow backups of a system while it is running, but the functionality of the shadow copies varies between different versions of Windows.

<span class="mw-page-title-main">Outlook Express</span> Microsoft e-mail client software

Outlook Express, formerly known as Microsoft Internet Mail and News, is a discontinued email and news client included with Internet Explorer versions 3.0 through 6.0. As such, it was bundled with several versions of Microsoft Windows, from Windows 98 to Windows Server 2003, and was available for Windows 3.x, Windows NT 3.51, Windows 95, Mac System 7, Mac OS 8, and Mac OS 9. In Windows Vista, Outlook Express was superseded by Windows Mail.

<span class="mw-page-title-main">File Explorer</span> File manager application that is included with releases of the Microsoft Windows operating system

File Explorer, previously known as Windows Explorer, is a file manager application and default desktop environment that is included with releases of the Microsoft Windows operating system from Windows 95 onwards. It provides a graphical user interface for accessing the file systems, as well as user interface elements such as the taskbar and desktop.

WinFS was the code name for a canceled data storage and management system project based on relational databases, developed by Microsoft and first demonstrated in 2003. It was intended as an advanced storage subsystem for the Microsoft Windows operating system, designed for persistence and management of structured, semi-structured and unstructured data.

<span class="mw-page-title-main">Spotlight (Apple)</span> macOS search feature

Spotlight is a system-wide desktop search feature of Apple's macOS and iOS operating systems. Spotlight is a selection-based search system, which creates an index of all items and files on the system. It is designed to allow the user to quickly locate a wide variety of items on the computer, including documents, pictures, music, applications, and System Settings. In addition, specific words in documents and in web pages in a web browser's history or bookmarks can be searched. It also allows the user to narrow down searches with creation dates, modification dates, sizes, types and other attributes. Spotlight also offers quick access to definitions from the built-in New Oxford American Dictionary and to calculator functionality. There are also command-line tools to perform functions such as Spotlight searches.

<span class="mw-page-title-main">Desktop search</span>

Desktop search tools search within a user's own computer files as opposed to searching the Internet. These tools are designed to find information on the user's PC, including web browser history, e-mail archives, text documents, sound files, images, and video. A variety of desktop search programs are now available; see this list for examples. Most desktop search programs are standalone applications. Desktop search products are software alternatives to the search software included in the operating system, helping users sift through desktop files, emails, attachments, and more.

In computing, and specifically in the context of Microsoft Windows operating systems, Microsoft refers to Folder Redirection when automatically re-routing I/O to/from standard folders (directories) to use storage elsewhere on a network.

An IFilter is a plugin that allows Microsoft's search engines to index various file formats so that they become searchable. Without an appropriate IFilter, contents of a file cannot be parsed and indexed by the search engine.

Compared with previous versions of Microsoft Windows, features new to Windows Vista are very numerous, covering most aspects of the operating system, including additional management features, new aspects of security and safety, new I/O technologies, new networking features, and new technical features. Windows Vista also removed some others.

My Documents is the commonly recognized name of a special folder in Microsoft Windows This folder is supposed to be a personal area where users store their personal non-shared documents. However, many software developers have ignored this convention and as a result, this folder has become a dumping ground for the application data such as files containing settings and saved games. Users cannot delete, move or organize these files without causing unwanted behavior in their software.

On Microsoft Windows, a special folder is a folder that is presented to the user through an interface as an abstract concept instead of an absolute folder path. Special folders make it possible for any application to ask the operating system where an appropriate location for certain kinds of files can be found; independently of which version or user language of Windows is being used.

In Windows Shell programming, the Windows Shell namespace is an organized tree-structured hierarchical representation that Windows Explorer facilitates to graphically present file system contents and other objects to the end user. Conceptually, the Shell namespace may be regarded as a larger and more inclusive version of the file system.

The Windows shell is the graphical user interface for the Microsoft Windows operating system. Its readily identifiable elements consist of the desktop, the taskbar, the Start menu, the task switcher and the AutoPlay feature. On some versions of Windows, it also includes Flip 3D and the charms. In Windows 10, the Windows Shell Experience Host interface drives visuals like the Start Menu, Action Center, Taskbar, and Task View/Timeline. However, the Windows shell also implements a shell namespace that enables computer programs running on Windows to access the computer's resources via the hierarchy of shell objects. "Desktop" is the top object of the hierarchy; below it there are a number of files and folders stored on the disk, as well as a number of special folders whose contents are either virtual or dynamically created. Recycle Bin, Libraries, Control Panel, This PC and Network are examples of such shell objects.

Windows Vista has many significant new features compared with previous Microsoft Windows versions, covering most aspects of the operating system.

Program Files is the directory name of a standard folder in Microsoft Windows operating systems in which applications that are not part of the operating system are conventionally installed. Typically, each application installed under the 'Program Files' directory will have a subdirectory for its application-specific resources. Shared resources, for example resources used by multiple applications from one company, are typically stored in the 'Common Files' directory.

<span class="mw-page-title-main">Backup and Restore</span> Primary backup component of Windows Vista and Windows 7

Backup and Restore is the primary backup component of Windows Vista and Windows 7. It can create file and folder backups, as well as system images backups, to be used for recovery in the event of data corruption, hard disk drive failure, or malware infection. It replaces NTBackup, which has been part of Windows since Windows NT 3.51. Unlike its predecessor, it supports CDs, DVDs, and Blu-rays discs as backup media.

<span class="mw-page-title-main">Windows Search</span> Desktop search platform by Microsoft

Windows Search is a content index desktop search platform by Microsoft introduced in Windows Vista as a replacement for both the previous Indexing Service of Windows 2000 and the optional MSN Desktop Search for Windows XP and Windows Server 2003, designed to facilitate local and remote queries for files and non-file items in compatible applications including Windows Explorer. It was developed after the postponement of WinFS and introduced to Windows constituents originally touted as benefits of that platform.

Some of the new features included in Windows 7 are advancements in touch, speech and handwriting recognition, support for virtual hard disks, support for additional file formats, improved performance on multi-core processors, improved boot performance, and kernel improvements.

References

  1. Scot Hacker (1999). The BeOS Bible. Peachpit Press. ISBN   0-201-35377-6.
  2. Chris Herborth. "Show formula query strings in Tracker". The BeOS Tip Server. Retrieved 2007-03-22.
  3. Be Inc. (October 7, 1997). "Be Ships BeOS Preview Release 2". Be Inc. Archived from the original on May 20, 1998. Retrieved 2006-12-24.
  4. Be Inc. "Searching on the BeOS". The BeOS Tip of the Week. Be Inc. Archived from the original on 2002-07-24. Retrieved 2006-12-24.
  5. Scot Hacker. "Self-destructing queries". The BeOS Tip Server. Retrieved 2007-03-22.
  6. Dominic Giampaolo. "Personal homepage" . Retrieved 2006-09-10.
  7. 1 2 3 Microsoft. "Saved Search File Format". MSDN . Retrieved November 11, 2015.
  8. 1 2 3 Price, John. "Windows Vista Virtual Folders and Search". MSDN . Microsoft. Archived from the original on December 7, 2006. Retrieved June 23, 2023.
  9. "Advanced File Management with Windows Explorer". Informit. Pearson Education. November 28, 2001. p. 6. Retrieved June 23, 2023.
  10. 1 2 Shultz, Greg (October 12, 2005). "An in-depth look at Windows Vista's Virtual Folders technology". TechRepublic . CBS Interactive . Retrieved November 15, 2015.
  11. Kaelin, Mark (July 17, 2007). "How do I... Save and refine desktop searches in Microsoft Windows Vista?". TechRepublic . CBS Interactive . Retrieved November 11, 2015.
  12. 1 2 3 4 Bentz, Ben (October 31, 2006). "Query Composition: Building a search upon another search". Shell: Revealed Blog. Microsoft. Archived from the original on December 15, 2006. Retrieved October 20, 2015.
  13. Shultz, Greg (December 11, 2007). "Narrow a saved search with Vista's Query Composition feature". TechRepublic . CBS Interactive . Retrieved November 11, 2015.
  14. White, Nick (May 14, 2007). "Searcing, part III: Do you know what a SearchMelt is?". Windows Vista Team Blog. Microsoft. Archived from the original on May 16, 2007. Retrieved October 20, 2015.
  15. "Windows Vista Product Guide". Microsoft. 2006. pp. 44–51. Archived from the original (DOCX) on July 1, 2011. Retrieved March 1, 2018.
  16. "Remarks by Bill Gates, Chairman and Chief Software Architect, Microsoft CorporationMicrosoft Professional Developers Conference 2003". Microsoft. October 27, 2003. Archived from the original on February 3, 2004. Retrieved April 27, 2021. HILLEL COOPERMAN: "All right, one more thing. You might say, 'Well, I understand that these [stack] views [in WinFS] are generated dynamically. I understand this is all based on this structured metadata that Bill [Gates] was talking about, but I could kind of approximate this with folders today. I could make a bunch of folders for authors, and then in them have project folders.' I'll tell you something you couldn't do. You couldn't do it, have that exist, and do the reverse; for example, be able to navigate first author, then project or first project then author.
  17. 1 2 3 Thurrott, Paul (December 21, 2005). "Windows Vista December 2005 CTP (Build 5270) Review Part 1: Setup and User Interface". SuperSite for Windows. Penton. Archived from the original on December 23, 2005. Retrieved October 13, 2015.{{cite web}}: CS1 maint: unfit URL (link)
  18. Thurrott, Paul (October 6, 2010). "Working with Display Drivers in Windows Vista Beta 1". SuperSite for Windows. Penton . Retrieved November 11, 2015.
  19. Lee, Wei-Meng (August 2, 2005). "An In-Depth Look at Vista, Part 2". O'Reilly Media . Retrieved November 11, 2015.
  20. "Windows Vista First Hands-On Walkthrough of Microsoft's New 'Longhorn'". PCMag . Ziff Davis Media. September 6, 2005. p. 108. Retrieved October 25, 2015. When you create a stack based on a keyword, files added to that stack receive the keyword automatically.
  21. 1 2 "WinFS: The Windows File System (Microsoft Access 2002 Technical Articles)". MSDN . Microsoft. October 2003. Archived from the original on 2003-12-21. Retrieved February 1, 2018.
  22. Shinder, Deb (July 12, 2006). "More than just a pretty interface: File management with Vista Explorer". TechRepublic . CBS Interactive . Retrieved November 22, 2016.
  23. Kyle Jones. "VM User's Manual - Virtual Folders". Wonderworks. Retrieved 2010-01-26.
  24. Phil Sung. "VM Configuration and Workflow" . Retrieved 2010-03-13.
  25. Michael Hall (June 30, 2000). "You Say You Want an Evolution". Linux Planet. Retrieved 2006-12-24.
  26. Dave Whitinger (July 8, 1999). "Dave Whitinger and Miguel de Icaza at the ZD Open Source Forum". Linux Today. Retrieved 2006-12-24.
  27. "Saved Search - MozillaZine Knowledge Base" . Retrieved 2010-01-22.
  28. Apple (July 17, 2002). "Apple Announces iTunes 3". Apple. Archived from the original on July 26, 2006. Retrieved December 25, 2006.
  29. Microsoft (January 3, 2003). "Microsoft Announces Digital Media Upgrade for Windows XP With Final Release of Windows Media Player 9 Series and Windows Movie Maker 2". Microsoft. Retrieved 2006-12-25.