National Digital Information Infrastructure and Preservation Program

Last updated

The National Digital Information Infrastructure and Preservation Program (NDIIPP) of the United States was an archival program led by the Library of Congress to archive and provide access to digital resources. The program convened several working groups, administered grant projects, and disseminated information about digital preservation issues. [1] The U.S. Congress established the program in 2000, [2] and official activity specific to NDIIPP itself wound down between 2016 and 2018. [3] The Library was chosen because of its role as one of the leading providers of high-quality content on the Internet. The Library of Congress has formed a national network of partners dedicated to preserving specific types of digital content that is at risk of loss.

Contents

In July 2010, the Library launched a National Digital Stewardship Alliance (NDSA) to extend the work of NDIIPP to more institutions. The organization, which has been hosted by the Digital Library Federation since January 2016, focuses on several goals. [4] It develops improved preservation standards and practices; works with experts to identify categories of digital information that are most worthy of preservation; and takes steps to incorporate content into a national collection. It provides national leadership for digital preservation education and training. NDSA also provides communication and outreach for all aspects of digital preservation. The NDSA membership includes universities, professional associations, commercial businesses, consortia, and government agencies. [5]

Overview

The preservation of digital content has become a major challenge for libraries and archives whose mission is to preserve the intellectual and cultural heritage of the nation. In 1998 the Library of Congress began to develop a digital strategy with a group of senior managers who were charged with assessing the roles and responsibilities of the Library in the digital age. This oversight group was headed by the Associate Librarian for Strategic Initiatives, the Associate Librarian for Library Services, and the Register of Copyrights. This group held several planning meetings to assess the current state of digital archiving and preservation.

The Librarian of Congress James H. Billington commissioned the National Research Council Computer Science and Telecommunications Board of the National Academy of Sciences to evaluate the Library's readiness to meet the challenges of the rapidly evolving digital world. They recommended that the Library, working with other federal and non-federal institutions, take the lead in a national, cooperative effort to archive and preserve digital information. [6]

In December 2000, Congress appropriated up to $100 million [7] ($75 million of which was slated for dollar for dollar cost matching) for the effort. Congress rescinded $47 million in unspent funds in 2007. In 2009, NDIIPP received about $6.5 million as a line item in the Library's annual budget appropriation.

Congressional legislation

The U.S. Congress has asked the Library of Congress to lead a collaborative project, called the National Digital Information Infrastructure and Preservation Program. In December 2000, Congress passed special legislation (Public Law 106-554) in recognition of the importance of preserving digital content for future generations, appropriating $100 million to the Library of Congress to lead this effort. (A government-wide rescission of .22 percent in late December 2000 reduced this special appropriation to $99.8 million.)

This effort falls within the Library Services mission, which includes providing access to and preserving information for the benefit of the United States and the World. [8] This mission extends to materials in electronic formats as well. In addition, the Library is the home of the U.S. Copyright Office and is thus already engaged in issues relating to copyright in a digital environment.

Participating organizations

The National Digital Information Infrastructure and Preservation Program is a cooperative effort.

The Library is working closely with partners to assess considerations for shared responsibilities. Federal legislation calls for the Library to work jointly with the Secretary of Commerce, the director of the White House Office of Science and Technology Policy, and the National Archives and Records Administration. The legislation also directs the Library to seek the participation of "other federal, research and private libraries and institutions with expertise in the collection and maintenance of archives of digital materials," including the National Library of Medicine, the National Agricultural Library, the Research Libraries Group, the Online Computer Library Center and the Council on Library and Information Resources. [9]

The Library is also working with the non-federal sector. The overall strategy is being executed in cooperation with the library, creative, publishing, technology and copyright communities. In early 2001 the Library established a National Digital Strategy Advisory Board to help guide it through the planning process. This board is made up of experts from the technology, publishing, Internet, library and intellectual-property communities as well as government.

The Library has also established a working group to look at ways that current copyright law can address how libraries and archives handle digital materials when preserving them and making them available to users.

National significance

The availability of electronic information is today taken for granted. With the rapid growth of the Internet and the World Wide Web, millions of people have grown accustomed to using these tools as resources to acquire information—from a Ph.D. candidate conducting research for a dissertation to a teacher who might not be able to take a class on a field trip to see historical artifacts to a lifelong learner.

Digital has become the principal medium to create, distribute and store content, from text to motion pictures to recorded sound. Digital content now embodies much of the nation's intellectual, social and cultural history. Because digital materials can be so easily altered, corrupted or even lost, these materials must be saved now if they are to remain available to today's and tomorrow's generations.

NDIIPP provided a national focus on important policy, standards and technical components necessary to preserve digital content. Investments in modeling and testing various options and technical solutions took place over several years, resulting in recommendations to the U.S. Congress about the most viable and sustainable options for long-term preservation, copyright law in the context of digital preservation, and other issues.

In 2008, NDIIPP was the United States author for a four-nation recommendation (United States, Australia, United Kingdom, and the Netherlands) to establish laws to support digital preservation, particularly for materials at risk of being lost. [10] That report summarized the state of digital preservation in each country at the time, and highlighted relevant existing law for each country.

NDIIPP kickstarted the Library's efforts to advice individuals on personal digital archiving. This resulted in an e-book on the topic, and the seeds of the current Library of Congress website on Personal Digital Archiving.

NDIIPP managed the Congressional appropriation to kick-start many important digital preservation endeavors, some in the Digital preservation partnership projects section. Two others of note were issues that had some prior development, but were realized fully with the assistance of NDIIPP funding. [11] The first technology was LOCKSS, a tool for digital preservation of scholarly articles and other digital formats. The second was a pilot project for archiving digital content from the WNET Public Broadcasting station, the Preserving Digital Public Television Project. That project evolved into today's American Archive of Public Broadcasting. [12]

Digital preservation partnership projects

Digital Preservation Icon Icon WebResource DigitalPreservation.png
Digital Preservation Icon

Included in the 300 partners (as of March 2013) are eight consortial partnerships comprising 33 institutions that are selecting, collecting and preserving specific types of digital content:

Collections

In keeping with the mission of the NDIIPP, they are working with over 1,400 collections globally to preserve institution's at risk digital content. The collection's content ranges from Arts and Culture, Religion and Philosophy, Social Sciences, and World History and Cultures. [13] The Library of Congress provides a full list of the collections as well as a interactive map of the collections' geographical location.

Related Research Articles

National Digital Library Program

The Library of Congress National Digital Library Program (NDLP) is assembling a digital library of reproductions of primary source materials to support the study of the history and culture of the United States. Begun in 1995 after a five-year pilot project, the program began digitizing selected collections of Library of Congress archival materials that chronicle the nation's rich cultural heritage. In order to reproduce collections of books, pamphlets, motion pictures, manuscripts and sound recordings, the Library has created a wide array of digital entities: bitonal document images, grayscale and color pictorial images, digital video and audio, and searchable e-texts. To provide access to the reproductions, the project developed a range of descriptive elements: bibliographic records, finding aids, and introductory texts and programs, as well as indexing the full texts for certain types of content.

Legal deposit is a legal requirement that a person or group submit copies of their publications to a repository, usually a library. The number of copies required varies from country to country. Typically, the national library is the primary repository of these copies. In some countries there is also a legal deposit requirement placed on the government, and it is required to send copies of documents to publicly accessible libraries.

Digital obsolescence

Digital obsolescence is the risk of data loss because of inabilities to access digital assets, due to the hardware or software required for information retrieval being repeatedly replaced by newer devices and systems, resulting in increasingly incompatible formats. While the threat of an eventual "digital dark age" was initially met with little concern until the 1990s, modern digital preservation efforts in the information and archival fields have implemented protocols and strategies such as data migration and technical audits, while the salvage and emulation of antiquated hardware and software address digital obsolescence to limit the potential damage to long-term information access.

PANDORA, or Pandora, is a national web archive for the preservation of Australia's online publications. Established by the National Library of Australia in 1996, it has been built in collaboration with Australian state libraries and cultural collecting organisations, including the Australian Institute of Aboriginal and Torres Strait Islander Studies, the Australian War Memorial, and the National Film and Sound Archive. It is now one of three components of the Australian Web Archive.

American Memory

American Memory is an internet-based archive for public domain image resources, as well as audio, video, and archived Web content. Published by the Library of Congress, the archive launched on October 13, 1994, after $13 million was raised in private donations.

In library and archival science, digital preservation is a formal endeavor to ensure that digital information of continuing value remains accessible and usable. It involves planning, resource allocation, and application of preservation methods and technologies, and it combines policies, strategies and actions to ensure access to reformatted and "born-digital" content, regardless of the challenges of media failure and technological change. The goal of digital preservation is the accurate rendering of authenticated content over time. The Association for Library Collections and Technical Services Preservation and Reformatting Section of the American Library Association, defined digital preservation as combination of "policies, strategies and actions that ensure access to digital content over time." According to the Harrod's Librarian Glossary, digital preservation is the method of keeping digital material alive so that they remain usable as technological advances render original hardware and software specification obsolete.

The California Digital Library (CDL) was founded by the University of California in 1997. Under the leadership of then UC President Richard C. Atkinson, the CDL's original mission was to forge a better system for scholarly information management and improved support for teaching and research. In collaboration with the ten University of California Libraries and other partners, CDL assembled one of the world's largest digital research libraries. CDL facilitates the licensing of online materials and develops shared services used throughout the UC system. Building on the foundations of the Melvyl Catalog, CDL has developed one of the largest online library catalogs in the country and works in partnership with the UC campuses to bring the treasures of California's libraries, museums, and cultural heritage organizations to the world. CDL continues to explore how services such as digital curation, scholarly publishing, archiving and preservation support research throughout the information lifecycle.

The National Geospatial Digital Archive (NGDA) is an archive of cartographic information funded by the Library of Congress through the National Digital Information Infrastructure and Preservation Program (NDIIPP) in collaboration with the University of California Santa Barbara, and Stanford University. The purpose of the archive is to collect and preserve geospatial data and images on a national scale, and develop mechanisms for making data available for future generations.

The Brittle Books Program is an initiative carried out by the National Endowment for the Humanities at the request of the United States Congress. The initiative began officially between 1988 and 1989 with the intention to involve the eventual microfilming of over 3 million endangered volumes.

The term born-digital refers to materials that originate in a digital form. This is in contrast to digital reformatting, through which analog materials become digital, as in the case of files created by scanning physical paper records. It is most often used in relation to digital libraries and the issues that go along with said organizations, such as digital preservation and intellectual property. However, as technologies have advanced and spread, the concept of being born-digital has also been discussed in relation to personal consumer-based sectors, with the rise of e-books and evolving digital music. Other terms that might be encountered as synonymous include "natively digital", "digital-first", and "digital-exclusive".

Preservation metadata is item level information that describes the context and structure of a digital object. It provides background details pertaining to a digital object's provenance, authenticity, and environment. Preservation metadata, is a specific type of metadata that works to maintain a digital object's viability while ensuring continued access by providing contextual information, usage details, and rights.

The Section 108 Study Group was a select committee of copyright experts and library and archives professionals, convened by the Copyright Office and the Library of Congress's National Digital Information Infrastructure and Preservation Program (NDIIPP). The Study Group was charged with updating Section 108 of the United States Copyright Act—relating to libraries and archives' ability to make copies of copyrighted works available under certain circumstances—for the digital age. The Study Group issued a final report in March 2008, outlining proposed changes and updates to Section 108.

The British Library Preservation Advisory Centre raises public awareness of preservation issues in libraries and serves as a nexus for developing and promoting improved preservation management of library and archive materials in the UK and Ireland. It was established as the National Preservation Office by the British Library Board in 1984, and was renamed to its current name in 2009. As of 31 March 2014 the centre is now closed.

A digital library, also called an online library, an internet library, a digital repository, or a digital collection is an online database of digital objects that can include text, still images, audio, video, digital documents, or other digital media formats or a library accessible through the internet. Objects can consist of digitized content like print or photographs, as well as originally produced digital content like word processor files or social media posts. In addition to storing content, digital libraries provide means for organizing, searching, and retrieving the content contained in the collection. Digital libraries can vary immensely in size and scope, and can be maintained by individuals or organizations. The digital content may be stored locally, or accessed remotely via computer networks. These information retrieval systems are able to exchange information with each other through interoperability and sustainability.

The MetaArchive Cooperative is an international digital preservation network composed of libraries, archives, and other memory institutions. As of August 2011, the MetaArchive preservation network is composed of 24 secure servers in four countries with a collective capacity of over 300TB. Forty-eight institutions are actively preserving their digital collections in the network.

DuraSpace was a 501(c)(3) not-for-profit organization founded in 2009 when the Fedora Commons organization and the DSpace Foundation, two of the largest providers of open source repository software for managing and providing access to digital content, joined their organizations. In July 2019 DuraSpace merged with LYRASIS, becoming a division of that organization.

Howard Besser is a scholar of digital preservation, digital libraries, and preservation of film and video. He is Professor of Cinema Studies and the founding director of the NYU Moving Image Archiving and Preservation Program ("MIAP"), a graduate program in the Tisch School. Besser also works as a Senior Scientist at New Your University's Digital Library Initiative. He conducted extensive research in image databases, multimedia operation, digital library, and social and cultural influence of the latest Information Technology. Besser is a prolific writer and speaker, and has consulted with many governments, educational institutions, and arts agencies on digital preservation matters. Besser researched libraries' new technology, archives, and museums. Besser has been actively contributing at the international level to build metadata and upgrade the quality of the cultural heritage community. He predominantly, he focused on image and multimedia databases; digital library aspects ; cultural and societal impacts of information technology, and developing new teaching methods through technology such as web-based instructions and distance learning. Besser was closely involved in development of the Dublin Core and the Metadata Encoding and Transmission Standard (METS), international standards within librarianship.

National Recording Preservation Plan

The National Recording Preservation Plan is a strategic guide for the preservation of sound recordings in the United States. It was published in December 2012 by the Council on Library and Information Resources (CLIR) and the National Recording Preservation Board of the Library of Congress. The plan was written by a community of specialists, but is prominently credited to Brenda Nelson-Strauss, Alan Gevinson and Sam Brylawski

The American Archive of Public Broadcasting (AAPB) is a collaboration between the Library of Congress and WGBH Educational Foundation, founded through the efforts of the Corporation for Public Broadcasting. The AAPB is a national effort to digitally preserve and make accessible historically significant public radio and television programs created over the past 70+ years. The archive comprises over 120 collections from contributing stations and original producers from US states and territories. As of April 2020, the collection includes nearly 113,000 digitized items preserved on-site at the Library of Congress, and 53,000 items in the collection are streaming online in the AAPB Online Reading Room.

References

  1. "Digital Preservation (Library of Congress)". www.digitalpreservation.gov. Retrieved 2019-05-06.
  2. "A Brief History of NDIIPP". The Library of Congress - Digital Preservation. Archived from the original on December 27, 2016. Retrieved December 30, 2016. 2000 - NDIIP legislation is passed
  3. "Digital Preservation (Library of Congress)". www.digitalpreservation.gov. Retrieved 2019-05-06.
  4. "Digital Library Federation to Host National Digital Stewardship Alliance". 2015-10-19. Retrieved 2016-08-17.
  5. "National Digital Stewardship Alliance". Digital Library Federation. Retrieved 2016-08-17.
  6. LC 21: A Digital Strategy for the Library of Congress. Nap.edu. 2003-06-01. doi:10.17226/9940. ISBN   978-0-309-07144-4. Archived from the original on 2012-06-25. Retrieved 2012-08-07.
  7. Library of Congress. "Program Background". Webpage. Library of Congress. Archived from the original on 25 January 2013. Retrieved 6 March 2013.
  8. "About the Library | Library of Congress". Library of Congress. Retrieved 2019-05-06.
  9. Library of Congress. "NDIIPP PLAN" (PDF). Library of Congress Digital Preservation NDIIPP Plan. Library of Congress.
  10. Library of Congress. "International Study on the Impact of Copyright Law on Digital Preservation" (PDF). Digital Preservation (LOC) subsite for subject report. Retrieved 5 May 2019.
  11. Cruse and Sandore, Patricia and Beth (Winter 2009). "The Library of Congress National Digital Information Infrastructure and Preservation Program". Library Trends. 57: 301–314. doi:10.1353/lib.0.0055. S2CID   36323109.
  12. "A Brief History of the AAPB". americanarchive.org. Retrieved 2019-05-06.
  13. "Collections - Digital Preservation (Library of Congress)". www.digitalpreservation.gov. Retrieved 2019-05-06.