Will PDF prevent a digital dark age?

• Author: Swartz, Nikki
• Position: Up front: news, trends & analysis

It is every archivist's worst nightmare: electronic files will survive, but the equipment required to read them will not. With more and more records and information being stored digitally, this scenario has become a reality. Institutions have been struggling with ensuring the longevity of digital art, electronic court filings, online journals, research, and more. Businesses have not been able to read electronic records needed for lawsuits. Consider these sobering examples:

* The British Broadcasting Corp. created a computer-based collection of photographs, writings, and other snapshots of life in 1986, which marked the 900th anniversary of the written English survey the Domesday Book. While scholars can still read the 1086 book, the digital tome needs customized software and hardware that are breaking down from old age, meaning records from just 17 years ago are vanishing rapidly.

* Joe Miller, a University of Southern California neurobiologist, could not read magnetic tapes from NASA's 1976 Viking landings on Mars. Current technology could not read the data, which was in an unknown format, so he was forced to track down printouts and hire students to retype everything.

* Federal law requires the Census Bureau to retain records on "permanent" storage media. Data from the 1960 Census were recorded on magnetic tape, which was thought to be permanent at the time. In 1976, when the National Archives asked the Census Bureau to provide parts of the 1960 data that had long-term historical value, the Bureau took three years to furnish the records because it no longer had machines capable of reading the data.

Currently, governments around the world are facing an enormous challenge: meeting mandates to electronically archive an overwhelming amount of documents. The volume of electronic records (e-mail, Web pages, and database records) in the U.S. government required by law to be archived by the National Archives and Records Administration (NARA) is staggering--so much so that President Bush proposed a fiscal year 2004 budget of more than $300 million to assist NARA in addressing preservation, technology, and storage needs.

One example of the enormity of the electronic archive challenge, the Census Bureau, has accumulated 600 million pages of information from the 2000 Census that it will be transferring to NARA--more than five times the amount of data that NARA has captured and fully processed in the last 30 years. NARA estimates that 36.5 billion...