Beagrie.com

Library and Archives Canada (LAC) have released the report Survey of Digital Preservation Practices in Canada, which presents the result of a survey the LAC commissioned in 2008 and completed in 2009.

The survey received 61 full responses from a variety of types of organisations: libraries, archives government departments/agencies, museums, research institutes, across a number of sectors: academic, governments and not-for profit. Although invitations were sent to several organizations in private industry, no responses were received from this sector.

The survey found that 72% of respondents are involved in some aspects related to digital preservation. Offsite storage was the most commonly cited practice in use, followed by activities that address the decay or obsolescence of storage media, including refreshing, bitstream copying and replication.

Digital preservation practices that address the understandability of the digital object (format/software obsolescence), such as migration or emulation are less widespread, even amongst those repositories that have a formal mandate to preserve. As well, only a few repositories are employing the types of  extensive metadata schemas needed for long-term preservation, such as PREMIS.

The majority of repositories in the survey are applying some basic integrity measurements (virus check, format verification, checksum verification, format validation) but other methods for establishing authenticity and trust in digital repositories, such as through the use of persistent identifiers and audit trails for digital objects are not well established.

There are also numerous other challenges for repositories beyond the most obvious technical ones, in particular around funding/staffing and expertise.

The report concludes digital preservation presents significant challenges; and given the growing volume and complexity of digital information it will continue to do so in the future. It suggests one way to assist Canadian organisations with these challenges would be to establish a central entity in Canada that can provide leadership in this area.

The European Archive are organising a Web Archiving Training Session on 14th and 15th of October 2010 in Paris.

The training will cover all aspects of Web Archiving for librarians, archivists as well as technicians in charge of web archiving. Special attention will be given to providing the necessary background on Internet technologies in general and Web publishing in particular to understand the media and requirements for its preservation.

Registration fees for the 2 days (including lunches and coffee breaks)are 750€ standard rate or 580€ for non-profit and governmental organisations.

The New Zealand Government has announced the merger of Archives New Zealand, the National Library and the Department of Internal Affairs and new funding of £5.9 million pounds (NZ$12.6 million) to create a digital archive for New Zealand.

Announcing the new funding and the merger, the Minister responsible for all three agencies, Guy Hands believes they share natural synergies, a common focus on using digital technology, and making public information widely accessible to citizens through the internet. This move will allow expertise and resources to be pooled, while at the same time sharing back office costs. All savings generated by this project will be redirected into better frontline services for the public.

The New Zealand Government is also allocating £5.9 million pounds (NZ$12.6 million) of new money to Archives New Zealand and the National Library over the next four years to develop and implement a full-scale industrial-strength digital archive. The new archive will utilise Archive’s New Zealand’s existing infrastructure and build on functions developed for the National Library’s National Digital Heritage Archive.

A public announcement about the Government Digital Archive and was made at the Government Recordkeeping Forum held in Wellington on Tuesday 1 June.

I am pleased to announce that the final report for Keeping Research Data Safe 2 (KRDS2) is now available from the JISC website. This KRDS2 study report presents the results of a survey of available cost information, validation and further development of the KRDS activity cost model, and a new taxonomy to help assess benefits alongside costs.

KRDS2 has delivered the following:

• A survey of cost information for digital preservation, collating and making available 13 survey responses for different cost datasets;

• The KRDS activity model has been reviewed and its presentation and usability enhanced;

• Cost information for four organisations (the Archaeology Data Service; National Digital Archive of Datasets; UK Data Archive; and University of Oxford) has been analysed in depth and presented in case studies;

• A benefits framework has been produced and illustrated with two benefit case studies from the National Crystallography Service at Southampton University and the UK Data Archive at the University of Essex.

One of the key findings on the long-term costs of digital preservation for research data was that the cost of archiving activities (archival storage and preservation planning and actions) is consistently a very small proportion of the overall costs and significantly lower than the costs of acquisition/ingest or access activities for all the case studies in KRDS2. As an example the respective activity staff costs for the Archaeology Data Service are Access (c.31%), Outreach/Acquisition/Ingest (c.55%), Archiving (c.15%).This confirms and supports a preliminary finding in KRDS1.

A range of supplementary materials in support of this report have also been made available on the KRDS project website. This includes the ULCC Excel Cost Spreadsheet for the NDAD service together with a Guide to Interpreting and Using the NDAD Cost Spreadsheet. The NDAD Cost Spreadsheet has previously been used as an exercise in digital preservation training events and may be particularly useful in training covering digital preservation costs. The accompanying Guide provides guidance to those wishing to understand and experiment with the spreadsheet.

I am pleased to announce that our study Ensuring Perpetual Access: establishing a federated strategy on perpetual access and hosting of electronic resources for Germany is now available.

Concepts and Properties of Archives and Hosting in the Strategy and their Relationships ©Charles Beagrie Ltd 2009. CreativeCommons Attribution-Share Alike3.0 Key: solid colour represents core properties and fading colour represents weaker properties of archives and hosting services.

The study was commissioned by the Alliance of German Science Organisations to help develop a strategy to address the challenges of perpetual access and hosting of electronic resources. In undertaking the study we were requested to focus on commercial e-journals and retro-digitised material.

Although developed for Germany, there is substantial discussion and recommendations around the issues of perpetual access, archiving, and sustainability of hosting and access services for these materials which will be of interest to an international audience.

Contents include:

• Discussion, definition, and glossary of terms;
• Review of relevant  international activity;
• Review of current and future desired position in Germany;
• Gap analysis;
• A series of use cases;
• Scenarios, potential solutions, and recommendations

Model used for discussion of the Federated Strategy on Perpetual Access and Hosting of Electronic Resources for Germany  ©Charles Beagrie Ltd 2009. CreativeCommons Attribution-Share Alike3.0

The members of the Alliance of German Science Organisations are the Alexander von Humboldt Foundation, the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation), the Fraunhofer-Gesellschaft, the German Academic Exchange Service (DAAD), the German Rectors’ Conference (Hochschulrektorenkonferenz – HRK), the Helmholtz Association, the Leibniz Association, the Max Planck Society, and the Wissenschaftsrat (German Council of Science and Humanities). For further information on the Alliance Hosting Working Group that steered the study see:

English webpage:

http://www.allianzinitiative.de/en/core_activities/national_hosting_strategy/working_group/

Deutsch:

http://www.allianzinitiative.de/de/handlungsfelder/nationale_hosting_strategie/arbeitsgruppe/

The Final Report of the Blue Ribbon Task Force on Sustainable Digital Preservation and Access is now available.  The report Sustainable Economics for a Digital Planet: Ensuring Long-Term Access to Digital Information describes its work as follows:

“…questions remain about what digital information we should preserve, who is responsible for preserving, and who will pay.

The Blue Ribbon Task Force on Sustainable Digital Preservation and Access investigated these questions from an economic perspective. In this report, we identify problems intrinsic to all preserved digital materials, and propose actions that stakeholders can take to meet these challenges to sustainability. We developed action agendas that are targeted to major stakeholder groups and to domain-specific preservation strategies.

The Task Force focused its inquiry on materials that are of long-term public interest, looking at four content domains with diverse preservation profiles:

• Scholarly discourse: the published output of scholarly inquiry
• Research data: the primary inputs into research, as well as the first-order results of that research
• Commercially owned cultural content: culturally significant digital content that is owned by a private entity and is under copyright protection; and
• Collectively produced Web content: Web content that is created interactively, the result of collaboration and contributions by consumers.”

I have not had chance to look at the report in detail but hope to add a short commentary to the blog in due course.

The UK Government’s Department for Culture Media and Sport (DCMS) is inviting responses to a Proposal on the Collection and Preservation of UK Offline and Microform Publications and UK Online Publications (Available free of charge and without access restrictions)

The online document is a republication of the consultation document in commentable form.  As well as supporting comments for each paragraph, it provides a unique URI for each paragraph in the original document, which you may use as reference links in any online discussion you engage in about the consultation.

Chapter 1 provides general information about legal deposit and the legal deposit advisory panel (LDAP) proposals while Chapter 2 describes the consultation process.  Annexes A-F set out the main themes and questions:

Annex A: Proposals for Offline and Microform Publications
Annex B: Proposals for Online Publications
Annex C: Online Content to be Published
Annex D: Impact Assessments – Intervention and options, analysis and evidence
Annex E: Further Details on Territoriality
Annex F: Further Details on Harvesting Process

Finally, Annex G provides a summary of the consultation questions.

Closing date for responses is Monday 1 March 2010.

I am pleased to announce that the findings from the Keeping Research Data Safe 2 (“KRDS2) survey of digital preservation cost information are now available on the KRDS2 project webpage.

One of the core aims of the KRDS2 project was to identify potential sources of cost information for preservation of digital research data and to conduct a survey of them. Between September and November 2009 we made an open invitation via email lists and the project blog and project webpage for others to contact us and contribute to the data survey if they had research datasets and associated cost information that they believe may be of interest to the study.

13 survey responses were received: 11 of these were from UK-based collections, and 2 were from mainland Europe. Two further potential contributions from the USA were unfortunately not available in time to be included.

The responses covered a broad area of research including the arts and humanities, social sciences, and physical and biological sciences and research data archives or cultural heritage collections. Each survey response is approximately 6-8 pages in length.

A summary analysis plus individual completed responses to the data survey that provide  more detail, are available.

We have also made the revised versions of the KRDS2 activity model available to download.

We aim to release the KRDS2 report via JISC in March following peer review and final editing. Further supplementary materials from KRDS2 will also be placed on the project webpage in March.

You will also notice that we have recently undertaken a major website re-design and made additions, should you wish to browse other information on the web site.

An important editorial has just appeared online in the February issue of The American Naturalist.
To promote the preservation and fuller use of data, The American Naturalist, Evolution, the Journal of Evolutionary Biology, Molecular Ecology, Heredity, and other key journals in evolution and ecology will soon introduce a new data archiving policy. The policy has been enacted by the Executive Councils of the societies owning or sponsoring the journals. For example, the policy of The American Naturalist will state:

This journal requires, as a condition for publication, that data supporting the results in the paper should be archived in an appropriate public archive, such as GenBank, TreeBASE, Dryad, or the Knowledge Network for Biocomplexity. Data are important products of the scientific enterprise, and they should be preserved and usable for decades in the future. Authors may elect to have the data publicly available at time of publication, or, if the technology of the archive allows, may opt to embargo access to the data for a period up to a year after publication. Exceptions may be granted at the discretion of the editor, especially for sensitive information such as human subject data or the location of endangered species.

This policy will be introduced approximately a year from now, after a period when authors are encouraged to voluntarily place their data in a public archive. Data that have an established standard repository, such as DNA sequences, should continue to be archived in the appropriate repository, such as GenBank. For more idiosyncratic data, the data can be placed in a more flexible digital data library such as the National Science Foundation–sponsored Dryad Archive.

Authors of the editorial, Michael C. Whitlock, Mark A. McPeek, Mark D. Rausher, Loren Rieseberg, and Allen J. Moore present the case for the importance of data archiving in science.   This is the first of several coordinated editorials soon to appear in major journals.

The Association of American Universities and the American Institute of Physics have issued the following press release:

WASHINGTON, D.C., January 12, 2010 — An expert panel of librarians, library scientists, publishers, and university academic leaders today called on federal agencies that fund research to develop and implement policies that ensure free public access to the results of the research they fund “as soon as possible after those results have been published in a peer-reviewed journal.”

The Scholarly Publishing Roundtable was convened last summer by the U.S. House Committee on Science and Technology, in collaboration with the White House Office of Science and Technology Policy (OSTP). Policymakers asked the group to examine the current state of scholarly publishing and seek consensus recommendations for expanding public access to scholarly journal articles.

The various communities represented in the Roundtable have been working to develop recommendations that would improve public access without curtailing the ability of the scientific publishing industry to publish peer-reviewed scientific articles.

The Roundtable’s recommendations, endorsed in full by the overwhelming majority of the panel (12 out of 14 members), “seek to balance the need for and potential of increased access to scholarly articles with the need to preserve the essential functions of the scholarly publishing enterprise,” according to the report.

“I want to commend the members of the Roundtable for reaching broad agreement on some very difficult issues,” said John Vaughn, executive vice president of the Association of American Universities, who chaired the group. “Our system of scientific publishing is an indispensible part of the scientific enterprise here and internationally. These recommendations ensure that we can maintain that system as it evolves and also ensure full and free public access to the results of research paid for by the American taxpayer.”

The Roundtable identified a set of principles viewed as essential to a robust scholarly publishing system, including the need to preserve peer review, the necessity of adaptable publishing business models, the benefits of broader public access, the importance of archiving, and the interoperability of online content.

In addition, the group affirmed the high value of the “version of record” for published articles and of all stakeholders’ contributions to sustaining the best possible system of scholarly publishing during a time of tremendous change and innovation.

To implement its core recommendation for public access, the Roundtable recommended the following:

• Agencies should work in full and open consultation with all stakeholders, as well as with OSTP, to develop their public access policies.
• Agencies should establish specific embargo periods between publication and public access.
• Policies should be guided by the need to foster interoperability.
• Every effort should be made to have the Version of Record as the version to which free access is provided.
• Government agencies should extend the reach of their public access policies through voluntary collaborations with non-governmental stakeholders.
• Policies should foster innovation in the research and educational use of scholarly publications.
• Government public access policies should address the need to resolve the challenges of long-term digital preservation.
• OSTP should establish a public access advisory committee to facilitate communication among government and nongovernment stakeholders.
• In issuing its report, the Roundtable urged all interested parties to move forward, beyond “the too-often acrimonious” past debate over access issues towards a collaborative framework wherein federal funding agencies can build “an interdependent system of scholarly publishing that expands public access and enhances the broad, intelligent use of the results of federally-funded research.”

The report, as well as a list of Roundtable members, member biographies, and the House Science and Technology Committee’s charge to the group, can be found here.