Beagrie.com

The Digital Preservation Coalition is today publishing online in PDF  the latest in its popular Technology Watch Reports ‘Intellectual Property Rights for Digital Preservation’ by Andrew Charlesworth of the University of Bristol.  The report was previously available as a preview to DPC members but is now publicly accessible. This is the third report in the DPC technology watch series to have been commissioned with Charles Beagrie Ltd as series editors.

Legal issues, in particular the process of obtaining copyright clearance for preservation and access of archived material, can contribute significantly to the cost and complexity of digital preservation. It is an area where the wider preservation community often needs to make its case with government and other legislators.

‘While a number of legal issues colour contemporary approaches to, and practices of, digital preservation, it is arguable that intellectual property law, represented principally by copyright and its related rights, has been by far the most dominant, and often intractable, influence,’ explained Andrew Charlesworth.

‘It’s essential for those engaging in digital preservation to understand the letter of the law and to be able to identify and implement practical and pragmatic strategies for handling legal risks in the pursuit of preservation objectives. Moreover, those engaging in digital preservation need to advance a coherent and cogent message to rights holders, policymakers and the public with regard to the relationship between intellectual property law and digital preservation. It is in the long-term interests of all stakeholders that modern intellectual property law permits the implementation of effective and efficient mechanisms of digital preservation.’

The series editors have been further supported by an Editorial Board drawn from DPC members and peer reviewers who have commented on the text prior to release. The Editorial Board comprises William Kilbride (Chair), Neil Beagrie (Principal Investigator and Managing Editor for the series), Janet Delve (University of Portsmouth), Sarah Higgins (Archives and Records Association), Tim Keefe (Trinity College Dublin), Andrew McHugh (University of Glasgow), Dave Thompson (Wellcome Library)

Five more reports are in development – on Preservation, Trust and E-Journals; Digital Forensics for Preservation; Preserving Computer Aided Design; Web Archiving; and Preservation Metadata.

You can download and read the whole series of current and past DPC Technology Watch reports in PDF format from the DPC website.

it was a real pleasure to attend the celebration of the DPC’s 10th anniversary this week at the House of Lords and to catch up with many friends and colleagues.

At the event, DPC Chairman Richard Ovenden and Lord MacNally, Minister of State for Justice, celebrated the achievements of the Digital Preservation Coalition over the past ten years, but  also highlighted the continuing risk to government, business, educational and cultural organisations and by society at large in failing to address the preservation of digital information. In his speech, Richard Ovenden pointed to the major improvements that have been made in the past ten years but highlighted recent studies which show how major data losses continue to be suffered:
• Websites of MPs Robin Cook, Claire Short no longer live
• Website of Woolworths plc and Welsh Language Board both lost
• After one year, 11% web resources shared through social media will be lost

A briefing from the TIMBUS project illustrates how the challenge of reliable access to data is no longer simply a concern for memory institutions or research centres:
• 94% of companies that suffer major data loss incidents go out of business in 2 years
• The global costs of data centre downtime are estimated at $426bn per annum
• Data creation and consumption is diverse in ways which could not have been imagined a decade ago. Mobile devices have started becoming more ubiquitous than power supply. In 2011 the global ‘on network and off-grid’ population reached at 48million – that is mobile phone users who don’t have access to power at home.

Formally established in July 2001 and endorsed at a House of Lords reception in February 2002, today the DPC proudly boasts just shy of forty established members. The energy and expertise of its staff and Executive Board has facilitated the hosting of well over sixty digital preservation training events; awarded dozens of scholarships via its Leadership Programme; commissioned leading edge Technology Watch Reports; produced fifty ‘What’s New in Digital Preservation?’ news round ups; has advised and lobbied government and other public sector on policy; it  is also  involved in two European Commission-funded initiatives (APARSEN and TIMBUS) and runs the biannual Digital Preservation Awards.

‘The successes of the Coalition in the last decade have been impressive’, noted Richard Ovenden the current chair, ‘and we have come a long way in addressing the challenge set for us in 2002’. But the question of how to ensure long term value from digital data remains problematic. ‘The need for digital preservation is growing in just the same way as the digital domain: in total size, in sheer complexity and in economic importance. ’

‘The question about preserving authentic digital records is not simply one for archives or libraries, explained William Kilbride of the DPC. ‘An article in the Economist recently reported that patent litigation between technology companies in the US was worth $200bn in 2011 – equivalent to 2% of GDP. ‘This may not make you think about digital preservation, until you realise that the best way to defend a court case is to cite authoritative records of innovation.’

‘In other words, digital preservation has vital role in protecting some of the most dynamic and innovative sectors of the economy.’

‘That’s just one example: health care, civil engineering, pensions, the recording industry, care services, research institutes, legal services and many more sectors need to maintain and exploit accurate and authoritative records over an extended period. No wonder that Gartner recently reported that 15% of companies would soon need to employ a digital archivist.’

In his speech, Richard Ovenden then looked to the next ten years. He observed that data is an asset and that preservation creates new opportunities, but only if organisations are clear about their own plans. He called on organisation to ask five simple questions:
• Do they know which data sets from the last decade are going to be valuable in the next?
• Do they have robust plans for the long-term exploitation to business-critical, high-value data?
• Do they have robust preservation plans to ensure long term access to data?
• How are they going to recruit or train staff with skills in digital preservation needs?
• How can they collaborate more closely to meet the challenge of digital preservation?

You can read the full DPC press release on the event on its website.

We are pleased to announce a new study and collaboration between the Science and Technology Facilities Council (STFC), Charles Beagrie Ltd (Neil Beagrie), and the Centre for Strategic Economic Studies Victoria University (Prof John Houghton) on the value and impact of the British Atmospheric Data Centre (BADC).

The BADC, based at the STFC Rutherford Appleton Laboratory in the UK, is the Natural Environment Research Council’s (NERC) Designated Data Centre for the Atmospheric Sciences. Its role is to assist UK atmospheric researchers to locate, access, and interpret atmospheric data and to ensure the long-term integrity of atmospheric data produced by NERC projects. Since its establishment, the BADC has become the de facto point of contact for UK researchers needing access to the meteorological products of both the Met Office and the European Centre for Medium Range Weather Forecasting (ECMWF). There is also considerable interest from the international research community in BADC data holdings.

The BADC’s significance has grown considerably in the last decade or so and with the use of access statistics and user feedback it has generally been easy for the BADC to demonstrate that it offers a valuable service to its users. However, it is a much more challenging proposition to find ways of analysing BADC usage that make a clear statement about the very important issue of how much economic impact that the BADC has on the sector. The new BADC study funded by JISC and the Natural Environment Research Council (NERC) is intending to investigate in detail exactly this question and to give a clear indication of what the value is of having a free to use and open access data resource like the BADC.

Engaging the expertise of Neil Beagrie of Charles Beagrie Ltd. and Professor John Houghton of the CSES, the project will analyse and survey indicators and perceptions of the value of digital collections held by the BADC and how those indicators and perceptions of value can be measured. The CSES and Charles Beagrie Ltd have led the field in conducting value perception and economic impact surveys for digital repositories and they have recently completed a similar exercise with the Economic and Social Data Service (ESDS) in the UK. The report from this work, The Economic Impact Evaluation of the Economic and Social Data Service, is now available from the Economic and Social Science Research Council (ESRC). Another study on the impact of the Archaeology Data Service is also underway in parallel with that for BADC.

A major element of the BADC study will be two forms of stakeholder survey. The first phase will see a selection of users and depositors from all sectors be invited to participate in in-depth interviews, and secondly an online survey will be launched to gauge the levels of use, impacts, and perceptions of value amongst the broadest possible range of BADC users.

Our economic analysis aims to include a range of approaches, starting with the most immediate and direct measures of value that are likely to represent lower bound estimates of the value of BADC data and services and moving outwards to estimates of the wider economic benefits.

We hope this project will not only have immediate benefits for the BADC, its stakeholders and user communities, but will build on previous work to investigate methodologies and good practice in the area of valuation that will be directly applicable to other repositories, in different domains, allowing them to reap the benefits of this work as they seek to analyse their own economic impact.

For further information on the project see the BADC Value and Impact study project web page.

The Keeping Research Data Safe (KRDS) web site has been updated today with links and details of other implementations based on the KRDS tools. Implementation added are as follows:

• The Economic Impact Evaluation of the Economic and Social Data Service
• Impact of the Archaeology Data Service
• The Value and Impact of the British Atmospheric Data Centre
• Business Models and Cost Estimation: Dryad Repository Case Study
• Infrastructure for Integration in Structural Sciences (I2S2): Extended Cost Model and Benefits Use Cases
• JISC DMI Programme: Business Models, Cost and Benefit Analyses Support Web Page
• Application of the Benefits Analysis Tools for MRC population health studies
• Research360 University of Bath

For further details see the KRDS project website.

If you have based implementations on KRDS tools we would be happy to add details to the list. Please send further  information to info@beagrie.com.

We are pleased to announce that the Economic and Social Research Council (ESRC) in the UK has published the report of the Economic Impact Evaluation of the Economic and Social Data Service (ESDS) to coincide with the launch of the new UK Data Service that succeeds it.

The ESDS has its origins in the UK Data Archive established over 40 years ago and this one of the longest standing research data archives and proponents of digital preservation in the World. The impact evaluation therefore may be of interest to the digital preservation and data curation communities beyond the social sciences and economics, particularly as quantitative as well as qualitative evidence of impact in our fields is still relatively rare.

The Economic Impact Evaluation of the Economic and Social Data Service report (PDF file) was produced by Charles Beagrie Ltd and the Centre for Strategic Economic Studies (CSES) Victoria University and was authored by Neil Beagrie, John Houghton, Anna Palaiologk and Peter Williams. It combines approaches for qualitative and quantitative assessment of impact drawing on methodologies from Keeping Research Data Safe and more generally from economics and the social sciences.

An extract from the ESRC/ESDS press release of 24 July announcing the UK Data Service is as follows:

Continuing access to the most valuable collection of social and economic data in the UK has been secured with a £17 million investment over five years for the UK Data Service. Funded by the Economic and Social Research Council (ESRC), the new service is structured to support researchers in academia, business, third sector and all levels of government.

The new service, starting on 1 October 2012, will integrate the Economic and Social Data Service (ESDS), the Census Programme, the Secure Data Service and other elements of the data service infrastructure currently provided by the ESRC, including the UK Data Archive.

The integration follows an economic evaluation of ESDS, which reveals that for every pound currently invested in data and infrastructure, the service returns £5.40 in net economic value to users and other stakeholders.

The UK Data Service will provide a unified point of access to the extensive range of high quality economic and social data, including valuable census data. It is designed to provide seamless access and support to meet the current and future research demands of both academic and non-academic users, and to help them maximise the impact of their work.

“The UK Data Service represents a significant step forward in our strategy,” says ESRC’s Chief Executive, Professor Paul Boyle. “As data are the lifeblood of research, our aim is to consolidate resources in a way that expands both the reach and impact of these vital investments. It will become a cornerstone for UK research; the place to go for high quality data and support.”

“Between our services we have an impressive collection of rich research data,” says Dr Matthew Woollard, director of the Economic and Social Data Service (ESDS) and the UK Data Archive. “We are dedicated to the reuse, sharing and archiving of data because we know the effect it can have on the wider society. Together, we look forward to becoming the UK Data Service so we can continue to build on these excellent data and services to generate even more impact.”

The full press release can be accessed here.

We are pleased to announce that the  Digital Preservation Coalition is to offer its members a preview of the latest DPC Technology Watch Report ‘Intellectual Property Rights for Digital Preservation by Andrew Charlesworth of the University of Bristol. This is the third report in the DPC technology watch series to have been commissioned with Charles Beagrie Ltd as series editors.

‘While a number of legal issues colour contemporary approaches to, and practices of, digital preservation, it is arguable that intellectual property law, represented principally by copyright and its related rights, has been by far the most dominant, and often intractable, influence,’ explained Andrew Charlesworth.

‘It’s essential for those engaging in digital preservation to understand the letter of the law and to be able to identify and implement practical and pragmatic strategies for handling legal risks in the pursuit of preservation objectives. Moreover, those engaging in digital preservation need to advance a coherent and cogent message to rights holders, policymakers and the public with regard to the relationship between intellectual property law and digital preservation. It is in the long-term interests of all stakeholders that modern intellectual property law permits both the implementation of effective and efficient mechanisms of digital preservation.’

Two more reports – on Preservation, Trust and E-Journals, and Digital Forensics for Preservation – are now well advanced and a further batch are now in development.

The managing editor has been further supported by an Editorial Board drawn from DPC members and peer reviewers who have commented on the text prior to release. The Editorial Board comprises William Kilbride (Chair), Neil Beagrie (Series Editor), Janet Delve (University of Portsmouth), Sarah Higgins (Archives and Records Association), Tim Keefe (Trinity College Dublin), Andrew McHugh (University of Glasgow), Dave Thompson (Wellcome Library).

The preview report is now online for DPC members:
• Login or register for the DPC site (DPC Members only)
• Download the preview report  (DPC Members only)

It will be available for general public release in the third quarter of 2012.

We are very pleased to announce a new study and collaboration between Charles Beagrie Ltd and the Centre for Strategic Economic Studies University of Victoria (Prof John Houghton) on the impact of the Archaeology Data Service (ADS) based at the University of York in the UK.

For more than fifteen years the ADS has been working to serve its users, both by acting as a long-term repository for valuable archaeological data and by providing open and free access to this data for research purposes. Its users, both those who deposit data and those who access it, come from all possible sectors of the archaeology discipline.

ADS regularly deal with data and data requests from academic archaeologists, local and national government archaeologists, the commercial sector, the community archaeology sector and, being an open archive, the general public. The ADS’s significance in the archaeological landscape has grown considerably in the last decade or so and with the use of access statistics and user feedback it has generally been easy for the ADS to demonstrate that it offers a valuable service to its users. However, it is a much more challenging proposition to find ways of analysing ADS usage that make a clear statement about the very important issue of how much economic impact that the ADS has on the sector. The new ADS Impact Study funded by JISC is intending to investigate in detail exactly this question and to give a clear indication of what the value of having a free to use and open access resource like the ADS is to the whole archaeological sector.

Engaging the expertise of Neil Beagrie of Charles Beagrie Ltd. and Professor John Houghton of the Centre for Strategic Economic Studies (CSES) , the project will analyse and survey indicators and perceptions of the value of digital collections held by the ADS and how those indicators and perceptions of value can be measured. The CSES and Charles Beagrie Ltd have led the field in conducting value perception and economic impact surveys for digital repositories and they have recently completed a similar exercise with the Economic and Social Data Service (ESDS) in the UK.

A major element of the study will be two forms of stakeholder survey. The first phase will see a selection of users and depositors from all sectors be invited to participate in in-depth interviews, and secondly an online survey will be launched to gauge the levels of use, impacts, and perceptions of value amongst the broadest possible range of ADS users.

Our economic analysis aims to include a range of approaches, starting with the most immediate and direct measures of value that are likely to represent lower bound estimates of the value of ADS data and services and moving outwards to estimates of the wider economic benefits:

We hope this project will not only have immediate benefits for the ADS, its stakeholders and user communities, but will build on previous work to investigate methodologies and good practice in the area of valuation that will be directly applicable to other repositories, in different domains, allowing them to reap the benefits of this work as they seek to analyse their own economic impact. For further information on the ADS Impact study see the Project web site.

The Digital Preservation Coalition and Charles Beagrie Limited are delighted to announce a the continuation of their collaboration to produce 3 more Technology Watch Reports.

‘5 Technology Watch Reports have already been produced – or are in production – and have been enthusiastically received by our members’, said William Kilbride of the DPC. The next three will ensure that the production process continues through 2013 with themes and topics proposed and refined by DPC members to help them with digital preservation.’

The three new reports will be:
– Web Archiving, Maureen Pennock
– Preserving Computer Aided Design, Alex Ball (jointly with DCC)
– Preservation Metadata, Brian Lavoie and Richard Gartner

Two of the reports are completely new, and a third one will allow us to update one of the more popular reports that has become dated since it was first published in 2005. DPC members will have a period of privileged advance access to each report prior to wider public release.

The DPC Technology Watch Report series has been one of the Coalition’s most enduring contributions to the wider digital preservation community. They exist to provide authoritative support and foresight to those engaged with digital preservation or having to tackle digital preservation problems for the first time. These publications support members work forces’, they identify disseminate and discuss best practices and they lower the barriers to participation in digital preservation. Neil Beagrie, Director of Consultancy at Charles Beagrie Ltd, was commissioned to act as principal investigator and managing editor of the Technology Watch series in 2011.

‘Each ‘Technology Watch Report’ analyses a particular topic in digital preservation, evaluating workable solutions, and investigating new tools and techniques appropriate for different contexts,’ explained Neil Beagrie, series editor. ‘The reports are written by leaders-in-the-field and are peer-reviewed prior to publication. The intended audience is worldwide, especially in the UK, Europe, Australia New Zealand, USA, Canada.’

‘We expect that these reports will have a wide readership. The audience includes members and non-members of the coalition; staff of commercial and public agencies; repository managers, librarians and archivists charged with managing electronic resources; senior staff and executives of intellectual property organizations in the private and public sectors; those who teach and train information scientists; as well as policy advisors requiring an advanced introduction to specific issues and researchers developing DP solutions.’

Further publicity on each report in the series will be released over the course. Draft outlines of each reports will be distributed to DPC  members for comment and the whole process will be overseen by an editorial board drawn from the membership.

An interesting development presented at recent US meetings(Association of Research Libraries and Coalition for Networked Information) is the launch of a Digital Preservation Network (DPN) by over 50 major US universities.

It is a very new initiative and you can find current information on the DPN website and a bit more information at the DPN launch team page. The initiative is being catalysed and led by James Hilton Vice-President and Chief Information Officer at the University of Virginia.

The DPN caught my eye for many reasons. One being that in November 2008 with support from JISC, I was part of a digital archiving study group with amongst others Don Walters (Mellon Foundation) and Sandy Payette (Fedora Commons) that presented and debated the subject of digital preservation with US university presidents and Vice-Chancellors from UK universities who were part of the Windsor Group. The meeting was hosted by the University of Virginia.

The meeting had an extremely influential group of attendees and provided sufficient time and the right environment for them to engage seriously with the topics presented. I was surprised by the real level of engagement and recognition of the problem of digital archiving and sense of mission and responsibility that universities should have coming from the University Presidents and V-Cs themselves. It resonated very strongly as an issue with the university leaders present – not an outcome I had necessarily expected.

Unfortunately the follow-up from that meeting was hit by the economic crisis which was a big disappointment given the progress made. However I sense that the development of DPN perhaps flows from that meeting and the work of colleagues on the digital archiving working group eventually may prove fruitful.

The Digital Preservation Coalition, Richard Wright and Charles Beagrie Ltd are delighted to announce the public release of the latest DPC Technology Watch Report ‘Preserving Moving Pictures and Sound’, written by Richard Wright, formerly of the BBC.

‘Moving image and sound content is at great risk’, explained Richard Wright. ‘Surveys have shown that 74 per cent of professional collections are small: 5,000 hours or less. Such collections have a huge challenge if their holdings are to be preserved. About 85 per cent of sound and moving image content is still analogue, and in 2005 almost 100 per cent was still on shelves rather than being in files on mass storage. Surveys have also shown that in universities there is a major problem of material that is scattered, unidentified, undocumented and not under any form of preservation plan. These collection surveys are from Europe and North America because there is no survey of the situation in the UK, in itself a cause for concern.’

‘This report is for anyone with responsibility for collections of sound or moving image content and an interest in preservation of that content.’

‘New content is born digital, analogue audio and video need digitization to survive and film requires digitization for access. Consequently, digital preservation will be relevant over time to all these areas. The report concentrates on digitization, encoding, file formats and wrappers, use of compression, obsolescence and what to do about the particular digital preservation problems of sound and moving images.’

The report discusses issues of moving digital content from carriers (such as CD and DVD, digital videotape, DAT and minidisc) into files. This digital to digital ‘ripping’ of content is an area of digital preservation unique to the audio-visual world, and has unsolved problems of control of errors in the ripping and transfer process. It goes on to consider digital preservation of the content within the files that result from digitization or ripping, and the files that are born digital. While much of this preservation has problems and solutions in common with other content, there is a specific problem of preserving the quality of the digitized signal that is again unique to audio-visual content. Managing quality through cycles of ‘lossy’ encoding, decoding and reformatting is one major digital preservation challenge for audio-visual as are issues of managing embedded metadata.

DPC members have already had a preview. Pip Laurenson of Tate commented ‘This is a terrific report. Thank you so much for commissioning it – it is the best thing I have read on the subject.’

The report has also been subject to extensive review prior before publication. Oya Rieger and colleagues at Cornell University who reviewed the final draft welcomed the report: ‘It is a very thorough report. We realize that it was a challenging process to gather and organize all this information and present it in a succinct narrative. Another virtue of the report is that it incorporates both analog and digital media issues. The final section with conclusions and recommendation is very strong and provides an excellent summary.’

Another reviewer explained why the preview for DPC-members was so timely: ‘We are currently working on a grant proposal focusing on new media art and having access to the preserving moving pictures and sound report was very useful. The report provides a thorough characterization of the current practices, shortcomings, and challenges. Having access to the report has saved us from spending expensive time on conducting a literature review. ‘

DPC Technology Watch Reports identify, delineate, monitor and address topics that have major bearing on ensuring our collected digital memory will be available tomorrow. They provide an advanced introduction in order to support those charged with ensuring a robust digital memory and they are of general interest to a wide and international audience with interests in computing, information management, collections management and technology. The reports are commissioned after consultation with members; they are written by experts; and they are thoroughly scrutinised by peers before being released. The reports are informed, current, concise and balanced and they lower the barriers to participation in digital preservation. The reports are a distinctive and lasting contribution to the dissemination of good practice in digital preservation.

‘Preserving Moving Pictures and Sound’ is the second Technology Watch Report to be published by the DPC in association with Charles Beagrie Ltd. Neil Beagrie, Director of Consultancy at Charles Beagrie Ltd, was commissioned to act as principal investigator and managing editor of the series in 2011. The managing editor has been further supported by an Editorial Board drawn from DPC members and peer reviewers who have commented on the text prior to release. The Editorial Board comprises William Kilbride (Chair), Neil Beagrie (Series Editor), Janet Delve (University of Portsmouth), Sarah Higgins (Archives and records Association), Tim Keefe (Trinity College Dublin), Andrew McHugh (University of Glasgow) and Dave Thompson (Wellcome Library).

The report is online at: http://dx.doi.org/10.7207/twr12-01  (PDF 915KB)