Beagrie.com

The AHRC periodically commissions case studies to investigate the impact and value of AHRC-funded research. Across the series as a whole, impact has been defined in its broadest sense to include, economic, social, and cultural elements. The latest AHRC case study, Safeguarding our heritage for the future, focuses on the impact of data sharing and curation through the Archaeology Data Service.

It cites some of the Jisc-funded “The Value and Impact of the Archaeology Data Service: A study and methods for enhancing sustainability” study by ourselves and John Houghton.

There is the headline research efficiency impact message on page 1 and the relevant detail on page 2 of the case study as follows:

“JISC commissioned research carried out in 2012 found that the ADS has a broad user group which goes well beyond academia: whilst 38% of users are conducting academic research, 19% use ADS for private research;17% for general interest enquiries; 11% are Heritage Management users and 8% are commercial users; 6% use it to support teaching and learning activities; and 1% use it for family history research. The ADS is respected as an invaluable resource, saving users time and therefore money, and providing security for those who use the service to deposit their data. A significant increase in research efficiency was reported by users as a result of using the ADS, worth at least £13 million per annum – five times the costs of operation, data deposit and use. A potential increase in return on investment resulting from the additional use facilitated by ADS may be worth between £2.4 million and £9.7 million over thirty years in net present value from one-year’s investment – a 2-fold to 8-fold return on investment.”

The pdf version of the Safeguarding our heritage for the future case study  is available for download on the AHRC website.

AHRC Case Study

Last month I attended an excellent Academic Publishing in Europe 2014 conference in Berlin on the theme of “Redefining the Scientific Record: The Future of the Article, Big Data & Metrics” . Also notable was the inclusion for the first time at the conference, of a full session devoted to preservation of e-journals and the scientific record.

The preservation session on Permanent Access to the Record of Science was organised by Marcel Ras (Netherlands Coalition for Digital Preservation – NCDD) and the KB (the Dutch National Library). The Powerpoint presentations are now available with a blog post on the conference on the NCDD site. The presentations are overviews of the state of the art  and present the problem from the perspectives of different stakeholders:

The problem.  An introduction to Preservation, Trust and Continuing Access for e-Journals – from me – expanding on my recent DPC Tech Watch devoted to e-Journals

Ensuring access to the record of science: driving changes in the role of research libraries  – from Susan Reilly (LIBER)

The Publisher. Remaining Future-proof: Publishers and Digital Preservation – from Eefke Smit (STM Publishers)

The Archivist. Ensuring the Scholarly Record is kept safe: measured Progress with Serials – from Peter Burnhill (EDINA)

If you are interested in the other themes of the conference such as data publishing (I was!), a selection of the discussions were also video recorded and are available online here.

A Nature news item “Scientists losing data at a rapid rate“ reports and provides a valuable commentary on, a research article by Timothy Vines et al published today in Current Biology that looked at the availability of research data for Ecology articles over 2-22 years.

The researchers had requested data sets from a relatively homogenous set of 516 Ecology articles published between 2 and 22 years ago, and found that availability of the underlying data was strongly affected by article age. For papers where the authors gave the status of their data, the odds of a data set being extant fell by 17% per year over that period. Availability dropped to as little as 20% for research data from the early 1990s. In addition, the odds that they could find a working e-mail address for the first, last, or corresponding author fell by 7% per year.

Although solely focussed on Ecology, this is an interesting addition to a growing body of research on data sharing and availability, and to the case for archiving initiatives such as Dryad, Figshare, and institutional data repositories when no international or disciplinary archive exists.

My colleague John Houghton gave an excellent 20 minute Presentation at the October 2013 Open Access Research Conference in Brisbane on recent studies conducted by Charles Beagrie Ltd and Victoria University covering the value and impact of sharing research data via three UK research data centres. I highly recommend it as an accessible, concise, overview. The video of the presentation is now available at https://vimeo.com/82043019

It summarises recent studies exploring the impact and value of the Economic and Social Data Service (ESDS), the Archaeology Data Service (ADS), and the British Atmospheric Data Centre (BADC). The aim of the studies was to both assess the costs, benefits, value and impacts of the data centres, and to test a range of economic methods in order to ascertain which methods might work across three very different fields, with very different data production and use practices, and very different user communities. The presentation focuses on the methods used and lessons learned, as well as the headline findings.

As blogged previously the three reports for the ESDS, ADS, and BADC are all available now as individual open-access publications. A short synthesis of all three reports is being published by Jisc in the New Year.

Neil Beagrie of Charles Beagrie Ltd and Professor John Houghton of the Centre for Strategic Economic Studies (CSES) are pleased to announce the release of their final report from the Jisc study which examined the value and impact of the Archaeology Data Service (ADS). The aim of this study is to explore and attempt to measure the value and impact of the ADS. A range of economic approaches were used to analyses data gathered through online surveys, and user and depositor statistics, to supplement and extend other non-economic perceptions of value.

The study reveals the benefits of integrating qualitative approaches exploring user perceptions and non-economic dimensions of value with quantitative economic approaches to measuring the value and impacts of research data services. Such a mix of methods is important in capturing and presenting the full range and dimensions of value. The approaches are complementary and mutually reinforcing, with stakeholder perceptions matching the economic findings. For example, both qualitative and quantitative analysis highlights the important contribution of ADS data and services to research efficiency.

The study has changed stakeholder perceptions, increasing recognition of the value of the ADS and digital archiving and data sharing generally. Most stakeholders already valued ADS highly, but felt the study had extended their understanding of the scope of that value, and the degree of its value to other stakeholders. They were positive about seeing value expressed in economic terms, as this was something they had not previously considered or seen presented,

The report is available for download as a PDF file at: http://repository.jisc.ac.uk/5509/1/ADSReport_final.pdf

This report forms part of a series of independent studies produced by the authors on the value and impact of three UK research data centres. The other data centres already reported upon are the Economic and Social Research Data Service (ESDS), and the British Atmospheric Data Centre (BADC). To summarise and facilitate dissemination of the key findings from all three data centre studies a separate synthesis is currently being prepared by Jisc.

Charles Beagrie Ltd and the Digital Preservation Coalition are pleased to announce the public release of Preservation, Trust and Continuing Access for e-Journals, the latest in the Digital Preservation Coalition’s (DPC) series of Technology Watch Reports. Written by Neil Beagrie, and published in association with Charles Beagrie Ltd., this report and associated press release were published yesterday at the DPC’s much anticipated ‘e-Journals Summit’ at the RIBA headquarters at 66 Portland Place, London.

Endorsed by LIBER (The Association for European Research Libraries), the report discusses the critical issues of preservation, trust and continuing access for e-journals, particularly in light of the dynamic and interdependent resources they have become, as well as the ever-growing trend towards open-access.

With extensive experience in this field and a particular reputation for his policy advice on e-journals and the cost/benefits of digital preservation for Jisc and others, Neil tells us that these “issues have become increasingly important for research libraries as published journals and articles have shifted from print to electronic formats; and as traditional publishing business models and relationships have undergone major transformations as a result of that shift.”

With these issues in mind, the report provides a comprehensive review of the latest developments in e-journal preservation, outlining key considerations and an application of best practice standards. The report introduces a range of service providers that now support continuing access and/or preservation of e-journals and how research libraries have increasingly come to trust them.

Neil explains that “for trust to be established between libraries and digital preservation services there needs to be clear agreements for long-term archiving, and clear procedures and mechanisms for those agreements to be implemented and validated when necessary across all elements of the supply chain.”

Matthew Herring from the University of York is sure that the report provides answers to these requirements, calling it “a clear, comprehensive and informative introduction to the area… if I was trying to grapple for the first time with long-term e-journal access, I would find this a very helpful guide.”

Oya Y. Rieger, Associate University Librarian for Digital Scholarship and Preservation Services at Cornell University Library agrees, adding that “due to inherent risks associated with digital media, the initial focus of earlier preservation studies was much more on technology issues. Neil’s comprehensive analysis illuminates the complex and integrated nature of technical, policy, business, and trust issues underlying e-journal preservation.”

While ‘Preservation, Trust and Continuing Access for e-Journals’ predominantly addresses issues felt most keenly by libraries, scholars and publishers, the report also includes generic lessons on outsourcing and trust learnt in this field of interest to the wider digital preservation community. It is not solely focussed on technology, and covers relevant legal, economic and service issues.

You can download a PDF copy and read the report at ‘Preservation, Trust and Continuing Access for e-Journals’ .

Jisc in partnership with the Natural Environment Research Council (NERC) have commissioned work by Neil Beagrie of Charles Beagrie Ltd and Professor John Houghton of Victoria University to examine the value and impact of the British Atmospheric Data Centre (BADC).  We are pleased to announce publication today of the study report.

The key findings

The study shows the benefits of integrating qualitative approaches exploring user perceptions and non-economic dimensions of value with quantitative economic approaches to measuring the value and impacts of research data services.

The measurable economic benefits of BADC substantially exceed its operational costs. A very significant increase in research efficiency was reported by users as a result of their using BADC data and services, estimated to be worth at least £10 million per annum.

The value of the increase in return on investment in data  resulting from the additional use facilitated by the BADC was estimated to be between £11 million and £34 million over thirty years (net present value) from one-year’s investment – effectively, a 4-fold to 12-fold return on investment in the BADC service.

The qualitative analysis also shows strong support for the BADC, with many users and depositors aware of the value of the services for them personally and for the wider user community.

For example, the user survey showed that 81% of the academic users who responded reported that BADC was very or extremely important for their academic research, and 53% of respondents reported that it would have a major or severe impact on their work if they could not access BADC data and services.

Surveyed depositors cited having the data preserved for the long-term and its dissemination being targeted to the academic community, as the most beneficial aspects of depositing data with the BADC, both rated as a high or very high benefit by around 76% of respondents.

The study report

The study report is available for download as a PDF file at: http://www.jisc.ac.uk/whatwedo/programmes/di_directions/strategicdirections/badc.aspx

The British Atmospheric Data Centre (BADC)
The BADC, based at the STFC Rutherford Appleton Laboratory in the UK, is the Natural Environment Research Council’s (NERC) Designated Data Centre for the Atmospheric Sciences. Its role is to assist UK atmospheric researchers to locate, access, and interpret atmospheric data and to ensure the long-term integrity of atmospheric data produced by NERC projects. There is also considerable interest from the international research community in BADC data holdings.

The Research360 project is pleased to announce the public release of its guidance document Research Data Management and REF2014 prepared by staff at the University of Bath and Charles Beagrie Ltd. It is being disseminated and shared with the research community in Bath and other universities.

Many universities are still in the process of enhancing and formalising strategies for research data management at this time, so this paper may contribute to planning for future assessment exercises beyond REF2014, as well as business cases for further development of strategies and procedures for research data in research-intensive universities.

With the results from the REF determining institutional quality-related (QR) funding allocations (just over £1.3 billion in 2012/13), the research element of QR funding is one of the key funding streams for research in UK universities. Support for future assessment exercises is therefore a potential element in any business case for research data management.

The Research Data Management and REF2014 document can be downloaded in Word or PDF formats from: http://opus.bath.ac.uk/35518/.

The REF guidance document follows on from the previous release of the summary stakeholder benefits analysis (based on the KRDS Benefits Framework) from the Research Data Management business case for the University of Bath. The stakeholder benefits analysis is also still available separately to download in PDF format from http://opus.bath.ac.uk/32509.

The Research360 project is funded by Jisc and is developing the technical and human infrastructure for research data management at the University of Bath, as an exemplar research-intensive university.

We are pleased to announce that the JISC-funded Research360 Project has released the summary stakeholder benefits analysis (based on the KRDS Benefits Framework) from the Research Data Management business case for the University of Bath. The 4 page document is available to download in PDF format from opus.bath.ac.uk/32509

The benefits summary covers the following groups:

University Community

• Academic Staff and Researchers
• Students
• Professional Services
• Institution

External Partners

• Industry and Commerce
• Public and Voluntary Sectors
• Government
• Society

Industry and private sector partnerships alongside public sector and voluntary sector partnerships are key elements of many university research programmes. Frequently partners sharing their practice, results data and laboratory methodologies can lead to vital knowledge transfer activities, improved services and products, creation of spin-out companies and further investment in the Higher Education sector.

As part of the Research360 project at the University of Bath, we are examining the data management implications, challenges and benefits associated with Faculty-Industry and Faculty-Not-for-Profit research collaborations. As part of this work, we have developed the summary list of stakeholder benefits that can arise from research data management in these collaborations. This list is now being shared with other universities and their research partners. We hope the generic list can be used as a brain-storming tool and assist in articulating benefits for selected stakeholders from research data management. Users can sharpen these short generic expressions of benefits into more focused value propositions for specific stakeholder audiences as required. Those interested in applying KRDS benefits analysis for stakeholders in research data preservation and curation as well as research data management will also find it of interest.

The Research360 project is funded by JISC and the stakeholder analysis has been developed by Charles Beagrie Ltd and UKOLN at the University of Bath.

We are pleased to announce a new study and collaboration between the Science and Technology Facilities Council (STFC), Charles Beagrie Ltd (Neil Beagrie), and the Centre for Strategic Economic Studies Victoria University (Prof John Houghton) on the value and impact of the British Atmospheric Data Centre (BADC).

The BADC, based at the STFC Rutherford Appleton Laboratory in the UK, is the Natural Environment Research Council’s (NERC) Designated Data Centre for the Atmospheric Sciences. Its role is to assist UK atmospheric researchers to locate, access, and interpret atmospheric data and to ensure the long-term integrity of atmospheric data produced by NERC projects. Since its establishment, the BADC has become the de facto point of contact for UK researchers needing access to the meteorological products of both the Met Office and the European Centre for Medium Range Weather Forecasting (ECMWF). There is also considerable interest from the international research community in BADC data holdings.

The BADC’s significance has grown considerably in the last decade or so and with the use of access statistics and user feedback it has generally been easy for the BADC to demonstrate that it offers a valuable service to its users. However, it is a much more challenging proposition to find ways of analysing BADC usage that make a clear statement about the very important issue of how much economic impact that the BADC has on the sector. The new BADC study funded by JISC and the Natural Environment Research Council (NERC) is intending to investigate in detail exactly this question and to give a clear indication of what the value is of having a free to use and open access data resource like the BADC.

Engaging the expertise of Neil Beagrie of Charles Beagrie Ltd. and Professor John Houghton of the CSES, the project will analyse and survey indicators and perceptions of the value of digital collections held by the BADC and how those indicators and perceptions of value can be measured. The CSES and Charles Beagrie Ltd have led the field in conducting value perception and economic impact surveys for digital repositories and they have recently completed a similar exercise with the Economic and Social Data Service (ESDS) in the UK. The report from this work, The Economic Impact Evaluation of the Economic and Social Data Service, is now available from the Economic and Social Science Research Council (ESRC). Another study on the impact of the Archaeology Data Service is also underway in parallel with that for BADC.

A major element of the BADC study will be two forms of stakeholder survey. The first phase will see a selection of users and depositors from all sectors be invited to participate in in-depth interviews, and secondly an online survey will be launched to gauge the levels of use, impacts, and perceptions of value amongst the broadest possible range of BADC users.

Our economic analysis aims to include a range of approaches, starting with the most immediate and direct measures of value that are likely to represent lower bound estimates of the value of BADC data and services and moving outwards to estimates of the wider economic benefits.

We hope this project will not only have immediate benefits for the BADC, its stakeholders and user communities, but will build on previous work to investigate methodologies and good practice in the area of valuation that will be directly applicable to other repositories, in different domains, allowing them to reap the benefits of this work as they seek to analyse their own economic impact.

For further information on the project see the BADC Value and Impact study project web page.