policies – KB Research http://blog.kbresearch.nl Research at the National Library of the Netherlands Fri, 24 Aug 2018 13:17:55 +0000 en-US hourly 1 https://wordpress.org/?v=4.4.2 Policy-based assessment of EPUB with Epubcheck http://blog.kbresearch.nl/2015/03/13/policy-based-assessment-of-epub-with-epubcheck/ http://blog.kbresearch.nl/2015/03/13/policy-based-assessment-of-epub-with-epubcheck/#comments Fri, 13 Mar 2015 15:00:45 +0000 https://researchkb.wordpress.com/?p=1129

Back in 2012 the KB conducted a first investigation of the suitability of the EPUB format for long-term preservation. The KB will soon start receiving publications in this format, and in anticipation of this, our Collection Care department has formulated a policy on the minimum requirements an EPUB must meet to ensure long-term accessibility. The policy largely follows the recommendations from the 2012 report. This blog explores to what extent it is possible to automatically assess the EPUBs that we receive against our policy using a combination of the Epubcheck tool and Schematron rules.

KB EPUB policy

The KB’s policy on EPUB is made up of the following objectives:

  1. File must be valid EPUB (either version 2 or 3)

    Rationale: this minimises the risk of interoperability problems.

  2. File may not contain DRM or encryption

    Rationale: this minimises the risk that files become inaccessible. An edge case here is font obfuscation, which mangles some leading bytes in embedded fonts. This technology is merely meant as a stumbling block to discourage third parties from re-using embedded fonts, and it doesn pose a serious threat to long-term accessibility.

  3. File may not contain foreign resources

    Rationale: the Core Media Types define a set of file formats that must be supported by all conforming EPUB readers. Foreign resources are resources that are not part of this set, and the KB’s policy is to not accept them. This requirement minimises the risk of accepting files that contain content that may not be rendered correctly by some readers.

  4. File may not contain DTBook content

    Rationale: EPUB 2 offered the option to use the DTBook (DAISY Digital Talking Book) format as an alternative to XHTML 1.1. Support for DTBook was dropped in EPUB 3. Support is already limited with current EPUB reading software: both the popular Calibre and Readium viewers are unable to process EPUBS with DTBook content (although my Sony Reader device handles them without problems). This does not bode well for the future.

Automated conformance checking

To check if an EPUB conforms to the above policy, we need to:

  1. test for validity against the format’s standard;
  2. extract technical information that tells us something about DRM and file resources inside the EPUB;
  3. assess the results of steps 1 and 2 against our policy.

The Epubcheck validator is the obvious candidate for steps 1 and 2. Since Epubcheck is capable of reporting its results in XML format, we can use Schematron rules for the final assessment step. The general approach is similar to earlier work on the JP2 and PDF formats, as well as the British Library’s Flint tool.

Test data

For testing, we first need a corpus of files that are known violate one or more objectives of our policy. As this turned out to be more difficult than expected, I created a small set of test files. Some of the files in this dataset were created from scratch; others were taken directly or adapted from existing openly licensed datasets. The following table lists the main characteristics of the files in the dataset1:

Test Epub version Description
Minimal 2 Basic file with one text resource and one image
Encryption 2 Fake encrypted file that includes encryption.xml resource in META-INF, indicating that main text resource is encrypted2
Font obfuscation 3 Includes fonts that are obfuscated (which results in hasEncryption in epubcheck). Taken from EPUB 3 Sample Documents (wasteland with OTF fonts, obfuscated).
Foreign resource without fallback 2 Includes JP2 image, which is a format that is not on the list of Core Media Types
Foreign resource with fallback 1 2 Includes JP2 image, which is a format that is not on the list of Core Media Types; fallback defined in manifest, identifier in content document
Foreign resource with fallback 2 2 Includes JP2 image, which is a format that is not on the list of Core Media Types; fallback defined in manifest, no identifier in content document
DTBook 2 Includes Digital Talking Book content. Adapted from threepress, published under BSD 3 license.

Apart from the above files, the dataset also includes:

All files are openly licensed, and by adapting the existing tests it is pretty straightforward to add new ones.

Analysis with Epubcheck

The first question that we need to answer here is whether Epubcheck’s output is sufficiently detailed for our needs. So, as a first step I analysed all files in the dataset with Epubcheck. I did this using both Epubcheck 3.0.1 (the current stable version) and the alpha 11 release of Epubcheck 4.0.0. The full output can be found here. In the following sections I will address each of the objectives of the KB policy.

Encryption objective

For the ‘fake’ encrypted file Epubcheck’s output contains a hasEncryption property. Moreover, the messages element in the output contains an error message that refers to the encrypted resource. In Epubcheck 3 this is:

ERROR: : OPS/XHTML file OEBPS/Text/pdfMigration.html cannot be decrypted

A double-check with a ‘real’ encrypted EPUB (which is proprietary and could not be included in the dataset) confirmed that each encrypted resource produces an error message of the general form:

ERROR: : $fileType file $fileName cannot be decrypted

Here, $fileType and $fileName refer to the file type and name of the affected resource. The ‘fake’ encrypted file also resulted in some additional error messages about undefined fragment identifiers, but these look like secondary errors that result from Epubcheck ’s inability to decrypt the encrypted resource.

The behaviour of Epubcheck 4 is similar, although the error message is slightly different:

RSC-004, ERROR, [File 'OEBPS/Text/pdfMigration.html' could not be decrypted.],epub20_minimal_encryption.epub

The file with the obfuscated fonts also results in a hasEncryption entry in Epubcheck’s output. Epubcheck (both versions 3 and 4) doesn’t provide any direct clue that the encryption in this file is limited to some obfuscated fonts. For our policy-based assessment we can therefore ignore the hasEncryption entry, and simply check for the presence of “cannot be decrypted” error messages (see above).

DTBook objective

Epubcheck’s output does not give any explicit clue to the presence of DTBook content. However, Epubcheck 3 does report a read error on the corresponding file resource:

ERROR: : I/O error reading OEBPS/hauy-2005-1.xml: Stream closed

Epubcheck 4 does not report this error. A check of the DTBook resource confirmed that it is valid against version 2 of the DTBook Document Type Definition (I checked this using both JHOVE and an online XML validator). This suggests that Epubcheck 3 doesn’t properly recognise (cannot parse?) DTBook content, and incorrectly flags EPUBs that hold this as “Not well-formed”. The behaviour of Epubcheck 4 is correct (see also this issue report).

Foreign resources objective

The test dataset contains 3 files with foreign resources (resources that are not on the list of Core Media Types). In the first one I simply replaced a PNG image by a JP2 (and updated the manifest and the reference in the text accordingly). This results in the following validation error (Epubcheck 3):

ERROR: /OEBPS/Text/pdfMigration.html(20): non-standard image resource 'OEBPS/Images/pdfVenn.jp2' of type 'image/jp2'

And in Epubcheck 4;

MED-003, ERROR, [Non-standard image resource of type image/jp2 found.], OEBPS/Text/pdfMigration.html (20-63) 

This error also causes the validation to fail. The EPUB specification allows the use of foreign resources, but only if they have a Core Media fallback. I created two additional test files that use the original PNG image as a fallback3; I then updated the manifest of these files accordingly. Epubcheck validates both files as “Well-formed”, but gives no information whatsoever on the presence of foreign resources. Somewhat alarmingly, both Calibre and Readium failed to read either of these files correctly: the (fall back) image was not shown in both cases. As it turns out, very few EPUB readers support manifest fallbacks, even though this feature has been part of the EPUB specification for a long time (at least since EPUB 2).

Translating the policy to Schematron rules

If Epubcheck were able to address all apects of the KB’s policy, it would be possible to translate each of its objectives into a Schematron rule. As Epubcheck doesn’t yet provide the required information on foreign resources and DTBook content, for now we can only do this for the validity and encryption objectives. The Schematron rule for validity is:

<s:pattern name="wellFormed">
  <s:rule context="/jh:jhove/jh:repInfo">
    <s:assert test="(jh:status = 'Well-formed')">Not well-formed epub</s:assert>
  </s:rule>
</s:pattern>

For the encryption objective we have this:

<!-- This rule rules out encrypted content, but permits font obfuscation-->  
<s:pattern name="encryptedResources">
  <s:rule context="/jh:jhove/jh:repInfo/jh:messages">
    <s:assert test="count(jh:message[contains(.,'cannot be decrypted')]) = 0">Contains encrypted resources</s:assert>
  </s:rule>
</s:pattern>

Alternatively, we could have created a rule that uses the hasEncryption property here, but that would cause any files with obfuscated fonts to fail the assessment. The corresponding schema (adapted from the BL’s Flint tool) can be found here. It is designed to work with Epubcheck 3 only 4.

Demo

I created a simple EPUB policy-based validation demo. It is a shell script that validates all EPUB files in a user-defined directory with Epubcheck, and subsequently assesses Epubcheck’s output against a user-defined schema. Note that the purpose of the script is just to demonstrate the general procedure; it is not recommended for operational use.

Possible Epubcheck enhancements

The above tests demonstrate that currently Epubcheck is able to cover two aspects of the KB’s policy on EPUB: validity and encryption. However, its output doesn’t provide the information we need on the presence of foreign resources and DTBook content. It would be useful if Epubcheck could be extended with an option that reports all resources in an EPUB with their corresponding media types. This information can be extracted from the manifest element of an EPUB’s Package Document. For a file with both DTBook content and a foreign resource (a JP2 file) this looks something like this:

<manifest>
    <item href="toc.ncx" id="ncx" media-type="application/x-dtbncx+xml" />
    <item href="Images/pdfVenn.jp2" id="pdfVennJP2" media-type="image/jp2" fallback="pdfVennPNG" />
    <item href="Images/pdfVenn.png" id="pdfVennPNG" media-type="image/png" />
    <item href="hauy-2005-1.xml" id="opf3" media-type="application/x-dtbook+xml" />
</manifest>

Some simple Schematron rules on the media-type attribute would make it possible to filter this for the presence of DTBook content (where media-type is application/x-dtbook+xml) or foreign resources (which have a media-type value that is not on the Core Media Types list). Another solution would be to add properties like hasDTBook and hasForeignResources to Epubcheck’s output. This solution is less generic, but possibly more user-friendly.

Finally, the presence of DTBook resources 5 incorrectly causes the validation to fail in Epubcheck 3; this has been fixed in Epubcheck 4.


  1. These files are all released under the Creative Commons 3.0 BY-SA license, unless stated otherwise.

  2. The ‘encryption’ in this file is actually fake: I merely replace the original text resource with a base64 encoded representation of that file.

  3. They only differ in the way the JP2 image is referenced in the text, as the EPUB specification is not completely clear on this.

  4. Doesn’t yet work with Epubcheck 4 because it uses slightly different output messages (could be easily adapted).

  5. These are, by the way, pretty rare.

]]>
http://blog.kbresearch.nl/2015/03/13/policy-based-assessment-of-epub-with-epubcheck/feed/ 3
Crystal clear digital preservation: a management issue http://blog.kbresearch.nl/2015/02/01/crystal-clear-digital-preservation-a-management-issue/ http://blog.kbresearch.nl/2015/02/01/crystal-clear-digital-preservation-a-management-issue/#respond Sun, 01 Feb 2015 20:51:31 +0000 https://researchkb.wordpress.com/?p=1109 Author: Barbara Sierman
Originally posted on:
http://digitalpreservation.nl/seeds/crystal-clear-digital-preservation-a-management-issue/

Digital Preservation of Libraries.final.final.inddRaising awareness for digital preservation was a frequently used phrase when I started in this field ten years ago (never regretted it, hurray!). We preservationists have made progress. But the story is still not explaining itself. So I like reading how others persuade and convince people. Recently I found a book that really does the job. In crystal clear language, without beating about the bush and based on extensive up to date (until 2014) literature, digital preservation is explained and almost every aspect of it is touched upon. Edward M. Corrado and Heather Lea Moulaison have done a great job with their Digital Preservation for Libraries, Archives and Museums , Rowman and Littlefield, 2014. ISBN 978-0-8108-8712-1 (pbk.) — ISBN 978-0-8108-8713-8 (ebook).

In fact, I should start this blog post with “Dear manager, I have found a book that tells you all you need to know about digital preservation. Spare some time and read the chapter that is dedicated to you (part II) , the sooner the better” [preservationist, please forward this to your manager, they might even read the rest of the book!]

The book starts by explaining what digital preservation is not ( like “backup and recovery”, access, “an afterthought”). Followed almost immediately by the (positively phrased) starting point, that guides the whole book:

“ensuring ongoing access to digital content over time requires careful reflection and planning. In terms of technology, digital preservation is possible today. It might be difficult and require extensive, institution-wide planning, but digital preservation is an achievable goal given the proper resources. In short, digital preservation is in many ways primarily a management issue”.

The red line/ metaphor in the book is the authors “Digital Preservation Triad”. The triad is a new variety of the Three legged stool of Nancy McGovern and is symbolized by a Celtic knot. The knot is used in order to better symbolize the interrelated activities.

triad

These activities are divided into :

  • Management-related activities,
  • Technological activities and
  • Content-centred activities.

Each set of activities is further explained in a dedicated chapter. The chapter about Management activities immediately starts to explain the basics of the OAIS model. Clearly showing that this is the essence of digital preservation. Knowledge of OAIS should be present on management level of an organisation. Only then management can deal properly with aspects like human resources (skills and training), and sustainable digital preservation (costs etc).

The Technology part is more concerned with metadata and file formats and the technical infrastructure or repository, which is closely related to mechanisms of trust (audit and certification).

The last part of the book discusses aspects related to the Content, like collection development.

The text is based on a large literature list in which many recently published conference papers, (EU) project results and reports are used. The authors are well informed about what is going on and do not restrict themselves to the US.

What I liked in this book is the very practical approach and the unvarnished description of digital preservation (‘not easy but doable’). The authors stress that preservationists should convince over and over again management “that digital preservation is important to the overall mission of the organization”, and not just “an experimental technology project” and “communicate the multiple ways in which digital preservation brings value to the organization.”

One of the barriers in this process, at least in my experience, it that people often try to connect their experience in analogue preservation with that of digital preservation. Sometimes this leads to monstrous analogies. This book does not try to map the two worlds, but clearly states:

“The digital item created and made accessible as part of a digital preservation system is fundamentally different from an analogue item. Period.”

Unavoidably some recent developments are missing, like the Cost model work that was done in the 4C project and the work on Preservation Planning and Policies in SCAPE.

But if you still need to convince your management, point them to this book – also available as an epub!

]]>
http://blog.kbresearch.nl/2015/02/01/crystal-clear-digital-preservation-a-management-issue/feed/ 0
“Materials contain the seeds of their own destruction”. A preservation handbook. http://blog.kbresearch.nl/2014/09/22/materials-contain-the-seeds-of-their-own-destruction-a-preservation-handbook/ http://blog.kbresearch.nl/2014/09/22/materials-contain-the-seeds-of-their-own-destruction-a-preservation-handbook/#respond Mon, 22 Sep 2014 07:00:10 +0000 http://researchkb.wordpress.com/?p=1015 Author: Barbara Sierman
Originally posted on: http://digitalpreservation.nl/seeds/materials-contain-the-seeds-of-their-own-destruction-a-preservation-handbook/

harvey-204x300Regularly I have discussions whether digital material and analogue material can be treated the same way or whether the digital aspect requires special treatments, sometimes even resulting in different working processes, staffing and policies. Quite too often this discussion takes place with participants that are either representatives of the digital or of the analogue view. The polite way of trying to understand each other by finding analogies often lead to simplified views and unsatisfying outcomes and nobody gets the wiser. Therefore I was triggered when a new digital preservation handbook exactly raised this issue by stating “This book is based on the philosophy that there are preservation principles that apply to all kinds of materials, whether digital or not.” For a preservation handbook this is a realistic perspective, as organisations have both kinds of materials. The authors present this book as the first example of ” the essential tools and principles of a preservation management programme in the 21st century – one that addresses the realities of diverse collections and materials and embraces the challenges of working with both analogue and digital collections.”

This being stated, the authors start addressing the different issues related to digital versus analogue and refer to the fact that digitization in the past led to destruction of the related physical objects by assuming that “the information” was saved in the new digital object, a debatable point of view nowadays (see Nicholson Baker’s Double Fold. Libraries and the assault on paper. 2001) . They come with a set of shared preservation principles, for both analogue and digital material.

harvey-21

Four principles describe the context and aims of preservation, amongst which the needs of the user is mentioned (a point of view we also see in the OAIS model) as well as “Preservation is the responsibility of all, from the creators of objects to the users of objects“. A set of 8 general principles focus on “collaboration”, “advocacy, “active, managed care” and the preference for actions “that address large quantities of material over actions that focus on individual objects” [ although this is highly dependent on the value of these objects I would say] . The following principle describes the key of preservation: “Understanding the structure of material is the key to understanding what preservation actions to take, as materials contain the seeds of their own destruction (inherent vice)”.

This set of Preservation principles and practices is the red line for the rest of the book, which contains a wealth of information. I can recommend this book to both the digital and the analogue preservationists, as it will contribute to mutual understanding so desperately needed! And don’t complain about the price (90 dollars) : this book might be expensive, but a one day course is more expensive and almost all the rest you want to know about digital preservation is freely available on the internet!

The preservation management handbook: a 21st-century guide for libraries, archives and museums. [Edited by] Ross Harvey and Martha R. Mahard. Rowman and Littlefield, 2014. ISBN 978-0-7591-2315-1 (also available as e-book)

]]>
http://blog.kbresearch.nl/2014/09/22/materials-contain-the-seeds-of-their-own-destruction-a-preservation-handbook/feed/ 0
National Library of the Netherlands participates in Digitisation Days, Madrid, 19-20 May http://blog.kbresearch.nl/2014/06/10/national-library-of-the-netherlands-participates-in-digitisation-days-madrid-19-20-may/ http://blog.kbresearch.nl/2014/06/10/national-library-of-the-netherlands-participates-in-digitisation-days-madrid-19-20-may/#comments Tue, 10 Jun 2014 07:30:38 +0000 http://researchkb.wordpress.com/?p=975 On 19 and 20 May, the National Library of the Netherlands (KB) visited the Digitisation Days which were held at the Biblioteca Nacional in Madrid. The conference was supported by the European Commission, and organised by the Support Action Centre of Competence in Digitisation (Succeed) project  and the IMPACT Centre of Competence (IMPACT CoC) with the cooperation of Biblioteca Nacional de España.

For the National Library, being a collection holder, the Succeed awards ceremony was one of the highlights of the conference, because it showed the application of technology to actual collections. The Succeed awards aim to recognise successful digitisation programmes in the field of historical texts, especially those using the latest technology.

Two prizes went to the Hill Museum and Manuscript Library and the Centre d’Études Supérieures de la Renaissance, while two Commendations of Merit were awarded to the London Metropolitan Archives/ University College London  and to Tecnilógica.

In her role of member of the IMPACT CoC executive board, the KB’s Head of Research, Hildelies Balk, took part in the ceremony and awarded the Commendation of Merit to the London Metropolitan Archives/ University College London for their Great Parchment Book project. You will find a short video about the project here.[youtube=http://www.youtube.com/watch?v=WDD2cVT7PeU]

Moreover, the KB hosted an interesting and fruitful Round table workshop on the future of research and funding in digitisation and the possible roles of Centres of Competence on 20 May. Some 30 librarians and researchers joined this workshop, and discussed the below topics:

  • What research is needed to further the development of the Digital Library?
  • How can Centres of Competence assist your research or development?
  • In digitisation, are we ready to move the focus from quantity to quality?
  • What enrichments, e.g. in Named Entity Recognition, Linked Data services, or crowdsourcing for OCR correction, would be most beneficial for digitisation?
  • What’s your take on Labs and Virtual Research Environments?
  • What would you like to do in these types of research settings?
  • What do you expect to get out of them?

The preliminary outcomes of the workshop show that the main goal for institutions is to give users unrestricted access to data. During the workshop, the participants discussed the many layered aspects of these three topics, i.e. ‘users’, ‘access’, and ‘data’. Moreover, the participants gave their view on the following questions in relation to these topics:

  • What stops us from making progress?
  • What helps us to make progress?
  • And what role could CoCs play in this?

The outcomes of the workshop have been documented and will be used as a starting point for the roadmap to further development of digitisation and the digital library, which will be produced within the Succeed project. This roadmap will serve to support the European Commission in preparing the 2014–2020 Work Programme for Research and Innovation.

 

]]>
http://blog.kbresearch.nl/2014/06/10/national-library-of-the-netherlands-participates-in-digitisation-days-madrid-19-20-may/feed/ 1
Too early for audits? http://blog.kbresearch.nl/2014/05/04/too-early-for-audits/ http://blog.kbresearch.nl/2014/05/04/too-early-for-audits/#respond Sun, 04 May 2014 11:03:56 +0000 http://digitalpreservation.nl/seeds/?p=265 Author: Barbara Sierman
Originally posted on: http://digitalpreservation.nl/seeds/too-early-for-audits/

I never realized that the procedure of getting to an ISO standard could take several years, but this is true for two standards related to audit and certification of trustworthy digital repositories.  Although we have the ISO 16363 standard on Audit and Certification since 2012, official audits cannot take place against this standard until the related standard Requirements for bodies providing Audit and Certification (ISO 16919) is approved, regulating the appointment of auditors. This standard, similar to the ISO 16363 compiled by the PTAB group in which I participate, was already finished a few years ago, but the ISO review procedure, especially when revisions need to be made, takes long. The latest prediction is that this summer (2014) the ISO 16919 will be approved, after which national standardization bodies can train the future (official) auditors.  How many organizations will then apply for an official certification against the ISO standard is not yet clear, but if you’re planning to do so, it might be worthwhile to have a look at the recent report of the European 4C project  Quality and trustworthiness as economic determinants in digital curation.

The 4C project (Collaboration to Clarify the Cost of Curation) is looking at the costs and benefits of digital curation. Trustworthiness is one of the “economic determinants” of the 15 they distinguish. As quality is seen as a precondition for trustworthiness, the 4C project focusses in this report on the costs and benefits of “standards based quality assurance” and looks at the 5 current standards related to audit and certification: DSA, Drambora, DIN 31644 of the German nestor group, TRAC and TDR. The first part of the report gives an overview of the current status of these standards. Woven in this overview are some interesting thoughts about audit and certification. It all starts with the Open Archival Information System (OAIS) Reference Model. The report suggests that the OAIS model is there to help organisations to create processes and workflows (page 18), but I think this does not right to the OAIS model. If one really reads the OAIS standard from cover to cover (and should not we all do that regularly?) one will recognize that the OAIS model expects a repository to do more than designing workflows and processes. Instead, a repository needs to develop a vision on how to do digital preservation and the OAIS model gives directions. But the OAIS model is not a book of recipes and we all are trying to find the best way to translate OAIS into practice. It is this lack of evidence which approach will offer the best preserved digital objects, that made the authors in the report wonder whether an audit that will take place now might lead to a risky outcome (either too much confidence in the repository or too little). They use the phrase “dispositional trust” . “It is the trustor’s belief that it will have a certain goal B in the future and, whenever it will have such a goal and certain conditions obtain, the trustee will perform A and thereby will ensure B.”(p. 22). We expect that our actions will lead to a good result in the future, but this is uncertain as we don’t have an agreed common approach with evidence that this approach will be successful.  This is a good point to keep in mind I think as well as the fact that there are many more standards applicable for digital preservation then only the above mentioned. Security standards, record management standards and standards related to the creation of the digital object, to name just a few.

Based on publicly available audit reports (mainly TRAC and DSA, and test audits on TDR) the report describes the main benefits of audits for organisations as

  • to improve the work processes,
  • to meet a contractual obligation and
  • to provide a publicly understandable statement of quality and reliability (p. 29).

These benefits are rather vague but one could argue that these vague notions might lead to more tangible benefits in the future like more (paying) depositors, more funding, etc. By the way, one of the benefits recognized in the test audits was the process of peer review in itself and the ability for the repository management to discuss the daily practices with knowledgeable people.

The authors also tried to get more information about costs related to audit and certification, but had to admit in the end that currently there is hardly any information about the actual costs of an audit and/or get certified (why they mention on page 23 financial figures of 2 specific audits without any context is unclear to me) and base themselves mainly on information that was collected during the test audits that the APARSEN project performed and the taxonomy of costs that was created. For costs we need to wait for more audits and for repositories that are willing to publish all their costs in relation to this exercise.

Reading between the lines,  one could easily conclude that it is not recommended to perform audits yet. But especially now the DP community is working hard to discover the best way to protect digital material, it is important for any repository to protect their investments and to avoid that current funding organizations (often tax payers) will back off because of costly mistakes. The APARSEN trial audits were performed by experts in the field and the audited organizations (and these experts) found the discussions and recommendations valuable. As standards are evolving and best practices and tools are developed, a regular audit by experts in the field can certainly safeguard organizations to minimize the risk for the material. These expert auditors need to be aware of the current state of digital preservation, the uncertainties, the risks, the lack of tools and the best practices that are there. The audit results  will help the community to understand the issues encountered by the audited organizations, as audit results will be published.

As I noticed while reading a lot of preservation policies for SCAPE, many organisations want to get certified and put this aim in their policies. Publishers want to have their data and publications in trustworthy, certified repositories. But all stakeholders (funders, auditors, repository management) should realise that the outcomes of an audit should be seen in the light of the current state of digital preservation: that of pioneering.

]]>
http://blog.kbresearch.nl/2014/05/04/too-early-for-audits/feed/ 0
Sustainability is more than saving the bits http://blog.kbresearch.nl/2013/02/20/sustainability-is-more-then-saving-the-bits/ http://blog.kbresearch.nl/2013/02/20/sustainability-is-more-then-saving-the-bits/#respond Wed, 20 Feb 2013 09:28:34 +0000 http://researchkb.wordpress.com/?p=54 Author: Barbara Sierman
Originally posted on: http://digitalpreservation.nl/seeds/uncategorized/sustainability-is-more-then-saving-the-bits/

Sustaining-our-digital-future-FINAL-31

The subject of the JISC/SCA report Sustaining our digital Future. Institutional strategies for digital content. By Nancy L. Maron, Jason Yun and Sarah Pickle (2013),  is the sustainability of digitised collections in general, illustrated with experiences of three different organisations: University College London, The Imperial War Museum and the National Library of Wales. I was especially interested by the fact that the report mentions digital preservation, but not as a goal in itself (“saving the bits”). Instead, the authors broaden the scope of digital preservation with activities that are beyond bit preservation or even beyond “functional preservation”.

Nowadays a lot of digitisation projects are undertaken and interesting material comes to life for a large audience, often with a fancy website, a press release, a blog (and a big investment)  and attracts immediately  interested public. But the problematic phase starts when the project is finished. In organizations like universities, with a variety of digitisation projects, lack of central coordination of these projects could cause “disappearance” of project results, simple because hardly anyone knew about it. We all know these stories, and this report describes the ways these 3 organizations try to avoid that risk.

Internal coordination seems to be a key factor in this process. One organisation integrated more than a hundred databases in a central catalogue, another draw together several teaching collections. Both efforts resulted in visibility of the collections. But this is not enough to achieve permanent (long term) access.  The data will be stored safely, but who is taking care of all the related products, that support the visibility of the data? In other (digital preservation jargon) words, who is monitoring the Designated Community and their changing environment?

The report describes interesting activities.  Take for example this one: the intended public need to be reminded constantly of the existence of the digitized material by promotion actions, otherwise the collections will not be used at all. Who is planning this activity as part of digital preservation? That the changing environment needs to be updated sounds familiar. But there is more reason to do this apart from technical reasons. Websites need to be redesigned to be attractive, to adapt to changing user experiences. And who is monitoring whether there might be a new group of interested  visitors?

Or, as Lyn Lewis Dafgis of the National Library of Wales said, there is an assumption that

once digitised, the content is sustainable just by virtue of living in the digital asset management system and by living in the central catalogue.

And this needs to change.

Not seldom digital preservation is seen as something that deals with access to the digital collections somewhere in the future. Permanent access, which is the goal of digital preservation, is often seen as solved by “bit preservation” and if you do a really good job “functional preservation”. This report illustrates with some good examples what more needs to be done and is coloring the not always well understood OAIS phrase “monitoring the Designated Community”.

]]>
http://blog.kbresearch.nl/2013/02/20/sustainability-is-more-then-saving-the-bits/feed/ 0
BVIM and digital preservation policies http://blog.kbresearch.nl/2013/01/14/bvim-and-digital-preservation-policies/ http://blog.kbresearch.nl/2013/01/14/bvim-and-digital-preservation-policies/#respond Mon, 14 Jan 2013 15:49:22 +0000 http://researchkb.wordpress.com/?p=15 Author: Barbara Sierman
Originally posted on: http://digitalpreservation.nl/seeds/policies/bvim-and-digital-preservation-policies 

tn_DSCF6477

Toy clock Digital 350 computer

Organizations must evaluate their activities and show the relevancy of them to their funders. It  is no exception that organizations like libraries and archives are facing severe budget cuts, which will affect their current activities like their digitization projects. Simon Tanner of the Department of Digital Humanities, King’s College London, wrote an interesting report, in which he explains the Balanced Value Impact Model. This model will support organizations (especially memory institutions) to do an Impact Analyses of their digital resources in order to show how the use of digital resources will benefit  and change people. Not with vague notions, but in an evidence based approach. The results can be valuable input for further plans and can support decision makers at various levels. Decisons could be made not only on economical grounds, but also by taking the impact values into account.

Tanner distinguishes the following impact areas:

  • Social and Audience impacts : “the audience, the beneficial stakeholders and wider society has been affected and changes in a beneficial fashion”
  • Economic impacts “the activitiy is demonstrating economic benefits to the organisation or to society”
  • Innovation impacts: “that the digital resource is enabling innovation which is supporting the social and economic benefits accrued”
  • Internal process impacts: ”that the organisation creating/delivering the digital resources have been benefitted within its internal processes by the innovation demonstrated”. (p.45)

The model consists of 5 stages, of which the first two are “Context” and “Analysis and Design”. In these steps the digital environment in which the organization operates ( “the digital ecosystem”), are described, as well as the stakeholders who either benefit from or at least are affected by the digital resources.

It is not my intention to explain the model here and I would advise you to read the report. But it occurred to me that this exercise could benefit the case of digital preservation in an organisation as well. Part of the digital resources will be preserved for the long term after all.

As digital preservation is a costly activity, it is important to show the value of it. Why are we keeping all this digital material for an undefined amount of years? The Balanced Value Impact Model could be very helpful as this exercise will lead to an overview of the current ecosystem, and the current stakeholders for the digital resources. It will also show the value the stakeholders relate to the digital collections. Values for society and for individuals, economic values and values for the organization itself.

The  information collected for the Balanced Value Impact Model can help the organization to identify the areas they need to monitor in their Preservation Watch to safeguard that this ecosystem and the identified stakeholders will be served over the years. The Designated community, –  for many memory institutions quite a vague notion -, will be  described better, as well as the value this Designated Community experiences with the digital resources. These values could be an ingredient for the organization in establishing their preservation policies, in which they will describe whether and how  they will keep these values in the digital collection present.

Creating a Balanced Value Impact model will not be an easy task for an organization. But it could be a very useful exercise to support the preservation policies too.

]]>
http://blog.kbresearch.nl/2013/01/14/bvim-and-digital-preservation-policies/feed/ 0