shsdev, Author at Open Preservation Foundation

Quality assured ARC to WARC migration

July 10 , 2014

This blog post continues a series of posts about the weeb archiving topic „ARC to WARC migration“, namely it is a follow-up on the posts…

Will the real lazy pig please scale up: quality assured large scale image migration

June 24 , 2014

Authors: Martin Schaller, Sven Schlarb, and Kristin DillIn the SCAPE Project, the memory institutions are working on practical application scenarios for the tools and solutions…

ARC to WARC migration: How to deal with de-duplicated records?

March 24 , 2014

In my last blog post about ARC to WARC migration I did a performance comparison of two alternative approaches for migrating very large sets of…

Some reflections on scalable ARC to WARC migration

March 7 , 2014

The SCAPE project is developing solutions to enable the processing of very large data sets with a focus on long-term preservation. One of the application…

Web Archive FITS Characterisation using ToMaR

December 16 , 2013

From the very beginning of the SCAPE project on, it was a requirement that the SCAPE Execution Platform be able to leverage functionality of existing…

Impressions of the ‘Hadoop-driven digital preservation Hackathon’ in Vienna

December 6 , 2013

More than 20 developers visited the ‘Hadoop-driven digital preservation Hackathon’ in Vienna which took place in the baroque room called "Oratorium" of the Austrian National…

Read more from the author

Quality assured ARC to WARC migration

Will the real lazy pig please scale up: quality assured large scale image migration

ARC to WARC migration: How to deal with de-duplicated records?

Some reflections on scalable ARC to WARC migration

Web Archive FITS Characterisation using ToMaR

Impressions of the ‘Hadoop-driven digital preservation Hackathon’ in Vienna

Member-only content

or

or

or

or

Download

or

Download

or

Download

or

Download

or

Download

or