Error analysis on harvesting data over the internet
Authors: Kapidakis, Sarantos 
Issue Date: 26-Jun-2018
Conference: PETRA '18: The 11th PErvasive Technologies Related to Assistive Environments Conference 
Book: PETRA '18: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference 
Series: ACM International Conference Proceeding Series
Keywords: Harvesting, Metadata, Open archive initiative, Reliability, Tool
Abstract: 
Harvesting tasks gather information to a central repository. We studied 880560 harvesting tasks from 3446 harvesting services in 354 harvesting rounds during a period of 15 months, of which 382705 failed and the remaining tasks occasionally returning fewer records. A significant part of the Open Archive Initiative harvesting services never worked or have ceased working while many other services fail occasionally. A harvesting task includes many stages of information exchange, and each one of them may fail - but with different consequences each time. We studied the reported warning messages, the number of records returned, and the required response time to discover relations among them. We found that about half of the harvesting tasks on each harvesting round fail, and the number of failing tasks is slowly increasing. We developed a method of analysis that can be used to reverse engineering such complex network systems and to categorize the reasons of failure into useful classes. Our results do not indicate a new approach to harvesting or conclude to a breakthrough advice, but make clear the complexity of the operation in an ever changing networking environment and alarm the reader that some facts that may be considered trivial, actually they are not! They help us to better understand the risks involved, and to design more reliable procedures and improved ways to closely monitor them.
ISBN: 9781450363907
DOI: 10.1145/3197768.3201537
URI: https://uniwacris.uniwa.gr/handle/3000/908
Type: Conference Paper
Department: Department of Archival, Library and Information Studies 
School: School of Administrative, Economics and Social Sciences 
Affiliation: University of West Attica (UNIWA) 
Appears in Collections:Book Chapter / Κεφάλαιο Βιβλίου

CORE Recommender
Show full item record

SCOPUSTM   
Citations 20

2
checked on Nov 19, 2024

Page view(s)

30
checked on Nov 23, 2024

Google ScholarTM

Check

Altmetric

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.