Published September 30, 2022 | Version Draft
Project deliverable Open

TRIPLE Deliverable: D2.5 - Report on Data Enrichment

  • 1. Net7

Description

In this deliverable, the strategies for data enrichment in TRIPLE are presented. Through the Core Pipeline, named SCRE, metadata regarding publications and projects for the Social Sciences and Humanities are automatically harvested, mapped in the TRIPLE data model, curated, enriched and finally saved in the GoTriple platform’s indexes.
The document starts by presenting the ways SCRE imports publications metadata from OAI-PMH endpoints, OpenAIRE and Isidore data dumps. This reflects the strategies for integrating content which was planned in the project. On the one hand, OAI-PMH is a
well-known and established standard for content harvesting: many data providers, especially those of small dimension, support it, facilitating therefore their onboarding in GoTriple. The support for OpenAIRE and Isidore, on the other hand, responds to the wish to also harvest data from large aggregators, a strategy that allowed GoTriple to quickly present a significant amount
of publications in its index (more than 4 million at the time of writing).
Then the normalisation strategies applied to the acquired metadata are described. By analysing the first batches of acquired data, it has been decided to define the rules to normalise and clean the attributes for the following metadata: publication date, language codes, keywords, document types, licences, access rights and authors’ names. In the document, the definition of
controlled vocabularies for some of these attributes is also presented. 

Then enrichment services are explained, including language recognition, translation, automatic classification and annotation.
The services to detect duplicate publications and to disambiguate authors are also discussed, followed by the presentation of the acquisition and processing of project metadata 

Some final remarks on the data enrichment process, including the difficulties that have been
faced and solved, conclude the document.

Notes

The TRIPLE project (https://project.gotriple.eu/), which is financed under the Horizon 2020 framework https://cordis.europa.eu/project/id/863420), under Grant Agreement No. 863420, with approx. 5.6 million Euros for a duration of 42 months (2019-2023). The content of this deliverable reflects only TRIPLE's view and the Commission is not responsible for any use that may be made of the information it contains. --- At the heart of the project is the development of the GoTriple platform (https://www.gotriple.eu/), an innovative multilingual and multicultural discovery solution.

Files

D2.5-Report on data enrichment-1.0_TRIPLE.pdf

Files (1.5 MB)

Name Size Download all
md5:707161b88c88a3a8a91120eff20d502f
1.5 MB Preview Download

Additional details

Funding

TRIPLE – Transforming Research through Innovative Practices for Linked interdisciplinary Exploration 863420
European Commission