gdup: a big graph entity deduplication system

The GDup Software enables an integrated, scalable, general-purpose system for entity deduplication over big information graphs. GDup supports practitioners with the functionalities needed to realize a fully-fledged entity deduplication workflow over a generic input graph, inclusive of Ground Truth support, end-user feedback, and strategies for identifying and merging duplicates to obtain an output disambiguated graph.

This software module is the core library implementing the clustering functions, the comparators, and the configuration language that users can exploit to define the matching criteria.

GDup is today one of the core components of the OpenAIRE infrastructure production system, monitoring Open Science trends on behalf of the European Commission. The Software is the outcome of Claudio Atzori’s PhD investigations on “deduplication of knowledge graphs”.