Published October 30, 2022 | Version Accepted Published version
Conference paper Open

Exploiting CLIP-Based Multi-modal Approach for Artwork Classification and Retrieval

  • 1. Università degli Studi di Firenze - MICC, Firenze, Italy

Description

In this work we investigate how recent CLIP model can be applied in several tasks in artwork domain. We perform exhaustive experiments on the NoisyArt dataset which is a collection of artwork images collected from public resources on the web. On such dataset CLIP achieve impressive results on (zero-shot) classification and promising results in both artwork-to-artwork and description-to-artwork domain.ù

Notes

This work has been partly supported by the project that has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 101004545 - ReInHerit.

Files

Exploiting CLIP-Based Multi-modal Approach for Artwork Classification and Retrieval.pdf

Additional details

Funding

European Commission
ReInHerit - Redefining the future of cultural heritage, through a disruptive model of sustainability 101004545