Published June 12, 2025 | Version v1

Prompting or Fine-tuning? Evaluating Relation Classification in Portuguese for Knowledge Graph Construction

  • 1. University of Coimbra, CISUC/LASI, DEI, Coimbra, Portugal

Description

This paper explores relation classification as a step toward building structured knowledge graphs from unstructured Portuguese text. We evaluate prompt-based approaches using generative large language models and compare them with a fine-tuned BERT model. Experiments are conducted on a custom relation extraction dataset built by aligning Wikidata triples with sentences from Wikipedia in Portuguese, a lower-resourced language than English. Results show that while prompt-based methods offer flexibility and reasonable performance, fine-tuning yields significantly better results in identifying relation types, an essential aspect for accurate and reliable knowledge graph construction.

Files

GOBLIN25_Camera-Ready_16.pdf

Files (393.3 kB)

Name Size Download all
md5:66ec1fc9b4f2ee4a1337c406c372168e
393.3 kB Preview Download

Additional details

Funding

European Cooperation in Science and Technology
GOBLIN: Global Network on Large-Scale, Cross-domain and Multilingual Open Knowledge Graphs CA23147