Published September 29, 2023 | Version v1

New Ways of Creating Research Data - Conversion of Unstructured Text to TEI XML using GPT on the Correspondence of Hugo Schuchard with a Web Prototype for Prompt Engineering

  • 1. Zentrum für Informationsmodellierung, Österreich
  • 2. Digital Humanities Craft OG, Österreich
  • 3. Independent Software Developer
  • 1. Data Center for the Humanities, Universität zu Köln
  • 2. DAASI International GmbH
  • 3. Universität Tübingen

Description

This paper explores the use of prompt engineering to streamline the creation of humanities research data by converting unstructured correspondence texts into the TEI XML format. The approach optimizes language models such as GPT to produce accurate structured data while preserving context. The paper discusses the iterative refinement of the conversion process, challenges, and potential solutions, and presents a user-friendly web prototype. Overall, prompt engineering shows potential for improving the efficiency of research data creation in the humanities.

Files

V12_Pollin-New Ways of Creating Research Data-128.pdf

Files (211.7 kB)

Additional details

Related works

Is part of
Book: 10.5281/zenodo.8341605 (DOI)