Dataset Open Access


Tiedemann, Jörg; Scherrer, Yves

This release contains data sets for experiments with document-level machine translation. The data sets have been used in previous studies and provided here for replicability and comparison with other systems. The data sets are taken from the English-German news translation task at WMT 2019 and the English-German bitext in the OpenSubtitles collection v2016 from OPUS. All data sets are sentence aligned with corresponding lines being aligned to each other. Document boundaries are marked with empty lines (on both sides of the parallel corpus).

The data set has been used in the following publication:

    title = "Analysing concatenation approaches to document-level NMT in two different domains",
    author = {Scherrer, Yves and Tiedemann, J{\"o}rg and Lo{\'a}iciga, Sharid},
    booktitle = "Proceedings of the Third Workshop on Discourse in Machine Translation",
    month = nov,
    year = "2019",
    address = "Hong-Kong",
    publisher = "Association for Computational Linguistics",

Please, cite that paper if you use the data set in your own work.

Files (1.8 GB)
Name Size
1.8 GB Download
  • Scherrer, Tiedemann and Loáiciga: "Analysing concatenation approaches to document-level NMT in two different domains", in Proceedings of DiscoMT2019 at EMNLP 2019, Hong-Kong

All versions This version
Views 169169
Downloads 3030
Data volume 53.3 GB53.3 GB
Unique views 152152
Unique downloads 2626


Cite as