Published June 27, 2021 | Version v1
Dataset Open

Umsuka English - isiZulu Parallel Corpus

  • 1. SADILAR
  • 2. Masakhane
  • 3. University of Pretoria

Description

We’ve developed an open-source, high quality isiZulu parallel corpus that comes from a
mixture of domains, taking into account both Southern African context and international
English context, by using professional translators. We sourced 5000 English sentences,
sampled from News Crawl datasets that were translated into isiZulu. Additionally, we
translated 5000 isiZulu sentences, sampled from both the NCHLT monolingual corpus and
the open-source documents of the UKZN isiZulu National monolingual corpus, into English.
From each set, we separated out 1000 patterns as the evaluation dataset. Since isiZulu is
highly morphologically complex, we believe that the English-to-isiZulu evaluation set should
be translated at least twice, by different translators which will allow us to calculate
human-level BLEU score for the dataset.

More details in the provided Data Statement

Notes

Thank you to Facebook Research for funding the creation of this dataset

Files

Data Statement for Umsuka isiZulu Parallel Corpus.pdf

Files (3.6 MB)

Name Size Download all
md5:646273d2f01c98fde78d24aa2dfe8a19
62.2 kB Preview Download
md5:77c2301e67b8feb5f5dd23d18544990d
466.7 kB Preview Download
md5:b1d91414cf69fd07dfffbc3431ce05eb
1.5 MB Preview Download
md5:b4622782d59b88eb8191d263d4424f64
340.6 kB Preview Download
md5:ca618bff85902799ffdc27995480b9ac
1.2 MB Preview Download