Umsuka English - isiZulu Parallel Corpus
Authors/Creators
- 1. SADILAR
- 2. Masakhane
- 3. University of Pretoria
Description
We’ve developed an open-source, high quality isiZulu parallel corpus that comes from a
mixture of domains, taking into account both Southern African context and international
English context, by using professional translators. We sourced 5000 English sentences,
sampled from News Crawl datasets that were translated into isiZulu. Additionally, we
translated 5000 isiZulu sentences, sampled from both the NCHLT monolingual corpus and
the open-source documents of the UKZN isiZulu National monolingual corpus, into English.
From each set, we separated out 1000 patterns as the evaluation dataset. Since isiZulu is
highly morphologically complex, we believe that the English-to-isiZulu evaluation set should
be translated at least twice, by different translators which will allow us to calculate
human-level BLEU score for the dataset.
More details in the provided Data Statement
Notes
Files
Data Statement for Umsuka isiZulu Parallel Corpus.pdf
Files
(3.6 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:646273d2f01c98fde78d24aa2dfe8a19
|
62.2 kB | Preview Download |
|
md5:77c2301e67b8feb5f5dd23d18544990d
|
466.7 kB | Preview Download |
|
md5:b1d91414cf69fd07dfffbc3431ce05eb
|
1.5 MB | Preview Download |
|
md5:b4622782d59b88eb8191d263d4424f64
|
340.6 kB | Preview Download |
|
md5:ca618bff85902799ffdc27995480b9ac
|
1.2 MB | Preview Download |