ENGLISH-AKUAPEM TWI PARALLEL CORPUS
Description
This dataset (verified_data.csv) is bilingual machine translation training corpus for English and Akuapem Twi of 25,421 sentence pairs.
A transformer-based machine translator was used to generate initial translations in Akuapem Twi, which were later verified and corrected where necessary by native speakers.
The main idea of a typical use case for the dataset is for further training of machine translation models in Akuapem Twi.
The data can also be used for other downstream NLP tasks such as Named Entity Recognition and POS tagging, with appropriate additional annotations.
Another potential application is training unsupervised embeddings for the Akuapem Twi language.
In addition a higher quality 697 crowdsourced sentences (crowdsourced_data.csv) are provided for use as an evaluation set for the tasks highlighted above. It is recommended as a testing dataset for machine translation English to Twi and Twi to English models.
Acknowledgement: This project was supported by the AI4D language dataset fellowship through K4all and Zindi Africa