Published December 8, 2016 | Version v1
Conference paper Open

The IWSLT 2016 Evaluation Campaign

  • 1. Fondazione Bruno Kessler
  • 2. Karlsruhe Institute of Technology

Description

The IWSLT 2016 Evaluation Campaign featured two tasks: the translation of talks and the translation of video conference conversations. While the first task extends previously offered tasks with talks from a different source, the second task is completely new. For both tasks, three tracks were organised: automatic speech recognition (ASR), spoken language translation (SLT), and machine translation (MT). Main translation directions that were offered are English to/from German and English to French. Additionally, the MT track included English to/from Arabic and Czech, as well as French to English. We received this year run submissions from 11 research labs. All runs were evaluated with objec- tive metrics, while submissions for two of the MT talk tasks were also evaluated with human post-editing. Results of the human evaluation show improvements over the best submissions of last year.

Files

IWSLT_2016_evaluation_overview.pdf

Files (254.0 kB)

Name Size Download all
md5:8fb64e7479101b612e891434fa9b220e
254.0 kB Preview Download

Additional details

Funding

CRACKER – Cracking the Language Barrier: Coordination, Evaluation and Resources for European MT Research 645357
European Commission
MMT – MMT will deliver a language independent commercial online translation service based on a new open-source machine translation distributed architecture 645487
European Commission