Conference paper Open Access

Text Simplification from Professionally Produced Corpora

Carolina Scarton; Gustavo Henrique Paetzold; Lucia Specia


Dublin Core Export

<?xml version='1.0' encoding='utf-8'?>
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
  <dc:creator>Carolina Scarton</dc:creator>
  <dc:creator>Gustavo Henrique Paetzold</dc:creator>
  <dc:creator>Lucia Specia</dc:creator>
  <dc:date>2018-05-07</dc:date>
  <dc:description>The lack of large and reliable datasets has been hindering progress in Text Simplification (TS). We investigate the application of the recently created Newsela corpus, the largest collection of professionally written simplifications available, in TS tasks. Using new alignment algorithms, we extract 550,644 complex-simple sentence pairs from the corpus. This data is explored in different ways: (i) we show that traditional readability metrics capture surprisingly well the different complexity levels in this corpus, (ii) we build machine learning models to classify sentences into complex vs. simple and to predict complexity levels that outperform their respective baselines, (iii) we introduce a lexical simplifier that uses the corpus to generate candidate simplifications and outperforms the state of the art approaches, and (iv) we show that the corpus can be used to learn sentence simplification patterns in more effective ways than corpora used in previous work.</dc:description>
  <dc:identifier>https://zenodo.org/record/1410451</dc:identifier>
  <dc:identifier>10.5281/zenodo.1410451</dc:identifier>
  <dc:identifier>oai:zenodo.org:1410451</dc:identifier>
  <dc:relation>info:eu-repo/grantAgreement/EC/H2020/692819/</dc:relation>
  <dc:relation>doi:10.5281/zenodo.1410450</dc:relation>
  <dc:relation>url:https://zenodo.org/communities/h2020-simpatico-692819</dc:relation>
  <dc:rights>info:eu-repo/semantics/openAccess</dc:rights>
  <dc:rights>https://creativecommons.org/licenses/by/4.0/legalcode</dc:rights>
  <dc:title>Text Simplification from Professionally Produced Corpora</dc:title>
  <dc:type>info:eu-repo/semantics/conferencePaper</dc:type>
  <dc:type>publication-conferencepaper</dc:type>
</oai_dc:dc>
56
31
views
downloads
All versions This version
Views 5656
Downloads 3131
Data volume 7.5 MB7.5 MB
Unique views 5252
Unique downloads 2828

Share

Cite as