Published January 19, 2021 | Version 1.0
Software Open

Elicited Linguistic Data Wrangler (eLDW)

  • 1. Leiden University

Description

eLDW is a basic script which enables researchers to quickly process elicited linguistic data from a single speaker. When used as part of the Digital Notebook Method, eLDW allows for the rapid creation of archivable time-aligned text annotations. Some of its notable features include:

  • Integration of text data and timecode data from different data sources
  • Multiple input and output formats accepted, including .csv, .TextGrid (for use with Praat), .eaf (for use with ELAN), and .flextext (for use with FLEx).
  • Batch processing

 

How to use eLDW

eLDW is available as a Google Colab Notebook, which can be used without downloading or installing any software. You must have a Google account and be logged into the account in order to use the Colab Notebook. Open the notebook and follow the three primary steps outline in the instructions:

  1. Choose the options in the first form and press the first play button. Step 1 Option Descriptions

  2. Fill out the information in the generated form and press the second play button. Step 2 Option Descriptions

  3. Press the "Browse" button to upload your files.

When the process is complete you will be able to download all of the output files in a zipped folder. Download this file to your computer and extract the contents.

 

Requirements

The eLDW is suitable only for recordings of a single speaker and utterance-level text data (i.e. free translations and transcriptions but not parsing or glossing).

 

Text Data Input

  • .csv - (Tidy data format) Each row in the data should correspond to a single utterance, optionally with the first row serving as column names which can then be used as tier names for the output data. If the first row does not include column names, then columns must be specified in the generated form of Step 2. If paired with timecode data, each row of the text data should correspond to each pair of start and end times.
  • .TextGrid - For each tier specified in Step 2, all non-empty segments are used as input text and all empty segments will be disregarded.
  • .eaf - For each tier specified in Step 2, all annotations are used for input text.
  • .flextext - Currently only the non-parsed text of .flextext files can be used as input text.

 

Timecode Data Input

  • .csv - The first column of data should include the start times for each segment, and the second column should include the end times.
  • .TextGrid - The timecode data for either all non-empty segments or those with the specified sounding interval text are used as input timecode. If multiple tiers are present in the .TextGrid file, then all tiers should have the same start time and end time for each segment.
  • .eaf - The start time and end time for each annotation are used as input timecode. If multiple tiers are present in the .eaf file, then all tiers should have the same start time and end time for each segment.
  • .flextext - The start time and end time of each "phrase" in the .flextext are used as input timecode.

 

Output

  • .csv - The output .csv file includes the following data, sparated by commas: REF_ID (if selected in Step 1), start time, end time, text data tiers.
  • .TextGrid - The output .TextGrid includes the REF_ID tier as the first tier (if selected in Step 1), followed by the text data tiers.
  • .eaf - The output .eaf includes the REF_ID tier as the parent tier (if selected in Step 1), with all of the text data as child tiers.
  • .flextext - The output .flextext includes the tier selected as Transcription as linguistic data during Step 1, and any tiers selected as Translation are included as free translations of the linguistic data. The REF_ID is included as a free translation with the language code "zxx".

Files

Elicited_Linguistic_Data_Wrangler_(eLDW).ipynb

Files (55.3 kB)

Name Size Download all
md5:bce75deceb4137b6d364cf8f45c4e464
45.4 kB Preview Download
md5:d07ce6c80db32d03524cf43072a73114
4.4 kB Preview Download
md5:a47ee0cd36f4fa43e418fc97849a2e40
1.3 kB Preview Download
md5:f62b9d7c0c4ed2953806617b38e8d3f9
4.2 kB Preview Download

Additional details