Published January 12, 2023 | Version 0.0.1
Dataset Open

THCHS-30 - Aligned IPA transcriptions

  • 1. Chemnitz University of Technology

Description

This upload contains aligned IPA transcriptions for the THCHS-30 dataset from OpenSLR. Thereby, punctuation is added, silence marked and duration markers for each phoneme are assigned. Furthermore, the silence on the beginning and ending of each file is marked.

The words were transcribed using pypinyin (v0.47.1) via dict-from-pypinyin (v0.0.1) and mapped to IPA using the pinyin-ipa-map-TONE3-all.json mapping from here. The alignment was done using Montreal Forced Aligner (v2.0.5) and the acoustic model Mandarin MFA (v2.0.0a).

Phoneme duration markers:

  • ˘ -> [0, 20) percentile (speaker-wise), e.g., a˥˩˘
  • (none) -> [20, 80) percentile (speaker-wise), e.g., a˥˩
  • ˑ -> [80, 90) percentile (speaker-wise), e.g., a˥˩ˑ
  • ː -> [90, inf) percentile (speaker-wise), e.g., a˥˩ː

Thereby each phoneme (including tones) was considered on its own, i.e., phonemes with different tones were not considered together for the percentile calculation.

Silence markers:

  • SILX -> silence at start/end of a recording (aligned on all tiers)
  • SIL0 -> no silence
  • SIL1 -> [0, 33.33333333) percentile of all silences (speaker-wise)
  • SIL2 -> [33.33333333, 66.66666666) percentile of all silences (speaker-wise)
  • SIL3 -> [66.66666666, inf) percentile of all silences (speaker-wise)

Files:

  • grids.zip
    • contains TextGrids for all audio files containing three tiers wordsphonemes and transcription
      • words contains the aligned Chinese words
      • phonemes contains the IPA pronunciations including silence markers at start and end (SILX)
      • transcription contains unaligned phonemes including punctuation and word boundary labels (SIL0)
    • the folder structure is equal to one from the dataset
  • grids-sdp.zip
  • preview-start/middle/end.png
    • preview of the first TextGrid from speaker A2 opened in Praat in different positions
  • words-vocabulary.txt
    • contains all Chinese words from tier words
  • phonemes-vocabulary.txt
    • contains all phonemes from tier phonemes
  • transcription-vocabulary.txt
    • contains all phonemes/punctuation from tier transcription
  • phonemes-durations.pdf
    • contains the plotted phoneme duration distribution of tier phonemes
  • phonemes-durations-simple.pdf
    • contains the plotted phoneme duration distribution of tier phonemes if all duration markers are ignored
  • phonemes-durations-simple-toneless.pdf
    • contains the plotted phoneme duration distribution of tier phonemes if all duration markers and tones are ignored
  • pronunciations-broad.dict
    • contains the broad pronunciations for each word including punctuation but not duration markers
    • e.g., 一下。 i˥ ɕ j a˥˩ 。
  • pronunciations-narrow.dict
    • contains the narrow pronunciations for each word including punctuation, duration markers and weights (= occurrence) over all speakers
    • e.g., 一下。 3 i˥ ɕ j a˥˩ː 。
  • pronunciations-narrow-speakers.zip
    • contains the narrow pronunciations separated for each speaker
  • script.sh
    • contains the script to reproduce all results
    • error in line 32: replace with speech-dataset-parser==0.0.4

Notes

Funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – Project-ID 416228727 – CRC 1410

Files

grids-sdp.zip

Files (92.4 MB)

Name Size Download all
md5:fa3d2bdbc0cc8403b45e09d249cee16c
41.0 MB Preview Download
md5:2347227d8f2b72eb40dfb8e869ed014b
40.9 MB Preview Download
md5:010415642fe4b59f4f2283b0a3afd53e
92.3 kB Preview Download
md5:e68b6faeb64f177d494546f7cf5c9a68
188.7 kB Preview Download
md5:e3ccb7f507e0be6a4fcc465d3f7e4fea
692.2 kB Preview Download
md5:cb496d79f4fe66b074d364cc38713dff
2.9 kB Preview Download
md5:620f9310999c408c3c9350bf926fd91e
890.5 kB Preview Download
md5:62024bf916fbe3eea555a02a55cac1cd
1.0 MB Preview Download
md5:fdb8d00361adbaca4c197e4490d6841a
899.8 kB Preview Download
md5:7c3c360d93b7420b61b24c46f7bc215d
285.2 kB Download
md5:fb255f7c9e3c371ff0fd119cf952923b
2.1 MB Preview Download
md5:cff6b6f442c50f01678068f7e244321a
4.3 MB Download
md5:1906119e0b18b087d67fcec1c6b9571d
23.7 kB Download
md5:489f0dfe6d0a83734cf81c8a3d285318
2.9 kB Preview Download
md5:5fd9ea1bd184ad9be5ab936cdfa68525
67.2 kB Preview Download

Additional details

References