THCHS-30 - Aligned IPA transcriptions
Description
This upload contains aligned IPA transcriptions for the THCHS-30 dataset from OpenSLR. Thereby, punctuation is added, silence marked and duration markers for each phoneme are assigned. Furthermore, the silence on the beginning and ending of each file is marked.
The words were transcribed using pypinyin (v0.47.1) via dict-from-pypinyin (v0.0.1) and mapped to IPA using the pinyin-ipa-map-TONE3-all.json
mapping from here. The alignment was done using Montreal Forced Aligner (v2.0.5) and the acoustic model Mandarin MFA (v2.0.0a).
Phoneme duration markers:
˘
-> [0, 20) percentile (speaker-wise), e.g.,a˥˩˘
- (none) -> [20, 80) percentile (speaker-wise), e.g.,
a˥˩
ˑ
-> [80, 90) percentile (speaker-wise), e.g.,a˥˩ˑ
ː
-> [90, inf) percentile (speaker-wise), e.g.,a˥˩ː
Thereby each phoneme (including tones) was considered on its own, i.e., phonemes with different tones were not considered together for the percentile calculation.
Silence markers:
SILX
-> silence at start/end of a recording (aligned on all tiers)SIL0
-> no silenceSIL1
-> [0, 33.33333333) percentile of all silences (speaker-wise)SIL2
-> [33.33333333, 66.66666666) percentile of all silences (speaker-wise)SIL3
-> [66.66666666, inf) percentile of all silences (speaker-wise)
Files:
grids.zip
- contains TextGrids for all audio files containing three tiers
words
,phonemes
andtranscription
words
contains the aligned Chinese wordsphonemes
contains the IPA pronunciations including silence markers at start and end (SILX
)transcription
contains unaligned phonemes including punctuation and word boundary labels (SIL0
)
- the folder structure is equal to one from the dataset
- contains TextGrids for all audio files containing three tiers
grids-sdp.zip
- same as
grids.zip
except the folder structure is the one from speech-dataset-parser (v0.0.4)
- same as
preview-start/middle/end.png
- preview of the first TextGrid from speaker
A2
opened in Praat in different positions
- preview of the first TextGrid from speaker
words-vocabulary.txt
- contains all Chinese words from tier
words
- contains all Chinese words from tier
phonemes-vocabulary.txt
- contains all phonemes from tier
phonemes
- contains all phonemes from tier
transcription-vocabulary.txt
- contains all phonemes/punctuation from tier
transcription
- contains all phonemes/punctuation from tier
phonemes-durations.pdf
- contains the plotted phoneme duration distribution of tier
phonemes
- contains the plotted phoneme duration distribution of tier
phonemes-durations-simple.pdf
- contains the plotted phoneme duration distribution of tier
phonemes
if all duration markers are ignored
- contains the plotted phoneme duration distribution of tier
phonemes-durations-simple-toneless.pdf
- contains the plotted phoneme duration distribution of tier
phonemes
if all duration markers and tones are ignored
- contains the plotted phoneme duration distribution of tier
pronunciations-broad.dict
- contains the broad pronunciations for each word including punctuation but not duration markers
- e.g.,
一下。 i˥ ɕ j a˥˩ 。
pronunciations-narrow.dict
- contains the narrow pronunciations for each word including punctuation, duration markers and weights (= occurrence) over all speakers
- e.g.,
一下。 3 i˥ ɕ j a˥˩ː 。
pronunciations-narrow-speakers.zip
- contains the narrow pronunciations separated for each speaker
script.sh
- contains the script to reproduce all results
- error in line 32: replace with
speech-dataset-parser==0.0.4
Notes
Files
grids-sdp.zip
Files
(92.4 MB)
Name | Size | Download all |
---|---|---|
md5:fa3d2bdbc0cc8403b45e09d249cee16c
|
41.0 MB | Preview Download |
md5:2347227d8f2b72eb40dfb8e869ed014b
|
40.9 MB | Preview Download |
md5:010415642fe4b59f4f2283b0a3afd53e
|
92.3 kB | Preview Download |
md5:e68b6faeb64f177d494546f7cf5c9a68
|
188.7 kB | Preview Download |
md5:e3ccb7f507e0be6a4fcc465d3f7e4fea
|
692.2 kB | Preview Download |
md5:cb496d79f4fe66b074d364cc38713dff
|
2.9 kB | Preview Download |
md5:620f9310999c408c3c9350bf926fd91e
|
890.5 kB | Preview Download |
md5:62024bf916fbe3eea555a02a55cac1cd
|
1.0 MB | Preview Download |
md5:fdb8d00361adbaca4c197e4490d6841a
|
899.8 kB | Preview Download |
md5:7c3c360d93b7420b61b24c46f7bc215d
|
285.2 kB | Download |
md5:fb255f7c9e3c371ff0fd119cf952923b
|
2.1 MB | Preview Download |
md5:cff6b6f442c50f01678068f7e244321a
|
4.3 MB | Download |
md5:1906119e0b18b087d67fcec1c6b9571d
|
23.7 kB | Download |
md5:489f0dfe6d0a83734cf81c8a3d285318
|
2.9 kB | Preview Download |
md5:5fd9ea1bd184ad9be5ab936cdfa68525
|
67.2 kB | Preview Download |
Additional details
References
- Wang, D., Zhang, X., & Zhang, Z. (2015). THCHS-30: A Free Chinese Speech Corpus (arXiv:1512.01882). arXiv. http://arxiv.org/abs/1512.01882