Conference paper Open Access
Evaluating the Robustness of Embedding-Based Topic Models to OCR Noise
Zosa, Elaine;
Mutuvi, Stephen;
Granroth-Wilding, Mark;
Doucet, Antoine
Unsupervised topic models such as Latent Dirichlet Allocation (LDA) are popular tools to analyse digitised corpora. However, the performance of these tools have been shown to degrade with OCR noise. Topic models that incorporate word embeddings during inference have been proposed to address the limitations of LDA, but these models have not seen much use in historical text analysis. In this paper we explore the impact of OCR noise on two embedding-based models, Gaussian LDA and the Embedded Topic Model (ETM) and compare their performance to LDA. Our results show that these models, especially ETM, are slightly more resilient than LDA in the presence of noise in terms of topic quality and classification accuracy
| Name | Size | |
|---|---|---|
|
Zosa2021_Chapter_EvaluatingTheRobustnessOfEmbed.pdf
md5:6dc0e352dc2d06e4aa9424ca43d4e39e |
775.3 kB | Download |
| All versions | This version | |
|---|---|---|
| Views | 27 | 27 |
| Downloads | 56 | 56 |
| Data volume | 43.4 MB | 43.4 MB |
| Unique views | 25 | 25 |
| Unique downloads | 54 | 54 |
- Publication date:
- January 25, 2022
- DOI:
-
- Grants:
-
European Commission:
- NewsEye - NewsEye: A Digital Investigator for Historical Newspapers (770299)
- Meeting:
- International Conference on Asian Digital Libraries 2021
- Communities:
- License (for files):
- Creative Commons Attribution 4.0 International