segmented Corpus of Buddhist Sanskrit (proof of concept)

This is a proof-of-concept Sanskrit corpus developed for the study of Buddhist Sanskrit lexicology.

It comprises:

•  311 lemmatized and metadata-enriched Buddhist Sanskrit texts for a total of ~ 7 million words. 
• a tokenised reference corpus of general Sanskrit including 267 texts for a total of ~ 13 million words
• a metadata table with information about each text in the Buddhist and Reference corpora

The corpora is in romanised Sanskrit (UTF-8 encoding)

Limitations
As a proof of concept, this corpus suffers from several limitations. It is small by contemporary standards and it has not been proof-read yet. 

We are grateful to have received an Ashoka grant from the Khyentse Foundation to proofread the Buddhist Sanskrit Corpus. Improved versions will be released in due course.

Acknowledgments
The corpus had been first realised as part of the project 'Lexis and Tradition: variation in the vocabulary of Sanskrit Mahāyāna literature'. This project was funded by the British Academy through a Newton International Fellowship (NF161436) and hosted at the Department of Theology and Religious Studies at King's College London under the supervision of Prof. Henrietta Kate Crosby. 

Dr. Bruno Galasek-Hul has contributed to versions 1.4 - 1.7 thanks to funding from the Mangalam Research Center for Buddhist Languages.

The reference corpus of general Sanskrit has been tokenised by Matej Martinc within the project 'Computing the Dharma' funded by the National Endowment for the Humanities (HAA-277246-21).

Thanks to GRETIL, CTS e-texts, Vinita Tseng, Jowita Kramer and Prof. Steinkellner for kindly giving their permission to include automatically processed versions of some of their editions in this corpus.

Changelog

version 1.7 adds more Buddhist texts and a new pre-processed corpus of general Sanskrit

version 1.6 adds more Buddhist texts, improves segmentation and adds an initial iteration of the lemmatised corpus

version 1.5 adds more Buddhist texts, removes the reference corpus and improves segmentation

version 1.4 adds 59 Buddhist texts and fixes some recurrent segmentation errors

version 1.4.1 corrects some spacing and sentence parsing errors