Second release of BERTurk - Turkish Model Zoo (incl. BERT5urk).

Changelog

• 03.03.2025: Release of BERT5urk - pretrained on Turkish part of FineWeb2 corpus.
• 21.12.2024: New evaluations with Flair are added.
• 23.09.2021: Release of uncased ELECTRA and ConvBERT models and cased ELECTRA model, all trained on mC4 corpus.
• 24.06.2021: Release of new ELECTRA model, trained on Turkish part of mC4 dataset. Repository got new awesome logo from Merve Noyan.
• 16.03.2021: Release of ConvBERTurk model and more evaluations on different downstream tasks.
• 12.05.2020: Release of ELECTRA (small and base) models, see here.
• 25.03.2020: Release of BERTurk uncased model and BERTurk models with larger vocab size (128k, cased and uncased).
• 11.03.2020: Release of the cased distilled BERTurk model: DistilBERTurk. Available on the Hugging Face model hub
• 17.02.2020: Release of the cased BERTurk model. Available on the Hugging Face model hub
• 10.02.2020: Training corpus update, new TensorBoard links, new results for cased model.
• 02.02.2020: Initial version of this repo.