Obtaining Better Static Word Embeddings Using Contextual Embedding Models

Obtaining Better Static Word Embeddings Using Contextual Embedding Models

This repository contains the dataset of pretrained word embeddings as well as datasets used to train them, released with the following paper.

“Obtaining Better Static Word Embeddings Using Contextual Embedding Models” ACL (2021).

The wikipedia datasets were preprocessed from the wikipedia dump downloaded from dumps.wikimedia.org under Creative Commons Attribution-Share-Alike 3.0 License .

If you found the provided resources useful, please cite the above paper. Here's a BibTeX entry you may use:

@inproceedings{Gupta2021ObtainingPC,
  title={Obtaining Better Static Word Embeddings Using Contextual Embedding Models},
  author={Prakhar Gupta and Martin Jaggi},
  booktitle={ACL},
  year={2021}
}