Published June 1, 2022 | Version v1

English and Portuguese CBOW Models from Europarl Corpus, version 7, using FastText with Subwords Option

Authors/Creators

  • 1. INESC-ID

Description

The models were trained using FastText, model CBOW, 40 epochs, and subwords. Each *.BIN file has its *.VEC file with the vocabulary ordered by frequency. The *.BIN file can return a vector to represent an out-of-vocabulary (OOV) word if the necessary parts of the OOV word were used in training. FastText and Gensim can use these files. The English and Portuguese models are identified in the file name,  _en_  and _pt_ respectively.

An Excel file has the neighborhood changes of some selected words during training on each epoch. A previous exercise to find words with more than one meaning.

Notes

Compressed source text from https://www.statmt.org/europarl/v7/pt-en.tgz

Files

Files (428.1 MB)

Name Size
md5:9104c2a46a7328382b4cfaa178d788ef
205.8 MB Download
md5:8c45de992f1418e0b46e0ff0ba9faa4f
5.4 MB Download
md5:0cb806cd3bd7948db8faadae1ae22757
208.7 MB Download
md5:1045e877e3b0ae5e102f3e1d3b289af8
8.2 MB Download
md5:3f04749842b5c369ea315fa84475ccdd
30.5 kB Download