Published November 17, 2021 | Version 0.1.2

Language models for astrochemistry

Authors/Creators

Description

This posts a major change to the way embeddings are calculated. While the model weights are unchanged, the main user API for embedding molecular strings has been revised, as the previous implementation did not really take into account structure as it simply perform the einsum over raw nn.Embedding lookups.

The embed_molecule and related methods will now actually run the word embeddings through the encoder, then perform the einsum operation over non-padding tokens. This should now incorporate structural differences, and possibly explain why cosine similarities were very close to 1 for many molecules.

Full Changelog: https://github.com/laserkelvin/astrochem_embedding/compare/v0.1.4...v0.2.0

Notes

If you use this software, please cite it as below.

Files

laserkelvin/astrochem_embedding-v0.2.0.zip

Files (2.9 MB)

Name Size
md5:24c04f24cdff192a9d4bc0ca1b4fdc44
2.9 MB Preview Download

Additional details