Large scale paired antibody language models

Model weights for the language models introduced in "Large scale paired antibody language models" (arXiv:2403.17889), trained on paired and unpaired sequences from the Observed Antibody Space and based on the ProtTrans protein language models. 

This repository contains:

• IgBert, a paired antibody BERT language model trained on all OAS
• IgT5, a paired antibody T5 language model trained on all OAS
• IgBert-unpaired, a BERT language model trained on unpaired OAS
• IgT5-unpaired, a T5 language model trained on unpaired OAS

The same models are available on Hugging Face.