Published July 29, 2021 | Version v0.1-alpha

DALL·E Mini

Description

DALL·E mini is a JAX/Flax reimplementation of OpenAI's DALL·E that requires much smaller hardware resources. By simplifying the architecture and model memory requirements, as well as leveraging open-source code and pre-trained models, we were able to create a model that is 27 times smaller than the original DALL·E and train it on a single TPU v3-8 for only 3 days. DALL·E mini achieves impressive results, albeit of a lower quality than the original system. It can be used for exploration and further experimentation on commodity hardware.

Notes

If you use this project, please cite it using these metadata.

Files

borisdayma/dalle-mini-v0.1.1.zip

Files (199.2 kB)

Name Size
md5:f3284728612bd60f555e8634df334917
199.2 kB Preview Download

Additional details

Related works