Published November 22, 2024
| Version v2
Figure
Open
Scaling plots for 80% and 100% text-pretrained
Authors/Creators
Description
Scaling plots for 80% and 100% (text80 and text100) in the name
All are text-pretrained with 4 epochs of fine-tuning and 28b of image-text training with 10% image caption and 90% text (ratio 0p1 in the name)
plots with various ablations at 154m, 411m, 1b scale (appended in the name)
The text data is DCLM dataset and the image data is DatacompDR
Files
finetuning_epochs_datacompdronly_vs_vision_textstable-score_grid_ratio0p1_text80_154m.png
Files
(9.6 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:f9d7a81ef2ac70ce94ed801033b52d8f
|
1.1 MB | Preview Download |
|
md5:424092581d4b8a08bd32c477ea47c61b
|
1.1 MB | Preview Download |
|
md5:6fe359b407e473c56b91c7e426c88068
|
787.6 kB | Preview Download |
|
md5:53834887834a129aa946278b5969f165
|
860.1 kB | Preview Download |
|
md5:36ee245dee0e4fac5a6cee69b26270bd
|
1.2 MB | Preview Download |
|
md5:36ee245dee0e4fac5a6cee69b26270bd
|
1.2 MB | Preview Download |
|
md5:90580e946e0e38b719bc8719a183b335
|
1.2 MB | Preview Download |
|
md5:af831e6694fb3ebab95ceddc74523f99
|
1.2 MB | Preview Download |
|
md5:0508af7df72a0d8b02c01e0e6508977c
|
1.1 MB | Preview Download |
Additional details
Identifiers
- Other
- Figures_rebuttal_ICLR_2025
Dates
- Submitted
-
2024-11-22