Published March 5, 2026
| Version v4
Preprint
Open
Small Models Can Learn Complex Behaviors — They Just Need the Right Examples
Authors/Creators
Description
Contrastive behavioral pairs injected into 5% of pretraining blocks break the small-model behavioral emergence wall. A 7M-parameter model achieves bias and sycophancy scores exceeding vanilla 34M, at zero additional inference cost.