Noise Schedule Optimization in Tabular Flow Matching for Convergence and Sample Quality
Description
We systematically study antithetic initial noise in diffusion models, discovering that pairing each noise sample with its negation consistently produces strong negative correlation. This universal phenomenon holds across datasets, model architectures, conditional and unconditional sampling, and even other generative models such as VAEs and Normalizing Flows. To explain it, we combine experiments and theory and propose a textit\symmetry conjecture\ that the learned score function is approximately affine antisymmetric (odd symmetry up to a constant shift), supported by empirical evidence. This
Research goal: What is the impact of noise schedule design on the convergence speed and sample quality of tabular flow matching models compared to standard diffusion approaches?
Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 9.3/10.
Notes
Files
paper.pdf
Files
(79.0 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:06c734aa393604b73f8c480cba8660c6
|
79.0 kB | Preview Download |