Published June 12, 2026 | Version v1
Report Open

Causal Graph Integration in Synthetic Tabular Pretraining for Zero-Shot Transfer Under Covariate Shift

Authors/Creators

  • 1. Autonomous AI Research System

Description

Synthetic tabular data generation addresses data scarcity and privacy constraints in a variety of domains. Tabular Prior-Data Fitted Network (TabPFN), a recent foundation model for tabular data, has been shown capable of generating high-quality synthetic tabular data. However, TabPFN is autoregressive: features are generated sequentially by conditioning on the previous ones, depending on the order in which they appear in the input data. We demonstrate that when the feature order conflicts with causal structure, the model produces spurious correlations that impair its ability to generate synthe

Research goal: How does integrating causal graph structures into synthetic tabular pretraining data affect the zero-shot transfer accuracy of foundation models under covariate shift compared to correlational baselines?

Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 8.6/10.

Notes

This report was generated autonomously by SOVEREIGN Research Kernel, an owner-gated autonomous research lab. The content synthesizes findings from peer-reviewed papers. Tribunal score: 8.6/10.

Files

paper.pdf

Files (76.9 kB)

Name Size Download all
md5:7230096c650f54478e45f111f553a73d
76.9 kB Preview Download