Causal Mixture of Experts with LoRA for Low-Resource Tabular Learning
Description
Generative models have revolutionized multiple domains, yet their application to tabular data remains underexplored. Evaluating generative models for tabular data presents unique challenges due to structural complexity, large-scale variability, and mixed data types, making it difficult to intuitively capture intricate patterns. Existing evaluation metrics offer only partial insights, lacking a comprehensive measure of generative performance. To address this limitation, we propose three novel evaluation metrics: FAED, FPCAD, and RFIS. Our extensive experimental analysis, conducted on three stan
Research goal: How does integrating causal mixture of experts with LoRA affect convergence speed and final accuracy on low-resource tabular benchmarks like TabM3 compared to standard AdaFT?
Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 8.3/10.
Notes
Files
paper.pdf
Files
(75.5 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:7c33f46857dd23ddb201565d70985415
|
75.5 kB | Preview Download |