Causally Augmented Fine-Tuning for Zero-Shot CLIP Accuracy on DomainNet Versus Standard Approaches
Description
Human motion generation is essential for fields such as animation, robotics, and virtual reality, requiring models that effectively capture motion dynamics from text descriptions. Existing approaches often rely on Contrastive Language-Image Pretraining (CLIP)-based text encoders, but their training on text-image pairs constrains their ability to understand temporal and kinematic structures inherent in motion and motion generation. This work introduces MoCLIP, a fine-tuned CLIP model with an additional motion encoding head, trained on motion sequences using contrastive learning and tethering lo
Research goal: How does causally augmented fine-tuning affect zero-shot accuracy of CLIP on DomainNet compared to standard fine-tuning?
Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 8.5/10.
Notes
Files
paper.pdf
Files
(86.0 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:3e88549888669b1afead34ecfe5e7e77
|
86.0 kB | Preview Download |