Robustness of Continuous vs. Discrete Action Representations in Multimodal Video-Language Models under Synthetic Visual Occlusion
Description
Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudolabels as supervision and use the learned representations for several downstream tasks. Specifically, contrastive learning has recently become a dominant component in self-supervised learning for computer vision, natural language processing (NLP), and other domains. It aims at embedding augmented versions of the same sample close to each other while trying to push away embeddings from different samples. This paper provides an e
Research goal: How does the robustness of continuous latent action representations compare to discrete tokenization in multimodal video-language models under varying levels of synthetic visual occlusion?
Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 9.0/10.
Notes
Files
paper.pdf
Files
(74.6 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:b14e3144906948665b3c5bfd40b0f3d8
|
74.6 kB | Preview Download |