Few-Shot Flamingo vs. Domain-Adapted Models in Adversarial Multimodal Code Vulnerability Detection
Description
This report synthesises findings from 13 peer-reviewed papers addressing the following research question: How does the few-shot accuracy of Flamingo compare to domain-adapted models on multimodal code vulnerability detection benchmarks when subjected to adversarial perturbations in natural language. In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over fine-grained information from millions of tokens of context, including multiple long documents and. 11 claims were extracted from source literature; 11 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 9.3/10. This report is a machine-generated literature synthesis and does not constitute original research.
Research goal: How does the few-shot accuracy of Flamingo compare to domain-adapted models on multimodal code vulnerability detection benchmarks when subjected to adversarial perturbations in natural language descriptions?
Autonomous literature synthesis. Automated review score: 9.3/10. Full text and citation available at Assignee Research.
Notes
Files
paper.pdf
Files
(79.3 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:48d95ddd7aeae2a97fb0b3c48efe1c39
|
79.3 kB | Preview Download |
Additional details
Related works
- Is compiled by
- https://assignee.net (URL)