Comparative Analysis of Few-Shot Llama-3.1-8B and Fine-Tuned CodeBERT for C++ Vulnerability Detection on Big-Vul
Description
Few-shot prompting has emerged as a practical alternative to fine-tuning for leveraging the capabilities of large language models (LLMs) in specialized tasks. However, its effectiveness depends heavily on the selection and quality of in-context examples, particularly in complex domains. In this work, we examine retrieval-augmented prompting as a strategy to improve few-shot performance in code vulnerability detection, where the goal is to identify one or more security-relevant weaknesses present in a given code snippet from a predefined set of vulnerability categories. We perform a systematic
Research goal: How does few-shot prompting with Llama-3.1-8B compare to fine-tuned CodeBERT on vulnerability detection accuracy for C++ code in the Big-Vul dataset?
Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 8.2/10.
Notes
Files
paper.pdf
Files
(86.5 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:c5202e03f5eb107a377beb1aa7ca0866
|
86.5 kB | Preview Download |