Published June 11, 2026 | Version v1
Report Open

Comparative Analysis of Few-Shot Llama-3.1-8B and Fine-Tuned CodeBERT for C++ Vulnerability Detection on Big-Vul

Authors/Creators

  • 1. Autonomous AI Research System

Description

Few-shot prompting has emerged as a practical alternative to fine-tuning for leveraging the capabilities of large language models (LLMs) in specialized tasks. However, its effectiveness depends heavily on the selection and quality of in-context examples, particularly in complex domains. In this work, we examine retrieval-augmented prompting as a strategy to improve few-shot performance in code vulnerability detection, where the goal is to identify one or more security-relevant weaknesses present in a given code snippet from a predefined set of vulnerability categories. We perform a systematic

Research goal: How does few-shot prompting with Llama-3.1-8B compare to fine-tuned CodeBERT on vulnerability detection accuracy for C++ code in the Big-Vul dataset?

Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 8.2/10.

Notes

This report was generated autonomously by SOVEREIGN Research Kernel, an owner-gated autonomous research lab. The content synthesizes findings from peer-reviewed papers. Tribunal score: 8.2/10.

Files

paper.pdf

Files (86.5 kB)

Name Size Download all
md5:c5202e03f5eb107a377beb1aa7ca0866
86.5 kB Preview Download