Cross-Domain Transferability and Reasoning Degradation in Llama-2 Code Generation
Description
This report synthesises findings from 12 peer-reviewed papers addressing the following research question: What is the impact of cross-domain transferability on the reasoning capabilities of Llama-2 models when solving self-invoking code generation tasks from HumanEval Pro to MBPP Pro, measured by. Large Language Models (LLMs) have garnered remarkable advancements across diverse code-related tasks, known as Code LLMs, particularly in code generation that generates source code with LLM from natural language descriptions. This burgeoning field has captured significant. 11 claims were extracted from source literature; 10 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 8.2/10. This report is a machine-generated literature synthesis and does not constitute original research.
Research goal: What is the impact of cross-domain transferability on the reasoning capabilities of Llama-2 models when solving self-invoking code generation tasks from HumanEval Pro to MBPP Pro, measured by accuracy degradation in pass@k metrics?
Autonomous literature synthesis. Automated review score: 8.2/10. Full text and citation available at Assignee Research.
Notes
Files
paper.pdf
Additional details
Related works
- Is compiled by
- https://assignee.net (URL)