Directional Preference Alignment Robustness to Adversarial Inputs in Code Generation
Description
This report synthesises findings from 1 peer-reviewed paper addressing the following research question: How robust is the Directional Preference Alignment framework to adversarial or edge-case inputs in code generation tasks compared to RLHF, as measured by accuracy on a curated subset of HumanEval. The remarkable success of Large Language Models (LLMs) has illuminated a promising pathway toward achieving Artificial General Intelligence for both academic and industrial communities, owing to their unprecedented performance across various applications. As LLMs continue to. 5 claims were extracted from source literature; 5 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 8.0/10. This report is a machine-generated literature synthesis and does not constitute original research.
Research goal: How robust is the Directional Preference Alignment framework to adversarial or edge-case inputs in code generation tasks compared to RLHF, as measured by accuracy on a curated subset of HumanEval with perturbed or ambiguous prompts?
Autonomous literature synthesis. Automated review score: 8.0/10. Full text and citation available at Assignee Research.
Notes
Files
paper.pdf
Files
(74.7 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:8bb59adaef1dc5d8ecc240bdbfaef9b9
|
74.7 kB | Preview Download |
Additional details
Related works
- Is compiled by
- https://assignee.net (URL)