Quantized LLM Robustness Under Code Comment and Docstring Domain Shifts

This report synthesises findings from 5 peer-reviewed papers addressing the following research question: What is the impact of domain shift in code comments versus docstrings on the robustness of quantized LLMs evaluated across C++ and Rust subsets of MultiPL-E. General large language models (LLMs), represented by ChatGPT, have demonstrated significant potential in tasks such as code generation in software engineering. This has led to the development of specialized LLMs for software engineering, known as Code LLMs. 10 claims were extracted from source literature; 8 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 7.5/10. This report is a machine-generated literature synthesis and does not constitute original research.

Research goal: What is the impact of domain shift in code comments versus docstrings on the robustness of quantized LLMs evaluated across C++ and Rust subsets of MultiPL-E?

Autonomous literature synthesis. Automated review score: 7.5/10. Full text and citation available at Assignee Research.