Mistral-7B-Instruct-v0.2 vs. Llama-2-7B and Gemma-7B on MathOdyssey Algebra Benchmarks
Description
This report synthesises findings from 1 peer-reviewed paper addressing the following research question: How does Mistral-7B-Instruct-v0.2 perform on the MathOdyssey dataset compared to Llama-2-7B and Gemma-7B in terms of exact match accuracy on university-level algebra problems. 9 claims were extracted from source literature; 9 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 9.2/10. This report is a machine-generated literature synthesis and does not constitute original research.
Research goal: How does Mistral-7B-Instruct-v0.2 perform on the MathOdyssey dataset compared to Llama-2-7B and Gemma-7B in terms of exact match accuracy on university-level algebra problems?
Autonomous literature synthesis. Automated review score: 9.2/10. Full text and citation available at Assignee Research.
Notes
Files
paper.pdf
Additional details
Related works
- Is compiled by
- https://assignee.net (URL)