Published July 12, 2024
| Version v1
Conference paper
Open
GPT vs. Llama2: Which Comes Closer to Human Writing?
Contributors
Editors:
- 1. Bielefeld University, Germany
- 2. University of Alberta, Canada
Description
Large Language Models (LLMs) have prompted widespread application across diverse domains. In some applications, human-like quality in output is essential for optimal user experience and credibility. This is particularly evident in applications such as Chatbots. Conversely, concerns arise regarding LLM use in contexts where human authenticity is crucial, notably in higher education with materials like Statements of Purpose and Letters of Recommendation. Despite extensive research in this area, accurately distinguishing between human and LLM-generated content remains challenging. This study conducts a comparative analysis between two leading LLMs, GPT and Llama, evaluating their output's resemblance to human writing through vocabulary and structure analysis. Additionally, we apply classification models to detect human vs. LLM-generated content, with higher accuracy signaling deviations from human-like writing.
Files
2024.EDM-long-papers.9.pdf
Files
(384.5 kB)
Name | Size | Download all |
---|---|---|
md5:b5a5b269951335b895af84d9e9b94e55
|
384.5 kB | Preview Download |