Published July 12, 2024 | Version v1
Conference paper Open

GPT vs. Llama2: Which Comes Closer to Human Writing?

  • 1. Bielefeld University, Germany
  • 2. University of Alberta, Canada

Description

Large Language Models (LLMs) have prompted widespread application across diverse domains. In some applications, human-like quality in output is essential for optimal user experience and credibility. This is particularly evident in applications such as Chatbots. Conversely, concerns arise regarding LLM use in contexts where human authenticity is crucial, notably in higher education with materials like Statements of Purpose and Letters of Recommendation. Despite extensive research in this area, accurately distinguishing between human and LLM-generated content remains challenging. This study conducts a comparative analysis between two leading LLMs, GPT and Llama, evaluating their output's resemblance to human writing through vocabulary and structure analysis. Additionally, we apply classification models to detect human vs. LLM-generated content, with higher accuracy signaling deviations from human-like writing.

Files

2024.EDM-long-papers.9.pdf

Files (384.5 kB)

Name Size Download all
md5:b5a5b269951335b895af84d9e9b94e55
384.5 kB Preview Download