Published May 31, 2025 | Version v1
Report Open

AI Contest: ChatGPT vs Tabnine – A Comparative Study on Programming Assistance

  • 1. ROR icon Lakehead University

Description

This report presents a systematic comparison of two AI-powered programming tools—ChatGPT and Tabnine—in the context of competitive programming. Using problems from the 2024 USACO, the study evaluates each model's capabilities across metrics such as code accuracy, completeness, efficiency, and user experience. ChatGPT, known for its conversational and reasoning skills, is compared against Tabnine, a lightweight IDE-integrated tool known for code autocompletion. While ChatGPT demonstrated higher overall correctness in problem-solving, Tabnine showed strength in syntactically accurate code generation. This work highlights the trade-offs between full-solution LLMs and inline assistants and provides insights for students, educators, and developers on selecting the right AI tool for specific programming needs.

 

Files

AI-Contest.pdf

Files (386.0 kB)

Name Size Download all
md5:8806633d544c16611940b972c0230f0b
386.0 kB Preview Download

Additional details

Software

Repository URL
https://github.com/hassannx/AI-Contest---ChatGPT-vs-Tabnine.git
Programming language
Python
Development Status
Active