	A	B	C	D	E	F	G	H	I	J	K	L	M	N	O	P	Q	R	S	T	V	W	X	Y	Z	AA	AB	AC	AD	AE	AF	AG	AI	AJ	AK	AL
1						GPT 4 text					Le Chat Mistral					Gemini Advanced
2								Explanation					Explanation					Explanation						GPT4			Le Chat Mistral			Gemini Advanced
3	id	Language	LOC	Type	Error	Detect?	Fix?	Code element	Type of Error	Location	Detect?	Fix?	Code element	Type of Error	Location	Detect?	Fix?	Code element	Type of Error	Location	Error	Type	Count	Detect	Fix	Explanation	Detect	Fix	Explanation	Detect	Fix	Explanation	LLM	Detect	Fix	Explanation

4	1	C++	7	Syntax	Missing semicolon	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Missing semicolon	Syntax	8	8	8	6	7	7	6	5	6	3	GPT4	41/50	44/50	31/41
5	2	C++	11	Syntax	Missing semicolon (2x)	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Partially	Mismatching parentheses	Syntax	7	6	7	6	4	5	3	6	6	6	Le Chat Mistral	28/50	32/50	23/28
6	3	C++	8	Syntax	Mismatching parentheses	No	Yes	No	No	No	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Mismatching brackets	Syntax	5	3	3	3	0	2	0	0	1	0	Gemini Advanced	27/50	35/50	21/27
7	4	C++	8	Syntax	Mismatching parentheses	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	Yes	Yes	Mismatching quotes	Syntax	2	2	2	1	2	2	2	1	1	0
8	5	C++	11	Syntax	Mismatching parentheses	Yes	Yes	Yes	Yes	Yes	No	No	No	No	No	Yes	Yes	Yes	Yes	Yes	Invalid variable name	Syntax	1	1	1	0	1	1	1	1	1	1
9	6	C++	11	Syntax	Mismatching parentheses	Yes	Yes	Yes	Yes	Yes	No	Yes	No	No	No	Yes	Yes	Yes	Yes	Yes	Invalid macro usage	Syntax	1	1	1	1	0	0	0	1	1	0
10	7	C++	10	Syntax	Mismatching brackets	Yes	Yes	Yes	Yes	Yes	No	No	No	No	No	No	No	No	No	No	Illegal character	Syntax	1	1	1	0	1	1	0	1	1	1
11	8	C++	11	Syntax	Mismatching brackets	Yes	Yes	Yes	Yes	Yes	Partially	Yes	No	No	Yes	No	Yes	No	No	No	Variable not declared	Semantic	4	3	4	2	3	3	2	3	3	2
12	9	C++	35	Syntax	Mismatching parentheses	Yes	Yes	Yes	Yes	Yes	No	No	No	No	No	No	No	No	No	No	Type mismatch	Semantic	4	2	3	2	2	3	1	3	4	3
13	10	C++	10	Syntax	Mismatching quotes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	No	Yes	Yes	Yes	Variable out of scope	Semantic	10	7	7	5	4	4	4	2	6	2
14	11	C++	10	Syntax	Invalid variable name (3x)	Yes	Yes	Yes	Yes	Partially	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Function signature mismatch	Semantic	1	1	1	1	1	1	1	1	1	1
15	12	C++	7	Semantic	Variable not declared (2x)	Partially	Yes	Yes	Yes	Partially	Partially	Yes	Yes	Yes	Partially	Yes	Yes	Yes	Yes	Yes	Variable redefinition	Semantic	1	1	1	1	0	0	0	1	1	0
16	13	C++	15	Semantic	Type mismatch	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Dereference of primitive type	Semantic	1	1	1	0	1	1	1	1	1	1
17	14	C++	16	Semantic	Variable out of scope	No	No	No	No	No	No	No	No	No	No	No	Yes	No	No	No	Missing operand	Semantic	1	1	1	0	0	0	0	0	1	0
18	15	C++	12	Semantic	Variable out of scope	Yes	Yes	Yes	No	Yes	No	No	No	No	No	No	Yes	No	No	No	Invalid return type	Semantic	1	1	1	1	1	1	1	1	1	1
19	16	C++	13	Semantic	Variable out of scope	No	No	No	No	No	No	No	No	No	No	No	Yes	No	No	No	Function not defined	Semantic	1	1	1	1	0	0	0	0	0	0
20	17	C++	15	Semantic	Variable out of scope	Yes	Yes	Yes	Yes	Yes	No	No	No	No	No	No	No	No	No	No	Operator not defined	Semantic	1	1	1	1	1	1	1	0	0	0
21	18	C++	41	Semantic	Variable out of scope	Yes	Yes	Yes	Yes	Partially	Yes	Yes	Yes	Yes	Yes	No	No	No	No	No	TOTAL		50	41	44	31	28	32	23	27	35	21
22	19	C++	31	Semantic	Variable out of scope	Yes	Yes	Yes	Yes	Yes	No	No	No	No	No	No	No	No	No	No
23	20	C++	26	Semantic	Variable not declared	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	No	No	No	No	No
24	21	C++	55	Semantic	Function signature mismatch	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
25	22	C++	23	Semantic	Variable out of scope	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
26	23	C++	55	Semantic	Variable out of scope (3x)	No	No	No	No	No	No	No	No	No	No	No	No	No	No	No
27	24	C++	48	Syntax	Missing semicolon (2x)	Yes	Yes	Yes	Partially	Yes	No	No	No	No	No	No	No	No	No	No
28	25	C++	28	Semantic	Variable out of scope	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	No	No	No
29	26	C++	69	Semantic	Variable redefinition	Yes	Yes	Yes	Yes	Yes	No	No	Yes	No	No	Yes	Yes	Yes	No	Yes
30	27	C++	39	Syntax	Missing semicolon	Yes	Yes	Yes	Partially	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
31	28	C++	23	Syntax	Missing semicolon	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes
32	29	C++	29	Syntax	Missing semicolon	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
33	30	C++	18	Syntax	Invalid macro usage	Yes	Yes	Yes	Yes	Yes	No	No	No	No	No	Yes	Yes	Yes	No	Yes
34	31	Java	24	Semantic	Dereference of primitive type	Yes	Yes	Yes	Partially	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
35	32	Java	33	Syntax	Missing semicolon	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	No	No	No	No
36	33	Java	35	Syntax	Missing semicolon	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	No	Yes	No	No	No
37	34	Java	27	Syntax	Illegal character	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	Yes	Yes
38	35	Java	31	Semantic	Variable not declared	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	Yes	Yes
39	36	Java	29	Syntax	Mismatching parentheses	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
40	37	Java	32	Syntax	Mismatching brackets	No	No	No	No	No	No	Yes	No	No	No	No	No	No	No	No
41	38	Java	30	Semantic	Type mismatch	No	No	No	No	No	No	No	No	No	No	No	Yes	No	No	No
42	39	Java	21	Syntax	Mismatching brackets	No	No	No	No	No	No	No	No	No	No	No	No	No	No	No
43	40	Java	55	Semantic	Type mismatch (2x)	Partially	Yes	Yes	Yes	Partially	Partially	Yes	No	Yes	No	Yes	Yes	Yes	Yes	Yes
44	41	C	24	Syntax	Missing operand	Yes	Yes	Yes	No	Yes	No	No	Yes	No	No	No	Yes	No	No	No
45	42	C	25	Syntax	Mismatching brackets	Yes	Yes	Yes	Yes	Yes	No	No	No	No	No	No	No	No	No	No
46	43	C	25	Semantic	Type mismatch	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	No	No	Yes	Yes	Yes	Yes	Yes
47	44	C	23	Semantic	Variable out of scope	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
48	45	C	26	Syntax	Invalid return type	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
49	46	C	15	Semantic	Function not defined	Yes	Yes	Yes	Yes	Yes	No	No	No	No	No	No	No	No	No	No
50	47	C	18	Syntax	Mismatching quotes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	No	Yes
51	48	C	18	Syntax	Mismatching parentheses	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
52	49	C	38	Semantic	Variable not declared	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes
53	50	C	29	Semantic	Operator not defined	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	No	No	No	No