INFO:exp_v4_5_fixup:Loaded 7488 results from v4_5_scaling_latest.json
INFO:exp_v4_5_fixup:Judge-error results (re-judge only): 2900
INFO:exp_v4_5_fixup:Empty answers (regenerate + re-judge): 0
INFO:exp_v4_5_fixup:  Re-judge by index: {'exp_v4_s10_n0': 79, 'exp_v4_s10_n1': 99, 'exp_v4_s10_n3': 228, 'exp_v4_s50_n0': 750, 'exp_v4_s50_n1': 750, 'exp_v4_s50_n3': 750, 'exp_v4_s5_n0': 72, 'exp_v4_s5_n1': 87, 'exp_v4_s5_n3': 85}
INFO:exp_v4_5_fixup:  Regen by index:    {}
INFO:exp_v4_5_fixup:  Regen by config:   {}
INFO:exp_v4_5_fixup:
============================================================
INFO:exp_v4_5_fixup:Phase 1: Re-judging 2900 results
INFO:exp_v4_5_fixup:============================================================
INFO:exp_v4_5_fixup:  Re-judged single_pass|OOD_042 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged single_pass|OOD_044 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged single_pass|OOD_049 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_002 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_003 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_004 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_005 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_007 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_009 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_010 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_014 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_015 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_017 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_018 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_020 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_021 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_023 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_025 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_030 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_031 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_034 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_035 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_036 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_039 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_040 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_042 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_043 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_044 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_045 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_046 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_047 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_048 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_049 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_5|01_sarek_CO2 -> corr=2
INFO:exp_v4_5_fixup:  Re-judged rlm_5|CD_003 -> corr=3
INFO:exp_v4_5_fixup:  Re-judged rlm_5|OOD_003 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_5|OOD_006 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_5|OOD_008 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_5|OOD_012 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_5|OOD_014 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_5|OOD_015 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_5|OOD_038 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_5|OOD_039 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_5|OOD_041 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_5|OOD_044 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_5|OOD_049 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_10|04_fastp_CO2 -> corr=3
INFO:exp_v4_5_fixup:  Re-judged rlm_10|CD_004 -> corr=2
INFO:exp_v4_5_fixup:  Re-judged rlm_10|OOD_011 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_10|OOD_017 -> corr=n/a
INFO:exp_v4_5_fixup:  [50/2900] fixed=50, failed=0
INFO:exp_v4_5_fixup:  Re-judged rlm_10|OOD_021 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_10|OOD_031 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_10|OOD_044 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_10|OOD_045 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_10|OOD_046 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_10|OOD_049 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_10|OOD_050 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_20|OOD_001 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_20|OOD_010 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_20|OOD_011 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_20|OOD_019 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_20|OOD_032 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_20|OOD_041 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_20|OOD_042 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_20|OOD_044 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_20|OOD_045 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_20|OOD_048 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged rlm_20|OOD_049 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged verified_pass|01_sarek_CO2 -> corr=4
INFO:exp_v4_5_fixup:  Re-judged verified_pass|OOD_042 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged verified_pass|OOD_044 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged verified_pass|OOD_049 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged single_pass|OOD_042 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged single_pass|OOD_044 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged single_pass|OOD_049 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_001 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_004 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_005 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_006 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_007 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_008 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_009 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_010 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_011 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_013 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_016 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_017 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_018 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_023 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_024 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_026 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_027 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_029 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_031 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_033 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_034 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_037 -> corr=n/a
INFO:exp_v4_5_fixup:  Re-judged multi_hop|OOD_039 -> corr=n/a
