Repo: parlai
Filename: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/projects/parlai/tests/test_transformers.py
ClassName: TestTransformerGenerator
Testname: test_beamsearch
Params: learning_rate,289,29,ParamType.LR,0.007
epoch,291,27,ParamType.ITER,10
batchsize,290,26,ParamType.CHAINS,32
Assertion: self.assertGreaterEqual(test['bleu-4'], 0.90)
Original runtime: 14.676
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_0.007_10_32
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 11...
Iter 10...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.442666666666666, Max: 16.39, Min: 9.620000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1357808433158403
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.075166666666666, Max: 18.9, Min: 9.459999999999999
Passed tests : 60
Failed tests : 0
Converged: True
Convergence score: 0.532446660511777
Evaluating 60 values out of 60
Overall-timings: Avg: 11.075166666666666, Max: 18.9, Min: 9.459999999999999
Choosing distribution: gumbel_l
Probability of fail (non-zero): 8.059146412522857e-05
All-Passed: True
Probabilty of failure: 8.059146412522857e-05
Runtime: 11.075166666666666
Score: 11.075166666666666
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
>>Setting original runtime to 11.075166666666666
Optimization Iteration: 1
Running with params: {'batchsize': 4, 'epoch': 7, 'learning_rate': 0.09895783223188444}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_7_0.09895783223188444
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 79.488, Max: 157.32, Min: 59.29
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 2
Running with params: {'batchsize': 64, 'epoch': 5, 'learning_rate': 0.04708033920277139}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_64_5_0.04708033920277139
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 45.605666666666664, Max: 158.72, Min: 14.920000000000002
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 3
Running with params: {'batchsize': 128, 'epoch': 1, 'learning_rate': 6.962472219992788e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_128_1_6.962472219992788e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 243.32699999999997, Max: 300.43, Min: 157.58
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 4
Running with params: {'batchsize': 256, 'epoch': 7, 'learning_rate': 0.3833336538890539}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_256_7_0.3833336538890539
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 4...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 189.87099999999998, Max: 300.44, Min: 76.03999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 5
Running with params: {'batchsize': 16, 'epoch': 5, 'learning_rate': 4.945105072153201e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_16_5_4.945105072153201e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 288.83200000000005, Max: 300.58000000000004, Min: 166.85999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 6
Running with params: {'batchsize': 128, 'epoch': 9, 'learning_rate': 0.0031665862458812913}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_128_9_0.0031665862458812913
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 93.35366666666665, Max: 117.2, Min: 49.86
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 7
Running with params: {'batchsize': 4, 'epoch': 3, 'learning_rate': 5.623226392897361e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_3_5.623226392897361e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 300.53133333333324, Max: 300.58000000000004, Min: 300.33
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 8
Running with params: {'batchsize': 64, 'epoch': 6, 'learning_rate': 0.22580190727460187}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_64_6_0.22580190727460187
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 25.572999999999997, Max: 105.42, Min: 14.43
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 9
Running with params: {'batchsize': 2, 'epoch': 7, 'learning_rate': 0.00018828298389534653}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_7_0.00018828298389534653
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 132.09233333333333, Max: 170.51000000000002, Min: 114.52
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 10
Running with params: {'batchsize': 128, 'epoch': 1, 'learning_rate': 0.0015423559270216253}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_128_1_0.0015423559270216253
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 5...
Iter 4...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 285.204, Max: 300.55, Min: 224.11
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 11
Running with params: {'batchsize': 2, 'epoch': 6, 'learning_rate': 0.0005580067499079597}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_6_0.0005580067499079597
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 79.932, Max: 103.59, Min: 34.75
Passed tests : 11
Failed tests : 19
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 12
Running with params: {'batchsize': 64, 'epoch': 3, 'learning_rate': 0.00590121371812516}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_64_3_0.00590121371812516
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 59.04066666666667, Max: 100.19, Min: 15.54
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 13
Running with params: {'batchsize': 256, 'epoch': 3, 'learning_rate': 2.1382941260367144e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_256_3_2.1382941260367144e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 27...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 248.15133333333335, Max: 300.43, Min: 144.89
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 14
Running with params: {'batchsize': 256, 'epoch': 2, 'learning_rate': 5.230395386675862e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_256_2_5.230395386675862e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 222.10199999999998, Max: 300.45, Min: 113.48
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 15
Running with params: {'batchsize': 64, 'epoch': 2, 'learning_rate': 0.27749376228016437}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_64_2_0.27749376228016437
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 101.76833333333333, Max: 286.55, Min: 11.43
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 16
Running with params: {'batchsize': 2, 'epoch': 3, 'learning_rate': 0.06744557355388357}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_3_0.06744557355388357
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 70.87233333333333, Max: 145.95, Min: 53.36
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 17
Running with params: {'batchsize': 32, 'epoch': 3, 'learning_rate': 0.0009464732413111309}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_32_3_0.0009464732413111309
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 86.87366666666667, Max: 188.82, Min: 20.86
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 18
Running with params: {'batchsize': 32, 'epoch': 7, 'learning_rate': 0.007181005963806194}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_32_7_0.007181005963806194
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.366333333333333, Max: 21.66, Min: 8.39
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.6369467897727943
Exceeding current best timeout: 12.366333333333333 > 11.075166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 19
Running with params: {'batchsize': 64, 'epoch': 8, 'learning_rate': 0.005173375071405977}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_64_8_0.005173375071405977
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.440000000000001, Max: 21.01, Min: 8.39
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 2.0952908873087375
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.957666666666666, Max: 22.13, Min: 8.39
Passed tests : 54
Failed tests : 6
Converged: True
Convergence score: 0.8650498848776007
Evaluating 54 values out of 60
Overall-timings: Avg: 11.957666666666666, Max: 22.13, Min: 8.39
Choosing distribution: cauchy
Probability of fail (non-zero): 0.030098590018503568
Exceeding max probability of failure: 0.030098590018503568
All-Passed: False
Probabilty of failure: 0.030098590018503568
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 20
Running with params: {'batchsize': 4, 'epoch': 3, 'learning_rate': 0.010163335544702922}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_3_0.010163335544702922
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Iter 26...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.501666666666663, Max: 21.080000000000002, Min: 8.44
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.423839928708162
Exceeding current best timeout: 12.501666666666663 > 11.075166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 21
Running with params: {'batchsize': 8, 'epoch': 10, 'learning_rate': 0.04122272200750814}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_8_10_0.04122272200750814
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 13.129, Max: 26.439999999999998, Min: 8.41
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 1.7979289843940254
Exceeding current best timeout: 13.129 > 11.075166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 22
Running with params: {'batchsize': 4, 'epoch': 9, 'learning_rate': 0.025354854175588776}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_9_0.025354854175588776
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.734, Max: 23.68, Min: 8.34
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 8.310312136451273
Exceeding current best timeout: 12.734 > 11.075166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 23
Running with params: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.9330527626431209}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_2_0.9330527626431209
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.594666666666665, Max: 22.6, Min: 8.49
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 3.5454573079411817
Exceeding current best timeout: 12.594666666666665 > 11.075166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 24
Running with params: {'batchsize': 8, 'epoch': 10, 'learning_rate': 0.10645085334434173}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_8_10_0.10645085334434173
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.925666666666668, Max: 22.9, Min: 8.28
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 4.218565668126578
Exceeding current best timeout: 12.925666666666668 > 11.075166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 25
Running with params: {'batchsize': 4, 'epoch': 4, 'learning_rate': 0.018698808685600407}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_4_0.018698808685600407
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 13.066999999999998, Max: 29.53, Min: 8.39
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.913724796611216
Exceeding current best timeout: 13.066999999999998 > 11.075166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 11.075166666666666
Best-param: {'learning_rate': 0.007, 'epoch': 10, 'batchsize': 32}
Optimization Iteration: 26
Running with params: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_2_0.8886088965465745
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Timings: Avg: 10.427333333333332, Max: 17.770000000000003, Min: 8.47
Passed tests : 29
Failed tests : 1
Converged: True
Convergence score: 0.6034604113283387
Evaluating 29 values out of 30
Overall-timings: Avg: 10.427333333333332, Max: 17.770000000000003, Min: 8.47
Choosing distribution: laplace
Probability of fail (non-zero): 0.003194290881314204
All-Passed: True
Probabilty of failure: 0.003194290881314204
Runtime: 10.427333333333332
Score: 10.427333333333332
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 27
Running with params: {'batchsize': 8, 'epoch': 1, 'learning_rate': 0.519824667926478}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_8_1_0.519824667926478
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.245333333333333, Max: 19.46, Min: 8.4
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 1.6678156958735875
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.183833333333334, Max: 19.46, Min: 8.4
Passed tests : 49
Failed tests : 11
Converged: False
Convergence score: 1.7806870570047715
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.638444444444447, Max: 20.56, Min: 8.4
Passed tests : 72
Failed tests : 18
Converged: True
Convergence score: 0.8430660414728295
Evaluating 73 values out of 90
Overall-timings: Avg: 11.638444444444447, Max: 20.56, Min: 8.4
Choosing distribution: dweibull
Probability of fail (non-zero): 0.030950128738627264
Exceeding max probability of failure: 0.030950128738627264
All-Passed: False
Probabilty of failure: 0.030950128738627264
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 28
Running with params: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8277443502165934}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_2_0.8277443502165934
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.410000000000002, Max: 18.93, Min: 8.459999999999999
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 1.0984369379093666
Exceeding current best timeout: 12.410000000000002 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 29
Running with params: {'batchsize': 16, 'epoch': 4, 'learning_rate': 0.12016642923431786}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_16_4_0.12016642923431786
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.97966666666667, Max: 21.849999999999998, Min: 8.35
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 5.8888888888888955
Exceeding current best timeout: 11.97966666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 30
Running with params: {'batchsize': 4, 'epoch': 1, 'learning_rate': 0.15942675496535091}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_1_0.15942675496535091
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Timings: Avg: 11.905666666666667, Max: 21.060000000000002, Min: 8.37
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.052513414467262
Exceeding current best timeout: 11.905666666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 31
Running with params: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8422267313516606}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_2_0.8422267313516606
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.828666666666663, Max: 20.7, Min: 8.44
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 4.8547009405316395
Exceeding current best timeout: 11.828666666666663 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 32
Running with params: {'batchsize': 32, 'epoch': 1, 'learning_rate': 0.017451375853199953}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_32_1_0.017451375853199953
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Not found ::: 
Timings: Avg: 11.570666666666666, Max: 22.75, Min: 8.55
Passed tests : 27
Failed tests : 3
Converged: True
Convergence score: 0.8397463127555955
Evaluating 29 values out of 30
Overall-timings: Avg: 11.570666666666666, Max: 22.75, Min: 8.55
Choosing distribution: cauchy
Probability of fail (non-zero): 0.045358088383554485
Exceeding max probability of failure: 0.045358088383554485
All-Passed: False
Probabilty of failure: 0.045358088383554485
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 33
Running with params: {'batchsize': 16, 'epoch': 4, 'learning_rate': 0.04550360984950702}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_16_4_0.04550360984950702
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.914666666666669, Max: 19.52, Min: 8.41
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 4.47213595499958
Exceeding current best timeout: 11.914666666666669 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 34
Running with params: {'batchsize': 4, 'epoch': 1, 'learning_rate': 0.44543679820832166}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_1_0.44543679820832166
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 11.06, Max: 31.48, Min: 8.4
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.0787197799411836
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.3585, Max: 31.48, Min: 8.4
Passed tests : 52
Failed tests : 8
Converged: True
Convergence score: 0.7769938091280595
Evaluating 54 values out of 60
Overall-timings: Avg: 11.3585, Max: 31.48, Min: 8.4
Choosing distribution: laplace
Probability of fail (non-zero): 0.008215817886269435
All-Passed: True
Probabilty of failure: 0.008215817886269435
Runtime: 11.3585
Score: 11.3585
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 35
Running with params: {'batchsize': 4, 'epoch': 1, 'learning_rate': 0.45646815396742935}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_1_0.45646815396742935
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.194333333333333, Max: 22.74, Min: 8.45
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 3.8327319270849443
Exceeding current best timeout: 14.194333333333333 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 36
Running with params: {'batchsize': 128, 'epoch': 1, 'learning_rate': 1.1503889943493349e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_128_1_1.1503889943493349e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.747666666666666, Max: 19.2, Min: 8.44
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 1.4021363680319516
Exceeding current best timeout: 11.747666666666666 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 37
Running with params: {'batchsize': 4, 'epoch': 1, 'learning_rate': 0.23506710135856373}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_1_0.23506710135856373
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.203666666666667, Max: 18.5, Min: 8.29
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 4.04303770031319
Exceeding current best timeout: 12.203666666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 38
Running with params: {'batchsize': 256, 'epoch': 2, 'learning_rate': 0.00028818839454822383}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_256_2_0.00028818839454822383
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.160333333333332, Max: 33.86, Min: 8.46
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 3.6816376037769634
Exceeding current best timeout: 14.160333333333332 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 39
Running with params: {'batchsize': 16, 'epoch': 1, 'learning_rate': 0.0021742910932642493}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_16_1_0.0021742910932642493
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 4...
Iter 3...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.916333333333334, Max: 28.28, Min: 8.36
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.3863778119630967
Exceeding current best timeout: 12.916333333333334 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 40
Running with params: {'batchsize': 128, 'epoch': 1, 'learning_rate': 0.07259757766668415}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_128_1_0.07259757766668415
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 10.942000000000002, Max: 20.099999999999998, Min: 8.4
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.4258416642453604
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Timings: Avg: 11.459333333333337, Max: 20.099999999999998, Min: 8.38
Passed tests : 55
Failed tests : 5
Converged: True
Convergence score: 0.8893978660075851
Evaluating 55 values out of 60
Overall-timings: Avg: 11.459333333333337, Max: 20.099999999999998, Min: 8.38
Choosing distribution: cauchy
Probability of fail (non-zero): 0.038094721663509246
Exceeding max probability of failure: 0.038094721663509246
All-Passed: False
Probabilty of failure: 0.038094721663509246
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 41
Running with params: {'batchsize': 2, 'epoch': 2, 'learning_rate': 0.5898970820809861}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_2_0.5898970820809861
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.000666666666667, Max: 21.11, Min: 8.44
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 3.0344717549042657
Exceeding current best timeout: 12.000666666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 42
Running with params: {'batchsize': 4, 'epoch': 1, 'learning_rate': 0.00011637182245330793}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_1_0.00011637182245330793
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.94533333333333, Max: 26.759999999999998, Min: 8.44
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.0038373076033609
Exceeding current best timeout: 12.94533333333333 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 43
Running with params: {'batchsize': 4, 'epoch': 1, 'learning_rate': 0.3079239450631312}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_1_0.3079239450631312
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 13.276333333333334, Max: 30.910000000000004, Min: 8.45
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.082078659991438
Exceeding current best timeout: 13.276333333333334 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 44
Running with params: {'batchsize': 256, 'epoch': 2, 'learning_rate': 0.16003594988897896}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_256_2_0.16003594988897896
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.736333333333334, Max: 25.61, Min: 8.370000000000001
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 1.4922162511639607
Exceeding current best timeout: 12.736333333333334 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 45
Running with params: {'batchsize': 32, 'epoch': 5, 'learning_rate': 0.0032251724407105047}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_32_5_0.0032251724407105047
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.022666666666668, Max: 22.58, Min: 8.459999999999999
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 4.395493692999094
Exceeding current best timeout: 12.022666666666668 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 46
Running with params: {'batchsize': 2, 'epoch': 1, 'learning_rate': 0.0007649874510760826}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_1_0.0007649874510760826
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.372666666666666, Max: 20.64, Min: 8.37
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.3320779383041603
Exceeding current best timeout: 12.372666666666666 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 47
Running with params: {'batchsize': 64, 'epoch': 2, 'learning_rate': 0.02800484200037557}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_64_2_0.02800484200037557
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.108666666666666, Max: 20.34, Min: 8.479999999999999
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.627734037971745
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.952166666666669, Max: 28.61, Min: 8.479999999999999
Passed tests : 51
Failed tests : 9
Converged: False
Convergence score: 1.3241169484290707
Exceeding current best timeout: 11.952166666666669 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 48
Running with params: {'batchsize': 128, 'epoch': 1, 'learning_rate': 0.013474282915042938}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_128_1_0.013474282915042938
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.235333333333333, Max: 31.26, Min: 8.27
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 1.7663889351243838
Exceeding current best timeout: 14.235333333333333 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 49
Running with params: {'batchsize': 8, 'epoch': 1, 'learning_rate': 0.07886853820655919}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_8_1_0.07886853820655919
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.499333333333334, Max: 22.73, Min: 8.42
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 1.0259204829308979
Exceeding current best timeout: 12.499333333333334 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 50
Running with params: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.19698155057905578}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_2_0.19698155057905578
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.175, Max: 25.79, Min: 8.45
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 1.1313296932536272
Exceeding current best timeout: 12.175 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Upto iteration 50: {'batchsize': 1, 'epoch': 2.0, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 51
Running with params: {'batchsize': 16, 'epoch': 1, 'learning_rate': 0.9723283901741298}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_16_1_0.9723283901741298
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.950333333333337, Max: 26.52, Min: 8.35
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 15.890835355545327
Exceeding current best timeout: 12.950333333333337 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 52
Running with params: {'batchsize': 256, 'epoch': 3, 'learning_rate': 0.47163480579953326}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_256_3_0.47163480579953326
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Timings: Avg: 10.835000000000003, Max: 16.24, Min: 8.46
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 6.963136179520357
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.870333333333333, Max: 24.57, Min: 8.46
Passed tests : 52
Failed tests : 8
Converged: True
Convergence score: 0.7573861744588297
Evaluating 53 values out of 60
Overall-timings: Avg: 11.870333333333333, Max: 24.57, Min: 8.46
Choosing distribution: t
Probability of fail (non-zero): 0.026669165711118603
Exceeding max probability of failure: 0.026669165711118603
All-Passed: False
Probabilty of failure: 0.026669165711118603
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 53
Running with params: {'batchsize': 64, 'epoch': 2, 'learning_rate': 2.678159840828596e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_64_2_2.678159840828596e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.059999999999997, Max: 21.43, Min: 8.46
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.6258049414192004
Exceeding current best timeout: 12.059999999999997 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 54
Running with params: {'batchsize': 4, 'epoch': 5, 'learning_rate': 0.00041836051635242734}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_5_0.00041836051635242734
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.880000000000003, Max: 21.47, Min: 8.459999999999999
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.9117003009789575
Exceeding current best timeout: 11.880000000000003 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 55
Running with params: {'batchsize': 32, 'epoch': 1, 'learning_rate': 0.034241572841058464}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_32_1_0.034241572841058464
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 13.178666666666667, Max: 19.200000000000003, Min: 8.36
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 5.14736950723732
Exceeding current best timeout: 13.178666666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 56
Running with params: {'batchsize': 2, 'epoch': 2, 'learning_rate': 0.008052298703996269}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_2_0.008052298703996269
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Timings: Avg: 11.496666666666668, Max: 22.75, Min: 8.41
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.3699380810266708
Exceeding current best timeout: 11.496666666666668 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 57
Running with params: {'batchsize': 4, 'epoch': 6, 'learning_rate': 9.292069832257927e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_6_9.292069832257927e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.708333333333332, Max: 18.48, Min: 8.46
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 5.938965868728752
Exceeding current best timeout: 11.708333333333332 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 58
Running with params: {'batchsize': 8, 'epoch': 3, 'learning_rate': 0.35935778920124556}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_8_3_0.35935778920124556
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Not found ::: 
Not found ::: 
Timings: Avg: 11.419999999999998, Max: 19.229999999999997, Min: 8.43
Passed tests : 27
Failed tests : 3
Converged: True
Convergence score: 0.9218253795740178
Evaluating 28 values out of 30
Overall-timings: Avg: 11.419999999999998, Max: 19.229999999999997, Min: 8.43
Choosing distribution: cauchy
Probability of fail (non-zero): 0.04213799531086404
Exceeding max probability of failure: 0.04213799531086404
All-Passed: False
Probabilty of failure: 0.04213799531086404
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 59
Running with params: {'batchsize': 128, 'epoch': 1, 'learning_rate': 0.0013902989393754634}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_128_1_0.0013902989393754634
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.350000000000001, Max: 18.07, Min: 8.34
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.2587655622635754
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.889500000000002, Max: 42.970000000000006, Min: 8.33
Passed tests : 54
Failed tests : 6
Converged: False
Convergence score: 1.1104460837210337
Exceeding current best timeout: 11.889500000000002 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 60
Running with params: {'batchsize': 4, 'epoch': 4, 'learning_rate': 0.00415846509864509}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_4_0.00415846509864509
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 7...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Timings: Avg: 11.615, Max: 24.05, Min: 8.42
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 3.546240804159383
Exceeding current best timeout: 11.615 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 61
Running with params: {'batchsize': 64, 'epoch': 2, 'learning_rate': 0.06268028353060487}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_64_2_0.06268028353060487
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 11.110333333333331, Max: 18.06, Min: 8.41
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.5682267114246147
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.057999999999998, Max: 27.799999999999997, Min: 8.41
Passed tests : 50
Failed tests : 10
Converged: False
Convergence score: 2.6058907759471475
Exceeding current best timeout: 12.057999999999998 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 62
Running with params: {'batchsize': 4, 'epoch': 1, 'learning_rate': 0.7112046183512037}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_1_0.7112046183512037
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.399666666666667, Max: 19.58, Min: 8.39
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.7646918948607742
Exceeding current best timeout: 12.399666666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 63
Running with params: {'batchsize': 16, 'epoch': 3, 'learning_rate': 0.11016432741622786}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_16_3_0.11016432741622786
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.426333333333332, Max: 26.89, Min: 8.38
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.0399828103435413
Exceeding current best timeout: 12.426333333333332 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 64
Running with params: {'batchsize': 256, 'epoch': 1, 'learning_rate': 0.14895054616421893}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_256_1_0.14895054616421893
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 13.050333333333333, Max: 21.979999999999997, Min: 8.5
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 4.389381125701738
Exceeding current best timeout: 13.050333333333333 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 65
Running with params: {'batchsize': 32, 'epoch': 2, 'learning_rate': 0.019582921184373176}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_32_2_0.019582921184373176
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 6...
Iter 5...
Iter 4...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 15...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.850666666666667, Max: 25.869999999999997, Min: 8.19
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.6872824647588083
Exceeding current best timeout: 11.850666666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 66
Running with params: {'batchsize': 128, 'epoch': 1, 'learning_rate': 3.853288475374719e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_128_1_3.853288475374719e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.750333333333332, Max: 18.91, Min: 8.370000000000001
Passed tests : 24
Failed tests : 6
Converged: True
Convergence score: 0.9170109546287274
Evaluating 26 values out of 30
Overall-timings: Avg: 11.750333333333332, Max: 18.91, Min: 8.370000000000001
Choosing distribution: cauchy
Probability of fail (non-zero): 0.061500670250776435
Exceeding max probability of failure: 0.061500670250776435
All-Passed: False
Probabilty of failure: 0.061500670250776435
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 67
Running with params: {'batchsize': 128, 'epoch': 1, 'learning_rate': 1.029486127405797e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_128_1_1.029486127405797e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 13.241333333333332, Max: 21.57, Min: 8.3
Passed tests : 19
Failed tests : 11
Converged: False
Convergence score: 1.2722833945199596
Exceeding current best timeout: 13.241333333333332 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 68
Running with params: {'batchsize': 4, 'epoch': 1, 'learning_rate': 0.22004157496301538}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_1_0.22004157496301538
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.549333333333331, Max: 16.330000000000002, Min: 8.559999999999999
Passed tests : 25
Failed tests : 5
Converged: True
Convergence score: 0.9875752880105205
Evaluating 26 values out of 30
Overall-timings: Avg: 11.549333333333331, Max: 16.330000000000002, Min: 8.559999999999999
Choosing distribution: t
Probability of fail (non-zero): 0.029498431591851577
Exceeding max probability of failure: 0.029498431591851577
All-Passed: False
Probabilty of failure: 0.029498431591851577
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 69
Running with params: {'batchsize': 4, 'epoch': 1, 'learning_rate': 0.24931849234257727}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_1_0.24931849234257727
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.82933333333333, Max: 25.07, Min: 8.44
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.4911039412528522
Exceeding current best timeout: 12.82933333333333 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 70
Running with params: {'batchsize': 256, 'epoch': 2, 'learning_rate': 0.0002741065509350678}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_256_2_0.0002741065509350678
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.799999999999999, Max: 22.93, Min: 8.440000000000001
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.5202876398427243
Exceeding current best timeout: 11.799999999999999 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 71
Running with params: {'batchsize': 16, 'epoch': 1, 'learning_rate': 0.002079078296071459}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_16_1_0.002079078296071459
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 13.030666666666667, Max: 30.0, Min: 8.32
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 8.4928274236004
Exceeding current best timeout: 13.030666666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 72
Running with params: {'batchsize': 4, 'epoch': 7, 'learning_rate': 0.6946317003212351}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_7_0.6946317003212351
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.855666666666666, Max: 23.48, Min: 8.37
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 1.7977818845548243
Exceeding current best timeout: 12.855666666666666 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 73
Running with params: {'batchsize': 4, 'epoch': 9, 'learning_rate': 0.3598555191463197}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_9_0.3598555191463197
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.075, Max: 20.92, Min: 8.43
Passed tests : 23
Failed tests : 7
Converged: True
Convergence score: 0.8350576958703994
Evaluating 25 values out of 30
Overall-timings: Avg: 12.075, Max: 20.92, Min: 8.43
Choosing distribution: t
Probability of fail (non-zero): 0.03373169822761412
Exceeding max probability of failure: 0.03373169822761412
All-Passed: False
Probabilty of failure: 0.03373169822761412
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 74
Running with params: {'batchsize': 4, 'epoch': 4, 'learning_rate': 0.09389256042505537}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_4_0.09389256042505537
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Timings: Avg: 11.255666666666666, Max: 16.59, Min: 8.49
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 4.510677263355707
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Iter 26...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.601666666666668, Max: 22.51, Min: 8.45
Passed tests : 53
Failed tests : 7
Converged: False
Convergence score: 1.1428979165371755
Exceeding current best timeout: 11.601666666666668 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 75
Running with params: {'batchsize': 2, 'epoch': 8, 'learning_rate': 0.05197547795689584}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_8_0.05197547795689584
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 15...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.469666666666665, Max: 27.369999999999997, Min: 8.41
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 3.527710062564335
Exceeding current best timeout: 12.469666666666665 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 76
Running with params: {'batchsize': 4, 'epoch': 7, 'learning_rate': 0.00980808047978228}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_7_0.00980808047978228
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Timings: Avg: 12.975666666666665, Max: 24.549999999999997, Min: 8.39
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.3315617915159348
Exceeding current best timeout: 12.975666666666665 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 77
Running with params: {'batchsize': 8, 'epoch': 6, 'learning_rate': 0.5027033911871612}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_8_6_0.5027033911871612
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.319333333333335, Max: 28.25, Min: 8.48
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 1.5115241789324414
Exceeding current best timeout: 14.319333333333335 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 78
Running with params: {'batchsize': 4, 'epoch': 3, 'learning_rate': 0.9921875704677117}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_3_0.9921875704677117
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.491333333333335, Max: 18.72, Min: 8.38
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.3671684365786736
Exceeding current best timeout: 11.491333333333335 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 79
Running with params: {'batchsize': 4, 'epoch': 5, 'learning_rate': 0.03851388477267363}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_5_0.03851388477267363
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.062666666666667, Max: 18.25, Min: 8.47
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 2.4413258718835222
Exceeding current best timeout: 12.062666666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 80
Running with params: {'batchsize': 64, 'epoch': 8, 'learning_rate': 0.14231508343334787}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_64_8_0.14231508343334787
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Timings: Avg: 12.222666666666667, Max: 19.669999999999998, Min: 8.440000000000001
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.566066379312421
Exceeding current best timeout: 12.222666666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 81
Running with params: {'batchsize': 4, 'epoch': 4, 'learning_rate': 0.026114956455149486}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_4_4_0.026114956455149486
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 17...
Iter 15...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Timings: Avg: 12.622333333333332, Max: 46.31, Min: 8.459999999999999
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.4783704529709363
Exceeding current best timeout: 12.622333333333332 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 82
Running with params: {'batchsize': 32, 'epoch': 6, 'learning_rate': 0.014909637797394288}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_32_6_0.014909637797394288
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Timings: Avg: 12.408666666666669, Max: 36.25, Min: 8.38
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.8456143839316854
Exceeding current best timeout: 12.408666666666669 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 83
Running with params: {'batchsize': 2, 'epoch': 9, 'learning_rate': 0.35589984044850365}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_9_0.35589984044850365
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.193, Max: 16.8, Min: 8.27
Passed tests : 27
Failed tests : 3
Converged: True
Convergence score: 0.9607689228305324
Evaluating 27 values out of 30
Overall-timings: Avg: 11.193, Max: 16.8, Min: 8.27
Choosing distribution: beta
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 11.193
Score: 11.193
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 84
Running with params: {'batchsize': 2, 'epoch': 5, 'learning_rate': 0.2989874311719127}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_5_0.2989874311719127
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 4...
Iter 9...
Iter 12...
Iter 11...
Iter 10...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.534333333333334, Max: 21.119999999999997, Min: 8.36
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 2.4835223396778265
Exceeding current best timeout: 12.534333333333334 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 85
Running with params: {'batchsize': 2, 'epoch': 2, 'learning_rate': 0.6008234096335219}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_2_0.6008234096335219
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Timings: Avg: 11.456666666666669, Max: 21.88, Min: 8.51
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 3.188412630719941
Exceeding current best timeout: 11.456666666666669 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 86
Running with params: {'batchsize': 2, 'epoch': 3, 'learning_rate': 0.08746707483784444}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_3_0.08746707483784444
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 13...
Iter 11...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Iter 26...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.108333333333336, Max: 21.3, Min: 8.37
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.7529888064467434
Exceeding current best timeout: 12.108333333333336 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 87
Running with params: {'batchsize': 2, 'epoch': 2, 'learning_rate': 0.19026451948576875}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_2_0.19026451948576875
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.440666666666667, Max: 21.55, Min: 8.27
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.143822047593539
Exceeding current best timeout: 11.440666666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 88
Running with params: {'batchsize': 2, 'epoch': 10, 'learning_rate': 0.4035591099993177}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_10_0.4035591099993177
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 15...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.102333333333332, Max: 16.349999999999998, Min: 8.32
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.112278227242224
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.050166666666666, Max: 39.92, Min: 8.32
Passed tests : 51
Failed tests : 9
Converged: False
Convergence score: 2.2481064841718004
Exceeding current best timeout: 12.050166666666666 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 89
Running with params: {'batchsize': 8, 'epoch': 3, 'learning_rate': 0.05202996434774686}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_8_3_0.05202996434774686
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.989666666666666, Max: 25.060000000000002, Min: 8.379999999999999
Passed tests : 24
Failed tests : 6
Converged: True
Convergence score: 0.8957709483270354
Evaluating 26 values out of 30
Overall-timings: Avg: 12.989666666666666, Max: 25.060000000000002, Min: 8.379999999999999
Choosing distribution: beta
Probability of fail (non-zero): 0.16277933698829702
Exceeding max probability of failure: 0.16277933698829702
All-Passed: False
Probabilty of failure: 0.16277933698829702
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 90
Running with params: {'batchsize': 2, 'epoch': 4, 'learning_rate': 0.0060765785696604655}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_4_0.0060765785696604655
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 13.518333333333334, Max: 25.72, Min: 8.44
Passed tests : 24
Failed tests : 6
Converged: True
Convergence score: 0.9993549166661287
Evaluating 25 values out of 30
Overall-timings: Avg: 13.518333333333334, Max: 25.72, Min: 8.44
Choosing distribution: t
Probability of fail (non-zero): 0.030484004482533716
Exceeding max probability of failure: 0.030484004482533716
All-Passed: False
Probabilty of failure: 0.030484004482533716
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 91
Running with params: {'batchsize': 2, 'epoch': 1, 'learning_rate': 0.7711470260992636}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_1_0.7711470260992636
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 7...
Iter 6...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.734333333333334, Max: 18.06, Min: 8.35
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 4.880055718307206
Exceeding current best timeout: 12.734333333333334 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 92
Running with params: {'batchsize': 64, 'epoch': 2, 'learning_rate': 0.9640869584728832}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_64_2_0.9640869584728832
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.653, Max: 21.15, Min: 8.42
Passed tests : 24
Failed tests : 6
Converged: True
Convergence score: 0.8830048834463267
Evaluating 25 values out of 30
Overall-timings: Avg: 12.653, Max: 21.15, Min: 8.42
Choosing distribution: laplace
Probability of fail (non-zero): 0.006604062708191644
All-Passed: True
Probabilty of failure: 0.006604062708191644
Runtime: 12.653
Score: 12.653
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 93
Running with params: {'batchsize': 16, 'epoch': 1, 'learning_rate': 1.4002601400478988e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_16_1_1.4002601400478988e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.640999999999998, Max: 18.11, Min: 8.39
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.181228641351893
Exceeding current best timeout: 11.640999999999998 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 94
Running with params: {'batchsize': 256, 'epoch': 2, 'learning_rate': 0.1322550571544597}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_256_2_0.1322550571544597
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.264999999999999, Max: 26.84, Min: 8.379999999999999
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 3.0581864950030244
Exceeding current best timeout: 12.264999999999999 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 95
Running with params: {'batchsize': 32, 'epoch': 1, 'learning_rate': 0.06162079309078002}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_32_1_0.06162079309078002
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.815666666666665, Max: 26.98, Min: 8.44
Passed tests : 23
Failed tests : 7
Converged: True
Convergence score: 0.9442217468527283
Evaluating 25 values out of 30
Overall-timings: Avg: 12.815666666666665, Max: 26.98, Min: 8.44
Choosing distribution: cauchy
Probability of fail (non-zero): 0.07211608681983317
Exceeding max probability of failure: 0.07211608681983317
All-Passed: False
Probabilty of failure: 0.07211608681983317
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 96
Running with params: {'batchsize': 8, 'epoch': 3, 'learning_rate': 0.30522078545264625}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_8_3_0.30522078545264625
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.412666666666667, Max: 22.54, Min: 8.41
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 3.43282932837082
Exceeding current best timeout: 12.412666666666667 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 97
Running with params: {'batchsize': 128, 'epoch': 9, 'learning_rate': 0.18690773336665487}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_128_9_0.18690773336665487
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 6...
Iter 7...
Iter 5...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 8...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.957333333333336, Max: 22.04, Min: 8.440000000000001
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.0003876542514596
Exceeding current best timeout: 12.957333333333336 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 98
Running with params: {'batchsize': 2, 'epoch': 2, 'learning_rate': 0.5506475362631633}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_2_2_0.5506475362631633
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 11.861, Max: 32.68, Min: 8.59
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.7456258919345653
Exceeding current best timeout: 11.861 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 99
Running with params: {'batchsize': 64, 'epoch': 5, 'learning_rate': 0.0009448716924203602}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_64_5_0.0009448716924203602
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.381, Max: 32.17, Min: 8.5
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 3.288724496595287
Exceeding current best timeout: 12.381 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Optimization Iteration: 100
Running with params: {'batchsize': 16, 'epoch': 1, 'learning_rate': 0.020192278384711618}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597623342/assert_97220070_16_1_0.020192278384711618
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 12.445333333333334, Max: 24.74, Min: 8.42
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.9928068897339402
Exceeding current best timeout: 12.445333333333334 > 10.427333333333332
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 10.427333333333332
Best-param: {'batchsize': 4, 'epoch': 2, 'learning_rate': 0.8886088965465745}
Upto iteration 100: {'batchsize': 1, 'epoch': 2.0, 'learning_rate': 0.8886088965465745}
Breaking...
{'batchsize': 1, 'epoch': 2.0, 'learning_rate': 0.8886088965465745}
Best score: 10.427333333333332
Repeated params: 0
Trials: 101
Best param {'batchsize': 1, 'epoch': 2.0, 'learning_rate': 0.8886088965465745}
Reduction: 5.849422883026603%
Speedup: 1.0621283805383288x
Optimizer time: 5920.449725151062
