Repo: parlai
Filename: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/projects/parlai/tests/test_transformers.py
ClassName: TestTransformerRanker
Testname: test_alt_reduction
Params: learning_rate,226,29,ParamType.LR,0.007
batchsize,227,26,ParamType.CHAINS,16
Assertion: self.assertGreaterEqual(test['hits@1'], 0.90)
Original runtime: 13.274000000000001
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'learning_rate': 0.007, 'batchsize': 16}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_0.007_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 17...
Iter 16...
Iter 15...
Iter 19...
Iter 18...
Iter 20...
Iter 22...
Iter 21...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.133666666666667, Max: 13.42, Min: 7.760000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.598821754617935
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 10...
Iter 12...
Iter 11...
Iter 9...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.2005, Max: 13.42, Min: 7.760000000000001
Passed tests : 60
Failed tests : 0
Converged: True
Convergence score: 0.8421601936380879
Evaluating 60 values out of 60
Overall-timings: Avg: 9.2005, Max: 13.42, Min: 7.760000000000001
Choosing distribution: beta
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 9.2005
Score: 9.2005
Best-score: 9.2005
Best-param: {'learning_rate': 0.007, 'batchsize': 16}
>>Setting original runtime to 9.2005
Optimization Iteration: 1
Running with params: {'batchsize': 4, 'learning_rate': 0.3384420392134382}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.3384420392134382
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 153.8436666666667, Max: 219.07000000000002, Min: 116.08
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 9.2005
Best-param: {'learning_rate': 0.007, 'batchsize': 16}
Optimization Iteration: 2
Running with params: {'batchsize': 16, 'learning_rate': 0.00029049715300538193}
Lower learning rate.. returning... Best: 0.007, Proposed: 0.00029049715300538193
Optimization Iteration: 3
Running with params: {'batchsize': 16, 'learning_rate': 1.0554901206039794e-05}
Lower learning rate.. returning... Best: 0.007, Proposed: 1.0554901206039794e-05
Optimization Iteration: 4
Running with params: {'batchsize': 256, 'learning_rate': 2.6300103238848e-05}
Lower learning rate.. returning... Best: 0.007, Proposed: 2.6300103238848e-05
Optimization Iteration: 5
Running with params: {'batchsize': 64, 'learning_rate': 0.0004615807440602507}
Lower learning rate.. returning... Best: 0.007, Proposed: 0.0004615807440602507
Optimization Iteration: 6
Running with params: {'batchsize': 16, 'learning_rate': 0.00028680213602169343}
Lower learning rate.. returning... Best: 0.007, Proposed: 0.00028680213602169343
Optimization Iteration: 7
Running with params: {'batchsize': 128, 'learning_rate': 0.003290724473249662}
Lower learning rate.. returning... Best: 0.007, Proposed: 0.003290724473249662
Optimization Iteration: 8
Running with params: {'batchsize': 2, 'learning_rate': 0.0698948147595058}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_2_0.0698948147595058
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 9...
Iter 10...
Iter 7...
Iter 12...
Iter 11...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 292.85266666666666, Max: 300.55, Min: 228.32999999999998
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 9.2005
Best-param: {'learning_rate': 0.007, 'batchsize': 16}
Optimization Iteration: 9
Running with params: {'batchsize': 2, 'learning_rate': 0.16233429850945091}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_2_0.16233429850945091
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 11...
Iter 10...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 286.7993333333334, Max: 300.53000000000003, Min: 206.09
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 9.2005
Best-param: {'learning_rate': 0.007, 'batchsize': 16}
Optimization Iteration: 10
Running with params: {'batchsize': 8, 'learning_rate': 0.0018847518156482966}
Lower learning rate.. returning... Best: 0.007, Proposed: 0.0018847518156482966
Optimization Iteration: 11
Running with params: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_128_0.0188156444090351
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.712333333333333, Max: 9.8, Min: 7.67
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6269784336399091
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.873166666666666, Max: 10.51, Min: 7.67
Passed tests : 60
Failed tests : 0
Converged: True
Convergence score: 0.7427356735392254
Evaluating 60 values out of 60
Overall-timings: Avg: 8.873166666666666, Max: 10.51, Min: 7.67
Choosing distribution: beta
Probability of fail (non-zero): 2.4198118613395736e-22
All-Passed: True
Probabilty of failure: 2.4198118613395736e-22
Runtime: 8.873166666666666
Score: 8.873166666666666
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 12
Running with params: {'batchsize': 8, 'learning_rate': 0.10605395580036811}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_8_0.10605395580036811
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 101.39933333333333, Max: 144.79, Min: 46.72
Passed tests : 2
Failed tests : 28
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 13
Running with params: {'batchsize': 2, 'learning_rate': 0.0101056687944977}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.0101056687944977
Optimization Iteration: 14
Running with params: {'batchsize': 4, 'learning_rate': 0.1462863152453792}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.1462863152453792
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 192.48499999999996, Max: 256.89, Min: 118.39
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 15
Running with params: {'batchsize': 128, 'learning_rate': 3.941546035074246e-05}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 3.941546035074246e-05
Optimization Iteration: 16
Running with params: {'batchsize': 8, 'learning_rate': 0.0006086114883906274}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.0006086114883906274
Optimization Iteration: 17
Running with params: {'batchsize': 4, 'learning_rate': 0.0017676160416040185}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.0017676160416040185
Optimization Iteration: 18
Running with params: {'batchsize': 32, 'learning_rate': 0.43581899936870133}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_32_0.43581899936870133
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 42.96100000000001, Max: 55.45, Min: 32.22
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 19
Running with params: {'batchsize': 64, 'learning_rate': 2.67997554461914e-05}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 2.67997554461914e-05
Optimization Iteration: 20
Running with params: {'batchsize': 64, 'learning_rate': 0.0009062079914682501}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.0009062079914682501
Optimization Iteration: 21
Running with params: {'batchsize': 4, 'learning_rate': 0.017403581940242698}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.017403581940242698
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 43.064, Max: 62.61, Min: 25.26
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.663764976568008
Exceeding current best timeout: 43.064 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 22
Running with params: {'batchsize': 128, 'learning_rate': 0.027893517976422796}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_128_0.027893517976422796
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 39.93333333333333, Max: 68.16, Min: 14.52
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9846044545686774
Exceeding current best timeout: 39.93333333333333 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 23
Running with params: {'batchsize': 64, 'learning_rate': 0.0059870593772869156}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.0059870593772869156
Optimization Iteration: 24
Running with params: {'batchsize': 256, 'learning_rate': 0.8412504625170957}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_256_0.8412504625170957
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 38.890333333333324, Max: 56.71, Min: 24.69
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.245365597551235
Exceeding current best timeout: 38.890333333333324 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 25
Running with params: {'batchsize': 128, 'learning_rate': 0.44077834800291826}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_128_0.44077834800291826
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 42.82099999999999, Max: 62.06, Min: 14.370000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.23109403198639
Exceeding current best timeout: 42.82099999999999 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 26
Running with params: {'batchsize': 32, 'learning_rate': 0.06168774176574349}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_32_0.06168774176574349
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 45.724, Max: 61.43, Min: 24.57
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2893167424406144
Exceeding current best timeout: 45.724 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 27
Running with params: {'batchsize': 4, 'learning_rate': 0.9275399401399282}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.9275399401399282
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 45.39, Max: 66.71000000000001, Min: 15.059999999999999
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.8498365855987985
Evaluating 30 values out of 30
Overall-timings: Avg: 45.39, Max: 66.71000000000001, Min: 15.059999999999999
Choosing distribution: laplace
Probability of fail (non-zero): 0.010234037857175284
Exceeding max probability of failure: 0.010234037857175284
All-Passed: False
Probabilty of failure: 0.010234037857175284
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 28
Running with params: {'batchsize': 128, 'learning_rate': 0.032861940304485165}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_128_0.032861940304485165
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 46.166666666666664, Max: 64.1, Min: 24.669999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.303840481040533
Exceeding current best timeout: 46.166666666666664 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 29
Running with params: {'batchsize': 4, 'learning_rate': 0.2832377884451476}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.2832377884451476
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 41.98233333333334, Max: 57.44, Min: 24.970000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2149002151415929
Exceeding current best timeout: 41.98233333333334 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 30
Running with params: {'batchsize': 128, 'learning_rate': 0.00726155252192228}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.00726155252192228
Optimization Iteration: 31
Running with params: {'batchsize': 32, 'learning_rate': 0.04354135964665722}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_32_0.04354135964665722
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 44.90999999999999, Max: 68.91, Min: 24.98
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0377367587099673
Exceeding current best timeout: 44.90999999999999 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 32
Running with params: {'batchsize': 16, 'learning_rate': 0.00014594754039904358}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.00014594754039904358
Optimization Iteration: 33
Running with params: {'batchsize': 256, 'learning_rate': 0.01708396262740217}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_256_0.01708396262740217
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 15...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 41.39866666666667, Max: 60.529999999999994, Min: 24.77
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 5.019011475427825
Exceeding current best timeout: 41.39866666666667 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 34
Running with params: {'batchsize': 4, 'learning_rate': 0.2471757694677566}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.2471757694677566
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 4...
Iter 2...
Iter 3...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 45.56133333333333, Max: 70.96, Min: 25.04
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.8984591897591392
Evaluating 30 values out of 30
Overall-timings: Avg: 45.56133333333333, Max: 70.96, Min: 25.04
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.003833523706759996
All-Passed: True
Probabilty of failure: 0.003833523706759996
Runtime: 45.56133333333333
Score: 45.56133333333333
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 35
Running with params: {'batchsize': 4, 'learning_rate': 0.22832034895487455}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.22832034895487455
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 42.495000000000005, Max: 64.65, Min: 24.65
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4322079151419072
Exceeding current best timeout: 42.495000000000005 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 36
Running with params: {'batchsize': 16, 'learning_rate': 0.7129799853843958}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_16_0.7129799853843958
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 43.66666666666666, Max: 60.57, Min: 24.44
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6035674514745464
Exceeding current best timeout: 43.66666666666666 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 37
Running with params: {'batchsize': 128, 'learning_rate': 0.004187566742682053}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.004187566742682053
Optimization Iteration: 38
Running with params: {'batchsize': 256, 'learning_rate': 0.015455223099617768}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.015455223099617768
Optimization Iteration: 39
Running with params: {'batchsize': 2, 'learning_rate': 0.09362824833672469}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_2_0.09362824833672469
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 43.778999999999996, Max: 70.43, Min: 14.46
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.7383577954199745
Exceeding current best timeout: 43.778999999999996 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 40
Running with params: {'batchsize': 4, 'learning_rate': 0.05005778744567979}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.05005778744567979
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 44.353666666666655, Max: 61.25, Min: 25.61
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9194621406122891
Evaluating 30 values out of 30
Overall-timings: Avg: 44.353666666666655, Max: 61.25, Min: 25.61
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.022240889506465515
Exceeding max probability of failure: 0.022240889506465515
All-Passed: False
Probabilty of failure: 0.022240889506465515
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 41
Running with params: {'batchsize': 8, 'learning_rate': 0.0012879112459670296}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.0012879112459670296
Optimization Iteration: 42
Running with params: {'batchsize': 16, 'learning_rate': 7.298606251895451e-05}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 7.298606251895451e-05
Optimization Iteration: 43
Running with params: {'batchsize': 128, 'learning_rate': 0.1881730434380101}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_128_0.1881730434380101
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 44.317666666666675, Max: 61.37, Min: 25.32
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4815602407219226
Exceeding current best timeout: 44.317666666666675 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 44
Running with params: {'batchsize': 2, 'learning_rate': 1.1835442298925178e-05}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 1.1835442298925178e-05
Optimization Iteration: 45
Running with params: {'batchsize': 4, 'learning_rate': 0.00022931909613877483}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.00022931909613877483
Optimization Iteration: 46
Running with params: {'batchsize': 32, 'learning_rate': 0.002471366988651737}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.002471366988651737
Optimization Iteration: 47
Running with params: {'batchsize': 8, 'learning_rate': 0.009328933634927641}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.009328933634927641
Optimization Iteration: 48
Running with params: {'batchsize': 128, 'learning_rate': 0.12728306917509122}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_128_0.12728306917509122
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 44.88333333333333, Max: 67.08999999999999, Min: 25.42
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.450947338712699
Exceeding current best timeout: 44.88333333333333 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 49
Running with params: {'batchsize': 64, 'learning_rate': 0.4674412113028887}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_64_0.4674412113028887
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 44.313333333333325, Max: 60.190000000000005, Min: 25.0
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5389675281277275
Exceeding current best timeout: 44.313333333333325 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 50
Running with params: {'batchsize': 4, 'learning_rate': 0.026284691195759047}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.026284691195759047
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 40.625666666666675, Max: 65.66, Min: 14.59
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.163439366800432
Exceeding current best timeout: 40.625666666666675 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Upto iteration 50: {'batchsize': 6, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 51
Running with params: {'batchsize': 256, 'learning_rate': 0.08097184296049328}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_256_0.08097184296049328
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 50.021333333333345, Max: 77.25, Min: 35.5
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 4.097645381730661
Exceeding current best timeout: 50.021333333333345 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 52
Running with params: {'batchsize': 2, 'learning_rate': 0.003771066129951921}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.003771066129951921
Optimization Iteration: 53
Running with params: {'batchsize': 128, 'learning_rate': 0.0005845079246896371}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.0005845079246896371
Optimization Iteration: 54
Running with params: {'batchsize': 8, 'learning_rate': 0.3255630231057735}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_8_0.3255630231057735
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 44.47066666666667, Max: 80.73, Min: 24.91
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.0412414523193063
Exceeding current best timeout: 44.47066666666667 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 55
Running with params: {'batchsize': 64, 'learning_rate': 0.01213983105770843}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.01213983105770843
Optimization Iteration: 56
Running with params: {'batchsize': 4, 'learning_rate': 0.6162795994741005}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.6162795994741005
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 44.56666666666667, Max: 59.39, Min: 24.4
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9284258880931773
Exceeding current best timeout: 44.56666666666667 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 57
Running with params: {'batchsize': 32, 'learning_rate': 0.005892207328863229}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.005892207328863229
Optimization Iteration: 58
Running with params: {'batchsize': 16, 'learning_rate': 0.03061995695140663}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_16_0.03061995695140663
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 42.42866666666667, Max: 65.0, Min: 14.600000000000001
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.7886715544981187
Evaluating 30 values out of 30
Overall-timings: Avg: 42.42866666666667, Max: 65.0, Min: 14.600000000000001
Choosing distribution: beta
Probability of fail (non-zero): 0.001201615142091058
All-Passed: True
Probabilty of failure: 0.001201615142091058
Runtime: 42.42866666666667
Score: 42.42866666666667
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 59
Running with params: {'batchsize': 16, 'learning_rate': 0.0010432435530843406}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.0010432435530843406
Optimization Iteration: 60
Running with params: {'batchsize': 16, 'learning_rate': 0.002028134878699355}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.002028134878699355
Optimization Iteration: 61
Running with params: {'batchsize': 16, 'learning_rate': 0.022549543890837513}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_16_0.022549543890837513
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 44.66033333333333, Max: 61.410000000000004, Min: 14.96
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4001331937972725
Exceeding current best timeout: 44.66033333333333 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 62
Running with params: {'batchsize': 16, 'learning_rate': 0.0004173068130795169}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.0004173068130795169
Optimization Iteration: 63
Running with params: {'batchsize': 16, 'learning_rate': 0.039009340542308264}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_16_0.039009340542308264
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 41.032666666666664, Max: 67.19000000000001, Min: 14.870000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8203641092364207
Exceeding current best timeout: 41.032666666666664 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 64
Running with params: {'batchsize': 128, 'learning_rate': 0.004748730871936454}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.004748730871936454
Optimization Iteration: 65
Running with params: {'batchsize': 16, 'learning_rate': 0.06575834242266487}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_16_0.06575834242266487
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 45.19433333333335, Max: 69.37, Min: 24.77
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.618136134933164
Exceeding current best timeout: 45.19433333333335 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 66
Running with params: {'batchsize': 4, 'learning_rate': 0.142080249610897}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.142080249610897
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 41.604, Max: 55.809999999999995, Min: 25.049999999999997
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.959365501571273
Evaluating 30 values out of 30
Overall-timings: Avg: 41.604, Max: 55.809999999999995, Min: 25.049999999999997
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.0013101257307171544
All-Passed: True
Probabilty of failure: 0.0013101257307171544
Runtime: 41.604
Score: 41.604
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 67
Running with params: {'batchsize': 256, 'learning_rate': 0.011137605586030228}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.011137605586030228
Optimization Iteration: 68
Running with params: {'batchsize': 128, 'learning_rate': 0.13921412442791875}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_128_0.13921412442791875
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 45.98366666666667, Max: 65.47, Min: 24.880000000000003
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.120951411305734
Exceeding current best timeout: 45.98366666666667 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 69
Running with params: {'batchsize': 64, 'learning_rate': 0.05564591131259214}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_64_0.05564591131259214
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 40.74966666666667, Max: 62.86, Min: 14.469999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.177970576414835
Exceeding current best timeout: 40.74966666666667 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 70
Running with params: {'batchsize': 4, 'learning_rate': 0.10431081858058852}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.10431081858058852
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 43.22666666666666, Max: 64.95, Min: 15.120000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.0641873861685536
Exceeding current best timeout: 43.22666666666666 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 71
Running with params: {'batchsize': 2, 'learning_rate': 0.17764618193043305}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_2_0.17764618193043305
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 42.610666666666674, Max: 55.98, Min: 24.900000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.22948160685261
Exceeding current best timeout: 42.610666666666674 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 72
Running with params: {'batchsize': 32, 'learning_rate': 0.02131775074028042}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_32_0.02131775074028042
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 44.64, Max: 60.5, Min: 24.830000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2235201996942053
Exceeding current best timeout: 44.64 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 73
Running with params: {'batchsize': 8, 'learning_rate': 0.03626838665155798}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_8_0.03626838665155798
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 45.198, Max: 64.14999999999999, Min: 24.88
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4001331937972723
Exceeding current best timeout: 45.198 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 74
Running with params: {'batchsize': 128, 'learning_rate': 0.0029275478566893063}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.0029275478566893063
Optimization Iteration: 75
Running with params: {'batchsize': 16, 'learning_rate': 0.008219111336442259}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.008219111336442259
Optimization Iteration: 76
Running with params: {'batchsize': 4, 'learning_rate': 0.012414592593045063}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.012414592593045063
Optimization Iteration: 77
Running with params: {'batchsize': 128, 'learning_rate': 0.43977538022300416}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_128_0.43977538022300416
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 45.001333333333335, Max: 65.99000000000001, Min: 14.97
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3239452123935311
Exceeding current best timeout: 45.001333333333335 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 78
Running with params: {'batchsize': 256, 'learning_rate': 0.006179358583149479}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.006179358583149479
Optimization Iteration: 79
Running with params: {'batchsize': 4, 'learning_rate': 0.9738041450823851}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.9738041450823851
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 43.459333333333326, Max: 61.25, Min: 24.58
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4966941037143295
Exceeding current best timeout: 43.459333333333326 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 80
Running with params: {'batchsize': 2, 'learning_rate': 0.00153741960456097}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.00153741960456097
Optimization Iteration: 81
Running with params: {'batchsize': 16, 'learning_rate': 0.016172698478351007}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.016172698478351007
Optimization Iteration: 82
Running with params: {'batchsize': 32, 'learning_rate': 0.08057846264763935}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_32_0.08057846264763935
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 15...
Iter 27...
Iter 28...
Iter 29...
Iter 26...
Timings: Avg: 44.705000000000005, Max: 63.8, Min: 24.62
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 5.4999999999999885
Exceeding current best timeout: 44.705000000000005 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 83
Running with params: {'batchsize': 64, 'learning_rate': 0.2513493156381129}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_64_0.2513493156381129
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 41.18833333333334, Max: 56.58, Min: 24.61
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1470786693528108
Exceeding current best timeout: 41.18833333333334 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 84
Running with params: {'batchsize': 8, 'learning_rate': 0.024574400246159964}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_8_0.024574400246159964
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 40.193, Max: 60.34, Min: 25.47
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.9163794720397096
Exceeding current best timeout: 40.193 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 85
Running with params: {'batchsize': 128, 'learning_rate': 0.032419934056221886}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_128_0.032419934056221886
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 48.52, Max: 76.95, Min: 24.68
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.0784834514481854
Exceeding current best timeout: 48.52 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 86
Running with params: {'batchsize': 4, 'learning_rate': 0.5523566735300415}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.5523566735300415
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 7...
Iter 8...
Iter 6...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 42.44333333333334, Max: 60.75, Min: 14.54
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9229831777904387
Evaluating 30 values out of 30
Overall-timings: Avg: 42.44333333333334, Max: 60.75, Min: 14.54
Choosing distribution: beta
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 42.44333333333334
Score: 42.44333333333334
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 87
Running with params: {'batchsize': 16, 'learning_rate': 0.045408780314913764}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_16_0.045408780314913764
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 43.94500000000001, Max: 75.99000000000001, Min: 15.09
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1450111254873376
Exceeding current best timeout: 43.94500000000001 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 88
Running with params: {'batchsize': 4, 'learning_rate': 0.11300319445183113}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.11300319445183113
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 42.91833333333333, Max: 73.44000000000001, Min: 14.5
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8489469032838002
Exceeding current best timeout: 42.91833333333333 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 89
Running with params: {'batchsize': 256, 'learning_rate': 0.18559591061917843}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_256_0.18559591061917843
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 42.61299999999999, Max: 69.11, Min: 24.56
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.166666666666663
Exceeding current best timeout: 42.61299999999999 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 90
Running with params: {'batchsize': 128, 'learning_rate': 0.3533628037334843}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_128_0.3533628037334843
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 45.693666666666665, Max: 59.510000000000005, Min: 24.669999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5328483487124076
Exceeding current best timeout: 45.693666666666665 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 91
Running with params: {'batchsize': 2, 'learning_rate': 0.0026981688389324182}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.0026981688389324182
Optimization Iteration: 92
Running with params: {'batchsize': 64, 'learning_rate': 0.020135661716301517}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_64_0.020135661716301517
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 45.00600000000001, Max: 68.91, Min: 34.92
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5037641213512527
Exceeding current best timeout: 45.00600000000001 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 93
Running with params: {'batchsize': 32, 'learning_rate': 0.004622689569110727}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.004622689569110727
Optimization Iteration: 94
Running with params: {'batchsize': 16, 'learning_rate': 0.000780115654687026}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.000780115654687026
Optimization Iteration: 95
Running with params: {'batchsize': 8, 'learning_rate': 0.7426914900689159}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_8_0.7426914900689159
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 42.14966666666667, Max: 62.75, Min: 14.73
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.587501587502383
Exceeding current best timeout: 42.14966666666667 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 96
Running with params: {'batchsize': 4, 'learning_rate': 0.030403354180374122}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_4_0.030403354180374122
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 7...
Iter 6...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 43.07699999999999, Max: 62.64, Min: 25.26
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3254455128833194
Exceeding current best timeout: 43.07699999999999 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 97
Running with params: {'batchsize': 128, 'learning_rate': 0.08242909633388984}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_128_0.08242909633388984
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 44.74733333333333, Max: 69.03, Min: 14.49
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5275252316519528
Exceeding current best timeout: 44.74733333333333 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 98
Running with params: {'batchsize': 16, 'learning_rate': 7.065150502361516e-05}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 7.065150502361516e-05
Optimization Iteration: 99
Running with params: {'batchsize': 256, 'learning_rate': 0.06064186659970043}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597619505_parlai/run_1597629276/assert_2252864_256_0.06064186659970043
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 43.22599999999999, Max: 62.18, Min: 25.16
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5075567228888116
Exceeding current best timeout: 43.22599999999999 > 8.873166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.873166666666666
Best-param: {'batchsize': 128, 'learning_rate': 0.0188156444090351}
Optimization Iteration: 100
Running with params: {'batchsize': 4, 'learning_rate': 0.014130663071317058}
Lower learning rate.. returning... Best: 0.0188156444090351, Proposed: 0.014130663071317058
Upto iteration 100: {'batchsize': 6, 'learning_rate': 0.0188156444090351}
Breaking...
{'batchsize': 6, 'learning_rate': 0.0188156444090351}
Best score: 8.873166666666666
Repeated params: 0
Trials: 101
Best param {'batchsize': 6, 'learning_rate': 0.0188156444090351}
Reduction: 3.5577776570113984%
Speedup: 1.0368902496290313x
Optimizer time: 4513.585746526718
