Repo: parlai
Filename: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/projects/parlai/tests/test_tra.py
ClassName: TestPolyRanker
Testname: test_eval_batch
Params: learning_rate,35,25,ParamType.LR,0.007
num_epochs,38,23,ParamType.CHAINS,4
batchsize,36,22,ParamType.CHAINS,16
Assertion: self.assertGreaterEqual(valid['hits@1'], threshold)
Original runtime: 5.822
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_0.007_4_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.858333333333333, Max: 5.97, Min: 5.71
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.788854381999834
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.866833333333334, Max: 5.970000000000001, Min: 5.71
Passed tests : 60
Failed tests : 0
Converged: False
Convergence score: 1.4207375195964245
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.861555555555555, Max: 5.970000000000001, Min: 5.71
Passed tests : 90
Failed tests : 0
Converged: True
Convergence score: 0.7724386267085496
Evaluating 90 values out of 90
Overall-timings: Avg: 5.861555555555555, Max: 5.970000000000001, Min: 5.71
Choosing distribution: cauchy
Probability of fail (non-zero): 0.022586392842494918
Exceeding max probability of failure: 0.022586392842494918
All-Passed: False
Probabilty of failure: 0.022586392842494918
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
>>>!!Warning: Allowing update probability!!<<
Updating probability of failure to: 0.022586392842494918
>>Setting original runtime to 5.861555555555555
Optimization Iteration: 1
Running with params: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.020678484910529614_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 4.7219999999999995, Max: 5.569999999999999, Min: 4.58
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.0046924886340487
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 25...
Iter 23...
Iter 24...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 4.728166666666666, Max: 5.67, Min: 4.58
Passed tests : 60
Failed tests : 0
Converged: True
Convergence score: 0.9923563534970566
Evaluating 60 values out of 60
Overall-timings: Avg: 4.728166666666666, Max: 5.67, Min: 4.58
Choosing distribution: lognorm
Probability of fail (non-zero): 0.018407407095613938
All-Passed: True
Probabilty of failure: 0.018407407095613938
Runtime: 4.728166666666666
Score: 4.728166666666666
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 2
Running with params: {'batchsize': 128, 'learning_rate': 0.00448671076625294, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.00448671076625294_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 13.905333333333337, Max: 14.15, Min: 13.56
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 3
Running with params: {'batchsize': 2, 'learning_rate': 0.0013606459722401306, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_0.0013606459722401306_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3266666666666667, Max: 3.37, Min: 3.26
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 4
Running with params: {'batchsize': 8, 'learning_rate': 2.1487754732612927e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_8_2.1487754732612927e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.802999999999999, Max: 10.96, Min: 10.590000000000002
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 5
Running with params: {'batchsize': 128, 'learning_rate': 3.169172436966095e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_3.169172436966095e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 13.891999999999996, Max: 14.18, Min: 13.65
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 6
Running with params: {'batchsize': 8, 'learning_rate': 0.3716897833097881, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_8_0.3716897833097881_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.325666666666667, Max: 3.37, Min: 3.25
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 7
Running with params: {'batchsize': 64, 'learning_rate': 0.22514280350280902, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_0.22514280350280902_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.322666666666666, Max: 3.38, Min: 3.13
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 8
Running with params: {'batchsize': 16, 'learning_rate': 4.285574770876314e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_4.285574770876314e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.777666666666667, Max: 8.92, Min: 8.65
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 9
Running with params: {'batchsize': 128, 'learning_rate': 0.09434689127126708, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.09434689127126708_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 12.008, Max: 12.28, Min: 11.73
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 10
Running with params: {'batchsize': 8, 'learning_rate': 0.11813580301624287, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_8_0.11813580301624287_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3296666666666668, Max: 3.4, Min: 3.21
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 11
Running with params: {'batchsize': 16, 'learning_rate': 9.863249336991735e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_9.863249336991735e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.2933333333333326, Max: 3.3600000000000003, Min: 3.1500000000000004
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 12
Running with params: {'batchsize': 2, 'learning_rate': 0.007473261739415849, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_0.007473261739415849_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.314666666666666, Max: 3.37, Min: 3.19
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 13
Running with params: {'batchsize': 32, 'learning_rate': 0.004752357545834566, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.004752357545834566_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.718333333333334, Max: 8.14, Min: 4.82
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.404039366018522
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 5.848333333333334, Max: 9.02, Min: 4.66
Passed tests : 53
Failed tests : 7
Converged: False
Convergence score: 1.3041566238037028
Exceeding current best timeout: 5.848333333333334 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 14
Running with params: {'batchsize': 8, 'learning_rate': 0.3819482811438106, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_8_0.3819482811438106_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.287000000000001, Max: 8.32, Min: 4.75
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 3.330086994753249
Exceeding current best timeout: 6.287000000000001 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 15
Running with params: {'batchsize': 128, 'learning_rate': 0.158796343083411, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.158796343083411_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.314000000000001, Max: 8.27, Min: 4.81
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.9989602286793975
Exceeding current best timeout: 6.314000000000001 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 16
Running with params: {'batchsize': 64, 'learning_rate': 3.531934678851361e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_3.531934678851361e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 6.562666666666666, Max: 9.01, Min: 4.81
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.381046221200223
Exceeding current best timeout: 6.562666666666666 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 17
Running with params: {'batchsize': 64, 'learning_rate': 0.018080504099379415, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_0.018080504099379415_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 27...
Iter 28...
Timings: Avg: 6.623333333333333, Max: 8.99, Min: 4.78
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 1.269056913988308
Exceeding current best timeout: 6.623333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 18
Running with params: {'batchsize': 32, 'learning_rate': 5.957666611991174e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_5.957666611991174e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 6.173666666666667, Max: 8.21, Min: 4.680000000000001
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.2535663410560187
Exceeding current best timeout: 6.173666666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 19
Running with params: {'batchsize': 16, 'learning_rate': 0.014818160420126682, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.014818160420126682_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.0969999999999995, Max: 8.38, Min: 4.76
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.499589284891676
Exceeding current best timeout: 6.0969999999999995 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 20
Running with params: {'batchsize': 64, 'learning_rate': 0.09011551445966728, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_0.09011551445966728_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.014333333333335, Max: 8.25, Min: 4.7700000000000005
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.809962538753605
Exceeding current best timeout: 6.014333333333335 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 21
Running with params: {'batchsize': 32, 'learning_rate': 0.0007936445089118258, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.0007936445089118258_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.2283333333333335, Max: 8.31, Min: 4.78
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.9119875006211846
Exceeding current best timeout: 6.2283333333333335 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 22
Running with params: {'batchsize': 16, 'learning_rate': 0.02797576765895609, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.02797576765895609_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.423999999999999, Max: 8.33, Min: 4.83
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.7270565284586628
Exceeding current best timeout: 6.423999999999999 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 23
Running with params: {'batchsize': 64, 'learning_rate': 0.887038286629586, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_0.887038286629586_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 6.141333333333333, Max: 8.21, Min: 4.78
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 3.8571428571428608
Exceeding current best timeout: 6.141333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 24
Running with params: {'batchsize': 32, 'learning_rate': 0.0008042003238239027, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.0008042003238239027_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 6.394333333333333, Max: 9.14, Min: 4.8
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 1.4019778870198873
Exceeding current best timeout: 6.394333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 25
Running with params: {'batchsize': 16, 'learning_rate': 0.04403080019810876, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.04403080019810876_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.077666666666667, Max: 8.21, Min: 4.72
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 2.775250622497845
Exceeding current best timeout: 6.077666666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 26
Running with params: {'batchsize': 64, 'learning_rate': 0.767946450132306, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_0.767946450132306_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.435333333333334, Max: 7.319999999999999, Min: 4.779999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 0.9891004919611714
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 5.897333333333333, Max: 8.95, Min: 4.75
Passed tests : 55
Failed tests : 5
Converged: False
Convergence score: 1.4392626417173082
Exceeding current best timeout: 5.897333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 27
Running with params: {'batchsize': 32, 'learning_rate': 0.00021055154528120396, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.00021055154528120396_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.923666666666667, Max: 8.01, Min: 4.85
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.377591465426846
Exceeding current best timeout: 5.923666666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 28
Running with params: {'batchsize': 16, 'learning_rate': 0.054652238052743086, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.054652238052743086_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 7.071333333333332, Max: 9.290000000000001, Min: 4.7
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 3.595508419960242
Exceeding current best timeout: 7.071333333333332 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 29
Running with params: {'batchsize': 64, 'learning_rate': 0.6824514812445345, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_0.6824514812445345_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.918333333333334, Max: 9.04, Min: 4.819999999999999
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 1.4724572962687266
Exceeding current best timeout: 6.918333333333334 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 30
Running with params: {'batchsize': 32, 'learning_rate': 0.00033137034408163877, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.00033137034408163877_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 6.562333333333334, Max: 9.08, Min: 4.7299999999999995
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 3.31900930773177
Exceeding current best timeout: 6.562333333333334 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 31
Running with params: {'batchsize': 16, 'learning_rate': 0.0018637120205885795, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.0018637120205885795_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.351666666666665, Max: 9.47, Min: 4.75
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.3513597036308065
Exceeding current best timeout: 6.351666666666665 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 32
Running with params: {'batchsize': 2, 'learning_rate': 1.1189894922954658e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_1.1189894922954658e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 5.643000000000001, Max: 8.799999999999999, Min: 4.62
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.0336134453781511
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.819166666666667, Max: 8.799999999999999, Min: 4.62
Passed tests : 53
Failed tests : 7
Converged: False
Convergence score: 2.751192014112804
Exceeding current best timeout: 5.819166666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 33
Running with params: {'batchsize': 32, 'learning_rate': 0.0005381670023877576, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.0005381670023877576_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.300333333333332, Max: 8.95, Min: 4.79
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 3.7728627316844086
Exceeding current best timeout: 6.300333333333332 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 34
Running with params: {'batchsize': 16, 'learning_rate': 0.0020227094148155766, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.0020227094148155766_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.413666666666668, Max: 9.17, Min: 4.8
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.3035426140597806
Exceeding current best timeout: 6.413666666666668 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 35
Running with params: {'batchsize': 2, 'learning_rate': 1.0788979195040058e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_1.0788979195040058e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.075333333333333, Max: 8.13, Min: 4.78
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 3.2101414080799846
Exceeding current best timeout: 6.075333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 36
Running with params: {'batchsize': 64, 'learning_rate': 0.008786417632611976, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_0.008786417632611976_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.545333333333335, Max: 7.87, Min: 4.82
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.842617831408456
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 25...
Iter 23...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.887333333333334, Max: 9.05, Min: 4.8
Passed tests : 52
Failed tests : 8
Converged: True
Convergence score: 0.7687604414581574
Evaluating 60 values out of 60
Overall-timings: Avg: 5.887333333333334, Max: 9.05, Min: 4.8
Choosing distribution: t
Probability of fail (non-zero): 0.4205636354875924
Exceeding max probability of failure: 0.4205636354875924
All-Passed: False
Probabilty of failure: 0.4205636354875924
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 37
Running with params: {'batchsize': 128, 'learning_rate': 0.003299100856515621, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.003299100856515621_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 6.340333333333334, Max: 9.139999999999999, Min: 4.67
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 3.8070667309900323
Exceeding current best timeout: 6.340333333333334 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 38
Running with params: {'batchsize': 32, 'learning_rate': 0.0009834237011990801, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.0009834237011990801_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.037333333333333, Max: 8.049999999999999, Min: 4.84
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.9163230266328206
Exceeding current best timeout: 6.037333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 39
Running with params: {'batchsize': 16, 'learning_rate': 0.027037299831262067, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.027037299831262067_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 6.063666666666665, Max: 8.930000000000001, Min: 4.8
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 3.2115861679683633
Exceeding current best timeout: 6.063666666666665 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 40
Running with params: {'batchsize': 16, 'learning_rate': 0.330518038042533, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.330518038042533_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 6.167000000000001, Max: 8.86, Min: 4.829999999999999
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.4103422545972197
Exceeding current best timeout: 6.167000000000001 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 41
Running with params: {'batchsize': 8, 'learning_rate': 0.8852779517263888, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_8_0.8852779517263888_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.474666666666666, Max: 9.0, Min: 4.819999999999999
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.7574567167250947
Exceeding current best timeout: 6.474666666666666 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 42
Running with params: {'batchsize': 64, 'learning_rate': 0.21964407287266582, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_0.21964407287266582_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.086666666666667, Max: 8.15, Min: 4.789999999999999
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 1.6868686868686873
Exceeding current best timeout: 6.086666666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 43
Running with params: {'batchsize': 128, 'learning_rate': 0.00011402989209671252, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.00011402989209671252_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.86, Max: 9.15, Min: 4.71
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 3.254568415145436
Exceeding current best timeout: 6.86 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 44
Running with params: {'batchsize': 2, 'learning_rate': 0.006435094293197034, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_0.006435094293197034_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.459999999999999, Max: 8.360000000000001, Min: 4.72
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 4.713890400917737
Exceeding current best timeout: 6.459999999999999 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 45
Running with params: {'batchsize': 16, 'learning_rate': 0.0543376264089804, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.0543376264089804_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.049333333333334, Max: 8.959999999999999, Min: 4.8
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.1329075813779044
Exceeding current best timeout: 6.049333333333334 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 46
Running with params: {'batchsize': 16, 'learning_rate': 0.012699049830913281, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.012699049830913281_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.617999999999999, Max: 9.139999999999999, Min: 4.74
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 1.6772655811601869
Exceeding current best timeout: 6.617999999999999 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 47
Running with params: {'batchsize': 8, 'learning_rate': 0.44581982099272466, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_8_0.44581982099272466_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.864999999999998, Max: 8.14, Min: 4.74
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.027597825303746
Exceeding current best timeout: 5.864999999999998 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 48
Running with params: {'batchsize': 64, 'learning_rate': 0.1285621451722608, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_0.1285621451722608_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.902333333333333, Max: 9.280000000000001, Min: 4.83
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.6710106923538506
Exceeding current best timeout: 6.902333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 49
Running with params: {'batchsize': 32, 'learning_rate': 0.00023335030822082948, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.00023335030822082948_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 6.033333333333333, Max: 8.17, Min: 4.79
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.0666213355560137
Exceeding current best timeout: 6.033333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 50
Running with params: {'batchsize': 32, 'learning_rate': 0.00014920834812027594, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.00014920834812027594_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.501333333333333, Max: 9.33, Min: 4.83
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.417315377445366
Exceeding current best timeout: 6.501333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Upto iteration 50: {'batchsize': 2, 'learning_rate': 0.020678484910529614, 'num_epochs': 1}
Optimization Iteration: 51
Running with params: {'batchsize': 16, 'learning_rate': 0.07873759156741335, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.07873759156741335_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.847333333333333, Max: 9.1, Min: 4.75
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 2.4406801424517504
Exceeding current best timeout: 6.847333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 52
Running with params: {'batchsize': 16, 'learning_rate': 0.024724900150014106, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.024724900150014106_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.501666666666667, Max: 9.120000000000001, Min: 4.8500000000000005
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 2.577912152878985
Exceeding current best timeout: 6.501666666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 53
Running with params: {'batchsize': 128, 'learning_rate': 0.5109900214376342, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.5109900214376342_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 6.253666666666666, Max: 9.040000000000001, Min: 4.79
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.4945091950816796
Exceeding current best timeout: 6.253666666666666 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 54
Running with params: {'batchsize': 64, 'learning_rate': 0.2046675704820714, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_0.2046675704820714_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7.070666666666665, Max: 9.24, Min: 4.74
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 4.423960733486293
Exceeding current best timeout: 7.070666666666665 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 55
Running with params: {'batchsize': 8, 'learning_rate': 1.721630867377082e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_8_1.721630867377082e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.478000000000001, Max: 9.03, Min: 4.79
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.9390990854409416
Exceeding current best timeout: 6.478000000000001 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 56
Running with params: {'batchsize': 32, 'learning_rate': 0.0005277282284605145, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.0005277282284605145_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.5233333333333325, Max: 8.97, Min: 4.81
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.446965559512067
Exceeding current best timeout: 6.5233333333333325 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 57
Running with params: {'batchsize': 16, 'learning_rate': 0.0020897996711714824, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.0020897996711714824_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 5...
Iter 6...
Iter 4...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.231, Max: 8.93, Min: 4.7
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.301920004049941
Exceeding current best timeout: 6.231 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 58
Running with params: {'batchsize': 16, 'learning_rate': 6.796147865770898e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_6.796147865770898e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.958333333333332, Max: 7.48, Min: 4.739999999999999
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.0155644370746395
Exceeding current best timeout: 5.958333333333332 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 59
Running with params: {'batchsize': 2, 'learning_rate': 0.004224366526880814, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_0.004224366526880814_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.349333333333333, Max: 8.409999999999998, Min: 4.68
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.246468676656598
Exceeding current best timeout: 6.349333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 60
Running with params: {'batchsize': 2, 'learning_rate': 1.1726086744067694e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_1.1726086744067694e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.373333333333335, Max: 9.09, Min: 4.72
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 1.831287024827179
Exceeding current best timeout: 6.373333333333335 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 61
Running with params: {'batchsize': 32, 'learning_rate': 0.0012012408617480528, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.0012012408617480528_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.541666666666666, Max: 8.850000000000001, Min: 4.720000000000001
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.7326756455428702
Exceeding current best timeout: 6.541666666666666 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 62
Running with params: {'batchsize': 128, 'learning_rate': 0.0005253348968416996, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.0005253348968416996_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.125, Max: 8.13, Min: 4.859999999999999
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.3409554595865587
Exceeding current best timeout: 6.125 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 63
Running with params: {'batchsize': 16, 'learning_rate': 0.0016455729844903693, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.0016455729844903693_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 6.269, Max: 9.07, Min: 4.819999999999999
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.2412738898265834
Exceeding current best timeout: 6.269 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 64
Running with params: {'batchsize': 16, 'learning_rate': 0.00903562724009571, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.00903562724009571_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.4046666666666665, Max: 9.07, Min: 4.81
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 1.6927638459638252
Exceeding current best timeout: 6.4046666666666665 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 65
Running with params: {'batchsize': 2, 'learning_rate': 1.9506025150170005e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_1.9506025150170005e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 6...
Iter 5...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.677999999999999, Max: 7.42, Min: 4.75
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.7679594696849383
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.788166666666666, Max: 8.84, Min: 4.72
Passed tests : 57
Failed tests : 3
Converged: False
Convergence score: 1.3163950660836488
Exceeding current best timeout: 5.788166666666666 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 66
Running with params: {'batchsize': 2, 'learning_rate': 0.011117425240764287, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_0.011117425240764287_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.473666666666666, Max: 9.110000000000001, Min: 4.73
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 1.3837082766440782
Exceeding current best timeout: 6.473666666666666 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 67
Running with params: {'batchsize': 128, 'learning_rate': 0.018516257766939385, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.018516257766939385_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 6.518666666666666, Max: 8.31, Min: 4.7700000000000005
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.8919048898042077
Exceeding current best timeout: 6.518666666666666 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 68
Running with params: {'batchsize': 128, 'learning_rate': 0.002854183871877102, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.002854183871877102_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 6.374333333333333, Max: 9.02, Min: 4.8100000000000005
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 4.865366027385457
Exceeding current best timeout: 6.374333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 69
Running with params: {'batchsize': 128, 'learning_rate': 0.0010403128489954658, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.0010403128489954658_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 5...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Iter 25...
Timings: Avg: 6.36, Max: 9.16, Min: 4.8100000000000005
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.305214686828737
Exceeding current best timeout: 6.36 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 70
Running with params: {'batchsize': 128, 'learning_rate': 0.005030424380899619, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.005030424380899619_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.869999999999999, Max: 8.16, Min: 4.77
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.217939281942834
Exceeding current best timeout: 5.869999999999999 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 71
Running with params: {'batchsize': 32, 'learning_rate': 0.034742388674917045, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.034742388674917045_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 7.026999999999999, Max: 9.219999999999999, Min: 4.8
Passed tests : 17
Failed tests : 13
Converged: False
Convergence score: 1.2617998314324248
Exceeding current best timeout: 7.026999999999999 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 72
Running with params: {'batchsize': 16, 'learning_rate': 0.06296292019443223, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.06296292019443223_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.318666666666667, Max: 8.940000000000001, Min: 4.74
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 2.558071886876062
Exceeding current best timeout: 6.318666666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 73
Running with params: {'batchsize': 16, 'learning_rate': 0.08152783791721123, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.08152783791721123_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.617, Max: 9.07, Min: 4.75
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.015502169679789
Exceeding current best timeout: 6.617 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 74
Running with params: {'batchsize': 16, 'learning_rate': 0.021495024315306734, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.021495024315306734_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.057333333333334, Max: 9.040000000000001, Min: 4.8100000000000005
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.5170248910031914
Exceeding current best timeout: 6.057333333333334 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 75
Running with params: {'batchsize': 128, 'learning_rate': 0.4423225957836489, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.4423225957836489_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.676666666666667, Max: 9.18, Min: 4.79
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 4.17002008677605
Exceeding current best timeout: 6.676666666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 76
Running with params: {'batchsize': 64, 'learning_rate': 0.21244863207596845, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_64_0.21244863207596845_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.622, Max: 9.11, Min: 4.7
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 4.472135954999579
Exceeding current best timeout: 6.622 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 77
Running with params: {'batchsize': 8, 'learning_rate': 0.1546837015598942, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_8_0.1546837015598942_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.573000000000001, Max: 9.18, Min: 4.78
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 3.8312696518368172
Exceeding current best timeout: 6.573000000000001 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 78
Running with params: {'batchsize': 8, 'learning_rate': 0.11963989442190912, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_8_0.11963989442190912_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 6.267333333333334, Max: 9.09, Min: 4.82
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 2.873058350558563
Exceeding current best timeout: 6.267333333333334 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 79
Running with params: {'batchsize': 8, 'learning_rate': 2.1514252852719832e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_8_2.1514252852719832e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 6.749333333333333, Max: 9.03, Min: 4.720000000000001
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 2.509088578403879
Exceeding current best timeout: 6.749333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 80
Running with params: {'batchsize': 32, 'learning_rate': 0.00041448764520423217, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.00041448764520423217_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.870666666666667, Max: 9.040000000000001, Min: 4.74
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.5801491491609436
Exceeding current best timeout: 5.870666666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 81
Running with params: {'batchsize': 16, 'learning_rate': 5.100355354168597e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_5.100355354168597e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.298666666666667, Max: 8.91, Min: 4.77
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 1.4672654368379061
Exceeding current best timeout: 6.298666666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 82
Running with params: {'batchsize': 16, 'learning_rate': 0.002528660270354213, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.002528660270354213_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.622666666666666, Max: 9.350000000000001, Min: 4.79
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 2.2065794249003763
Exceeding current best timeout: 6.622666666666666 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 83
Running with params: {'batchsize': 2, 'learning_rate': 0.00536614694907171, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_0.00536614694907171_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.676333333333334, Max: 9.08, Min: 4.63
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.676733468535926
Exceeding current best timeout: 6.676333333333334 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 84
Running with params: {'batchsize': 2, 'learning_rate': 0.004029677483656387, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_0.004029677483656387_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 6.177666666666666, Max: 9.28, Min: 4.71
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 1.719028156682783
Exceeding current best timeout: 6.177666666666666 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 85
Running with params: {'batchsize': 2, 'learning_rate': 0.036092604505567644, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_0.036092604505567644_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.515333333333333, Max: 9.02, Min: 4.83
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 2.5150708529480528
Exceeding current best timeout: 6.515333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 86
Running with params: {'batchsize': 32, 'learning_rate': 9.022192923968538e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_9.022192923968538e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.7666666666666675, Max: 8.86, Min: 4.81
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.6042284166118332
Exceeding current best timeout: 5.7666666666666675 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 87
Running with params: {'batchsize': 128, 'learning_rate': 0.0002399243212260288, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.0002399243212260288_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.722333333333333, Max: 8.97, Min: 4.880000000000001
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 3.8804123984969907
Exceeding current best timeout: 6.722333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 88
Running with params: {'batchsize': 128, 'learning_rate': 0.0007582625836512248, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.0007582625836512248_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.154, Max: 9.08, Min: 4.71
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 3.6816376037769607
Exceeding current best timeout: 6.154 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 89
Running with params: {'batchsize': 16, 'learning_rate': 0.0014622987746984672, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.0014622987746984672_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 6.112333333333334, Max: 8.97, Min: 4.83
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 1.8225714146540861
Exceeding current best timeout: 6.112333333333334 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 90
Running with params: {'batchsize': 16, 'learning_rate': 0.001434507659254367, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_16_0.001434507659254367_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 26...
Iter 25...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 6.276333333333335, Max: 9.21, Min: 4.64
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.923447578721422
Exceeding current best timeout: 6.276333333333335 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 91
Running with params: {'batchsize': 2, 'learning_rate': 0.009363291461890366, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_0.009363291461890366_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.229, Max: 8.27, Min: 4.8
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.1883770198673274
Exceeding current best timeout: 6.229 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 92
Running with params: {'batchsize': 2, 'learning_rate': 0.014774889940314472, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_0.014774889940314472_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 6.6036666666666655, Max: 9.2, Min: 4.81
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 1.6043472071498404
Exceeding current best timeout: 6.6036666666666655 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 93
Running with params: {'batchsize': 128, 'learning_rate': 0.012382908704031782, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.012382908704031782_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.041333333333333, Max: 8.200000000000001, Min: 4.8
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 3.030473249501146
Exceeding current best timeout: 6.041333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 94
Running with params: {'batchsize': 2, 'learning_rate': 0.006647923272298758, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_2_0.006647923272298758_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 1...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.783333333333332, Max: 9.25, Min: 4.7
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 3.4431516726302474
Exceeding current best timeout: 6.783333333333332 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 95
Running with params: {'batchsize': 128, 'learning_rate': 0.01696318922836639, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.01696318922836639_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.091333333333333, Max: 9.02, Min: 4.77
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.7540371932673855
Exceeding current best timeout: 6.091333333333333 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 96
Running with params: {'batchsize': 128, 'learning_rate': 0.0027936525521512854, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.0027936525521512854_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.533333333333332, Max: 9.21, Min: 4.79
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 1.5490420722287874
Exceeding current best timeout: 6.533333333333332 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 97
Running with params: {'batchsize': 128, 'learning_rate': 0.001062886231282027, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.001062886231282027_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.513000000000001, Max: 8.35, Min: 4.79
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 2.0469547510800328
Exceeding current best timeout: 6.513000000000001 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 98
Running with params: {'batchsize': 128, 'learning_rate': 0.000740634078740104, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_128_0.000740634078740104_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.770666666666667, Max: 8.02, Min: 4.63
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 2.42876026081093
Exceeding current best timeout: 5.770666666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 99
Running with params: {'batchsize': 32, 'learning_rate': 0.03708002829548867, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.03708002829548867_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.7653333333333325, Max: 9.11, Min: 4.75
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.7848026114926403
Exceeding current best timeout: 6.7653333333333325 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Optimization Iteration: 100
Running with params: {'batchsize': 32, 'learning_rate': 0.3198968746659654, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597824803/assert_84338284_32_0.3198968746659654_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.147666666666667, Max: 8.26, Min: 4.81
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.6648544566940835
Exceeding current best timeout: 6.147666666666667 > 4.728166666666666
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.728166666666666
Best-param: {'batchsize': 16, 'learning_rate': 0.020678484910529614, 'num_epochs': 2}
Upto iteration 100: {'batchsize': 2, 'learning_rate': 0.020678484910529614, 'num_epochs': 1}
Breaking...
{'batchsize': 2, 'learning_rate': 0.020678484910529614, 'num_epochs': 1}
Best score: 4.728166666666666
Repeated params: 0
Trials: 101
Best param {'batchsize': 2, 'learning_rate': 0.020678484910529614, 'num_epochs': 1}
Reduction: 19.335974523258912%
Speedup: 1.2397100121024125x
Optimizer time: 949.7208607196808
