Repo: parlai
Filename: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/projects/parlai/tests/test_tra.py
ClassName: TestPolyRanker
Testname: test_eval_inline
Params: learning_rate,35,25,ParamType.LR,0.007
num_epochs,38,23,ParamType.CHAINS,4
batchsize,36,22,ParamType.CHAINS,16
Assertion: self.assertGreaterEqual(valid['hits@1'], threshold)
Original runtime: 5.741
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_0.007_4_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.915666666666667, Max: 6.069999999999999, Min: 5.69
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.246811556331635
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.949166666666668, Max: 6.22, Min: 5.69
Passed tests : 60
Failed tests : 0
Converged: False
Convergence score: 1.4911097582318238
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.949888888888889, Max: 6.22, Min: 5.69
Passed tests : 90
Failed tests : 0
Converged: False
Convergence score: 1.025943149973026
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.947416666666666, Max: 6.26, Min: 5.69
Passed tests : 120
Failed tests : 0
Converged: True
Convergence score: 0.6011231105336775
Evaluating 120 values out of 120
Overall-timings: Avg: 5.947416666666666, Max: 6.26, Min: 5.69
Choosing distribution: dweibull
Probability of fail (non-zero): 3.875687517355148e-16
All-Passed: True
Probabilty of failure: 3.875687517355148e-16
Runtime: 5.947416666666666
Score: 5.947416666666666
Best-score: 5.947416666666666
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
>>Setting original runtime to 5.947416666666666
Optimization Iteration: 1
Running with params: {'batchsize': 8, 'learning_rate': 0.005775662201581985, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.005775662201581985_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 15...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.446000000000001, Max: 6.53, Min: 6.300000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6209994310517983
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 6.440833333333333, Max: 6.53, Min: 6.300000000000001
Passed tests : 60
Failed tests : 0
Converged: False
Convergence score: 1.6558468266361257
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.447111111111113, Max: 6.54, Min: 6.300000000000001
Passed tests : 90
Failed tests : 0
Converged: True
Convergence score: 0.8234346673292559
Evaluating 90 values out of 90
Overall-timings: Avg: 6.447111111111113, Max: 6.54, Min: 6.300000000000001
Choosing distribution: gumbel_l
Probability of fail (non-zero): 7.344772836846656e-05
All-Passed: True
Probabilty of failure: 7.344772836846656e-05
Runtime: 6.447111111111113
Score: 6.447111111111113
Best-score: 5.947416666666666
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 2
Running with params: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.012524049301142625_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 4.560333333333333, Max: 5.44, Min: 4.43
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9117589636314982
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 4.546666666666668, Max: 5.44, Min: 4.3100000000000005
Passed tests : 60
Failed tests : 0
Converged: False
Convergence score: 1.0446067274004867
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 4.551888888888889, Max: 5.44, Min: 4.3100000000000005
Passed tests : 90
Failed tests : 0
Converged: True
Convergence score: 0.5057436118439075
Evaluating 90 values out of 90
Overall-timings: Avg: 4.551888888888889, Max: 5.44, Min: 4.3100000000000005
Choosing distribution: beta
Probability of fail (non-zero): 0.008228704512978339
All-Passed: True
Probabilty of failure: 0.008228704512978339
Runtime: 4.551888888888889
Score: 4.551888888888889
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 3
Running with params: {'batchsize': 64, 'learning_rate': 0.017659450331219777, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.017659450331219777_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.1016666666666675, Max: 5.21, Min: 4.94
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9994375175330732
Evaluating 30 values out of 30
Overall-timings: Avg: 5.1016666666666675, Max: 5.21, Min: 4.94
Choosing distribution: gamma
Probability of fail (non-zero): 0.001889803258276646
All-Passed: True
Probabilty of failure: 0.001889803258276646
Runtime: 5.1016666666666675
Score: 5.1016666666666675
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 4
Running with params: {'batchsize': 2, 'learning_rate': 0.011875731740811642, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_0.011875731740811642_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 8.174666666666667, Max: 14.680000000000001, Min: 6.98
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.350597017574483
Exceeding current best timeout: 8.174666666666667 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 5
Running with params: {'batchsize': 2, 'learning_rate': 0.04876510700460954, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_0.04876510700460954_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.005666666666666, Max: 13.860000000000001, Min: 6.84
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 4.999781654621176
Exceeding current best timeout: 9.005666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 6
Running with params: {'batchsize': 2, 'learning_rate': 1.1631797076483585e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_1.1631797076483585e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.752333333333333, Max: 15.07, Min: 6.880000000000001
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.873986667100955
Exceeding current best timeout: 8.752333333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 7
Running with params: {'batchsize': 32, 'learning_rate': 0.034096207269076584, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_32_0.034096207269076584_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.309666666666667, Max: 14.77, Min: 6.83
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.7367883085656515
Exceeding current best timeout: 9.309666666666667 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 8
Running with params: {'batchsize': 8, 'learning_rate': 0.00027178346739820217, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.00027178346739820217_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7.928666666666667, Max: 12.020000000000001, Min: 6.95
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.3759522835552365
Exceeding current best timeout: 7.928666666666667 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 9
Running with params: {'batchsize': 64, 'learning_rate': 0.002610418828881146, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.002610418828881146_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.321, Max: 12.040000000000001, Min: 6.86
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.1353394350108528
Exceeding current best timeout: 8.321 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 10
Running with params: {'batchsize': 16, 'learning_rate': 8.591976936585485e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_16_8.591976936585485e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.580000000000002, Max: 14.450000000000001, Min: 6.83
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.048333080644023
Exceeding current best timeout: 8.580000000000002 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 11
Running with params: {'batchsize': 128, 'learning_rate': 0.8647253247887661, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_128_0.8647253247887661_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.326666666666666, Max: 13.35, Min: 6.8
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.7295896328868205
Exceeding current best timeout: 9.326666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 12
Running with params: {'batchsize': 16, 'learning_rate': 0.615849653878048, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_16_0.615849653878048_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.013333333333334, Max: 13.44, Min: 6.95
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.20344333562863
Exceeding current best timeout: 9.013333333333334 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 13
Running with params: {'batchsize': 32, 'learning_rate': 0.00012956212438624108, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_32_0.00012956212438624108_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.7, Max: 14.61, Min: 6.869999999999999
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 2.559584065475345
Exceeding current best timeout: 8.7 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 14
Running with params: {'batchsize': 2, 'learning_rate': 0.0028258881566247773, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_0.0028258881566247773_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 7...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.132, Max: 13.139999999999999, Min: 6.8500000000000005
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.3041424008039917
Exceeding current best timeout: 8.132 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 15
Running with params: {'batchsize': 128, 'learning_rate': 0.0014646747497763296, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_128_0.0014646747497763296_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.792333333333335, Max: 13.18, Min: 6.95
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 2.0146354733723824
Exceeding current best timeout: 8.792333333333335 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 16
Running with params: {'batchsize': 128, 'learning_rate': 0.0008340074091922491, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_128_0.0008340074091922491_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.405, Max: 13.1, Min: 6.8100000000000005
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.6308866573158378
Exceeding current best timeout: 8.405 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 17
Running with params: {'batchsize': 128, 'learning_rate': 0.005705321935235086, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_128_0.005705321935235086_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.873666666666669, Max: 14.93, Min: 6.93
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.210422373229988
Exceeding current best timeout: 8.873666666666669 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 18
Running with params: {'batchsize': 8, 'learning_rate': 0.0006410462224509102, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.0006410462224509102_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.234666666666666, Max: 14.85, Min: 6.96
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.3794771599915685
Exceeding current best timeout: 9.234666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 19
Running with params: {'batchsize': 32, 'learning_rate': 0.21557051873215852, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_32_0.21557051873215852_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.996333333333332, Max: 14.790000000000001, Min: 6.84
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.81865705367058
Exceeding current best timeout: 8.996333333333332 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 20
Running with params: {'batchsize': 2, 'learning_rate': 5.0299418415149385e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_5.0299418415149385e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 9.428666666666667, Max: 13.36, Min: 6.890000000000001
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.5426433027530546
Exceeding current best timeout: 9.428666666666667 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 21
Running with params: {'batchsize': 64, 'learning_rate': 0.09760563529583322, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.09760563529583322_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 9.305, Max: 13.31, Min: 6.94
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 3.1286583792092246
Exceeding current best timeout: 9.305 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 22
Running with params: {'batchsize': 64, 'learning_rate': 0.011518975106989304, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.011518975106989304_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.721333333333336, Max: 14.61, Min: 6.84
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5003545680229167
Exceeding current best timeout: 8.721333333333336 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 23
Running with params: {'batchsize': 64, 'learning_rate': 0.25083616947884635, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.25083616947884635_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.664, Max: 14.6, Min: 6.75
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.2707789689330173
Exceeding current best timeout: 8.664 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 24
Running with params: {'batchsize': 8, 'learning_rate': 0.03225017495463294, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.03225017495463294_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.297666666666666, Max: 14.860000000000001, Min: 6.96
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.026846838838128
Exceeding current best timeout: 9.297666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 25
Running with params: {'batchsize': 8, 'learning_rate': 0.02012727251818473, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.02012727251818473_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.732333333333333, Max: 13.530000000000001, Min: 6.93
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.2487413403285497
Exceeding current best timeout: 8.732333333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 26
Running with params: {'batchsize': 64, 'learning_rate': 0.08743752941252861, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.08743752941252861_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 8.657666666666668, Max: 13.370000000000001, Min: 6.859999999999999
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.4946941385723922
Exceeding current best timeout: 8.657666666666668 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 27
Running with params: {'batchsize': 64, 'learning_rate': 0.3261308512448558, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.3261308512448558_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.294333333333332, Max: 14.950000000000001, Min: 6.73
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.4447749539236772
Exceeding current best timeout: 9.294333333333332 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 28
Running with params: {'batchsize': 16, 'learning_rate': 0.007288439949349835, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_16_0.007288439949349835_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.308666666666669, Max: 13.63, Min: 6.88
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.0508828980513536
Exceeding current best timeout: 9.308666666666669 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 29
Running with params: {'batchsize': 8, 'learning_rate': 0.10265382111666736, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.10265382111666736_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.675666666666666, Max: 13.55, Min: 6.85
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 3.598508030042908
Exceeding current best timeout: 8.675666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 30
Running with params: {'batchsize': 8, 'learning_rate': 0.005880955416240879, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.005880955416240879_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.005666666666665, Max: 13.379999999999999, Min: 6.89
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 1.6729407444260644
Exceeding current best timeout: 9.005666666666665 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 31
Running with params: {'batchsize': 64, 'learning_rate': 0.012950960654147045, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.012950960654147045_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 9.675, Max: 13.51, Min: 6.82
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.871832634470952
Exceeding current best timeout: 9.675 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 32
Running with params: {'batchsize': 8, 'learning_rate': 0.00037049017262294064, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.00037049017262294064_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.132666666666667, Max: 15.549999999999999, Min: 6.92
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.9107006133254845
Exceeding current best timeout: 10.132666666666667 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 33
Running with params: {'batchsize': 32, 'learning_rate': 0.051927868401818435, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_32_0.051927868401818435_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 9.356666666666666, Max: 14.590000000000002, Min: 6.88
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.080819669175307
Exceeding current best timeout: 9.356666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 34
Running with params: {'batchsize': 16, 'learning_rate': 0.0017738279069163987, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_16_0.0017738279069163987_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.752666666666666, Max: 13.360000000000001, Min: 6.88
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.3732163633832375
Exceeding current best timeout: 8.752666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 35
Running with params: {'batchsize': 8, 'learning_rate': 0.015216309173038244, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.015216309173038244_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.032, Max: 15.100000000000001, Min: 6.83
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.981951068420758
Exceeding current best timeout: 9.032 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 36
Running with params: {'batchsize': 2, 'learning_rate': 1.841923943785158e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_1.841923943785158e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.398333333333333, Max: 15.07, Min: 6.8500000000000005
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 2.408741404268307
Exceeding current best timeout: 9.398333333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 37
Running with params: {'batchsize': 64, 'learning_rate': 0.02522966751463676, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.02522966751463676_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.109666666666666, Max: 14.97, Min: 6.909999999999999
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.309169875167172
Exceeding current best timeout: 9.109666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 38
Running with params: {'batchsize': 8, 'learning_rate': 0.00420113903208906, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.00420113903208906_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.87733333333333, Max: 14.77, Min: 6.89
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 3.8336780483813175
Exceeding current best timeout: 9.87733333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 39
Running with params: {'batchsize': 64, 'learning_rate': 0.47135246757813865, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.47135246757813865_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.009666666666668, Max: 13.41, Min: 6.81
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.5441939440769674
Exceeding current best timeout: 9.009666666666668 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 40
Running with params: {'batchsize': 32, 'learning_rate': 0.04727018388925553, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_32_0.04727018388925553_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.518666666666668, Max: 14.950000000000001, Min: 6.93
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.0779801697905644
Exceeding current best timeout: 9.518666666666668 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 41
Running with params: {'batchsize': 16, 'learning_rate': 0.16779397671445756, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_16_0.16779397671445756_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.443000000000001, Max: 11.83, Min: 6.930000000000001
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.7387697885482192
Exceeding current best timeout: 8.443000000000001 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 42
Running with params: {'batchsize': 2, 'learning_rate': 0.0017774294368421574, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_0.0017774294368421574_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.567, Max: 14.99, Min: 6.81
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.005971945211617
Exceeding current best timeout: 9.567 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 43
Running with params: {'batchsize': 128, 'learning_rate': 0.00023711380127509766, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_128_0.00023711380127509766_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.633333333333333, Max: 13.14, Min: 6.8999999999999995
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 1.5433808653981806
Exceeding current best timeout: 8.633333333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 44
Running with params: {'batchsize': 8, 'learning_rate': 0.8601069739220782, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.8601069739220782_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.652333333333333, Max: 14.950000000000001, Min: 6.93
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.8869398277720772
Exceeding current best timeout: 9.652333333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 45
Running with params: {'batchsize': 64, 'learning_rate': 0.0008268362288813326, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.0008268362288813326_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.768333333333333, Max: 14.799999999999999, Min: 6.91
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.1914881132454729
Exceeding current best timeout: 9.768333333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 46
Running with params: {'batchsize': 32, 'learning_rate': 0.00948336013603876, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_32_0.00948336013603876_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.787666666666665, Max: 13.27, Min: 6.92
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.394295942698917
Exceeding current best timeout: 8.787666666666665 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 47
Running with params: {'batchsize': 128, 'learning_rate': 0.002845307218663015, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_128_0.002845307218663015_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 15...
Iter 18...
Iter 19...
Iter 20...
Iter 17...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.662333333333335, Max: 13.55, Min: 6.75
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 3.3547433247345073
Exceeding current best timeout: 9.662333333333335 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 48
Running with params: {'batchsize': 2, 'learning_rate': 0.052172453726285345, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_0.052172453726285345_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.775333333333332, Max: 15.01, Min: 6.890000000000001
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 2.28334235265831
Exceeding current best timeout: 9.775333333333332 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 49
Running with params: {'batchsize': 16, 'learning_rate': 5.2957268442435904e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_16_5.2957268442435904e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.006333333333334, Max: 13.28, Min: 6.909999999999999
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.348723838062207
Exceeding current best timeout: 9.006333333333334 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 50
Running with params: {'batchsize': 8, 'learning_rate': 0.00047897857842404273, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.00047897857842404273_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.705666666666668, Max: 14.879999999999999, Min: 6.89
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 3.374403345503371
Exceeding current best timeout: 8.705666666666668 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Upto iteration 50: {'batchsize': 1, 'learning_rate': 0.012524049301142625, 'num_epochs': 0}
Optimization Iteration: 51
Running with params: {'batchsize': 64, 'learning_rate': 0.0011359278593210428, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.0011359278593210428_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.669, Max: 13.09, Min: 6.79
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.6197165743970503
Exceeding current best timeout: 8.669 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 52
Running with params: {'batchsize': 128, 'learning_rate': 0.0040079773957652914, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_128_0.0040079773957652914_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.738333333333333, Max: 13.17, Min: 6.84
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.835494329017012
Exceeding current best timeout: 8.738333333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 53
Running with params: {'batchsize': 32, 'learning_rate': 0.02185596764353799, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_32_0.02185596764353799_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 8.472333333333335, Max: 13.110000000000001, Min: 6.91
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 2.797146237285073
Exceeding current best timeout: 8.472333333333335 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 54
Running with params: {'batchsize': 64, 'learning_rate': 0.0001392914352745173, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.0001392914352745173_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.383000000000001, Max: 13.0, Min: 6.79
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.133426550165994
Exceeding current best timeout: 8.383000000000001 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 55
Running with params: {'batchsize': 8, 'learning_rate': 0.1701334921474644, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.1701334921474644_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.200333333333333, Max: 13.180000000000001, Min: 6.91
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.495505424115155
Exceeding current best timeout: 8.200333333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 56
Running with params: {'batchsize': 2, 'learning_rate': 0.08807173325957632, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_0.08807173325957632_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.558, Max: 13.09, Min: 6.859999999999999
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.7038933976608261
Exceeding current best timeout: 8.558 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 57
Running with params: {'batchsize': 64, 'learning_rate': 0.03229741006408527, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.03229741006408527_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.901666666666669, Max: 15.0, Min: 6.8100000000000005
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.4709178025994822
Exceeding current best timeout: 8.901666666666669 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 58
Running with params: {'batchsize': 16, 'learning_rate': 0.38342988894760777, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_16_0.38342988894760777_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.058666666666666, Max: 11.700000000000001, Min: 6.88
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.1153194253318905
Exceeding current best timeout: 8.058666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 59
Running with params: {'batchsize': 8, 'learning_rate': 1.2724218549670681e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_1.2724218549670681e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.328, Max: 13.26, Min: 6.86
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 3.1720831958260876
Exceeding current best timeout: 8.328 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 60
Running with params: {'batchsize': 128, 'learning_rate': 0.008361862051361836, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_128_0.008361862051361836_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 8.847333333333333, Max: 13.040000000000001, Min: 6.91
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.576252994516527
Exceeding current best timeout: 8.847333333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 61
Running with params: {'batchsize': 64, 'learning_rate': 0.6677164147214649, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.6677164147214649_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.059333333333333, Max: 14.610000000000001, Min: 6.89
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.5931726778494877
Exceeding current best timeout: 9.059333333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 62
Running with params: {'batchsize': 8, 'learning_rate': 0.13950598488637417, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.13950598488637417_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.956333333333335, Max: 13.23, Min: 6.8999999999999995
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.5100260168051975
Exceeding current best timeout: 8.956333333333335 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 63
Running with params: {'batchsize': 32, 'learning_rate': 0.01580452758127256, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_32_0.01580452758127256_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.765666666666668, Max: 13.4, Min: 6.92
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.4258006612732743
Exceeding current best timeout: 8.765666666666668 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 64
Running with params: {'batchsize': 2, 'learning_rate': 0.002434422887138574, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_0.002434422887138574_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.981333333333334, Max: 14.51, Min: 6.83
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.1239744302919
Exceeding current best timeout: 8.981333333333334 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 65
Running with params: {'batchsize': 64, 'learning_rate': 0.004797466105957139, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.004797466105957139_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Iter 26...
Timings: Avg: 9.342333333333332, Max: 14.92, Min: 6.89
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.3333333333333326
Exceeding current best timeout: 9.342333333333332 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 66
Running with params: {'batchsize': 8, 'learning_rate': 0.06892660721230184, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.06892660721230184_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.492666666666667, Max: 14.700000000000001, Min: 6.78
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 2.2206674308176115
Exceeding current best timeout: 9.492666666666667 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 67
Running with params: {'batchsize': 8, 'learning_rate': 0.007262672528324407, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.007262672528324407_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 9.050666666666666, Max: 14.76, Min: 6.88
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.090873683898316
Exceeding current best timeout: 9.050666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 68
Running with params: {'batchsize': 8, 'learning_rate': 0.001314267191857617, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.001314267191857617_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 9.058333333333335, Max: 14.65, Min: 6.92
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.0639490484227856
Exceeding current best timeout: 9.058333333333335 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 69
Running with params: {'batchsize': 8, 'learning_rate': 0.0022234295673917953, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.0022234295673917953_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.520999999999999, Max: 13.37, Min: 6.87
Passed tests : 27
Failed tests : 3
Converged: True
Convergence score: 0.8778045705489428
Evaluating 30 values out of 30
Overall-timings: Avg: 8.520999999999999, Max: 13.37, Min: 6.87
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.3741373497877977
Exceeding max probability of failure: 0.3741373497877977
All-Passed: False
Probabilty of failure: 0.3741373497877977
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 70
Running with params: {'batchsize': 8, 'learning_rate': 0.03994176811328104, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.03994176811328104_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.317333333333334, Max: 13.13, Min: 6.81
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.363415692080429
Exceeding current best timeout: 8.317333333333334 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 71
Running with params: {'batchsize': 8, 'learning_rate': 0.010485271696829085, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.010485271696829085_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 21...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.341333333333333, Max: 14.77, Min: 6.92
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.5286954802198625
Exceeding current best timeout: 9.341333333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 72
Running with params: {'batchsize': 16, 'learning_rate': 0.0036504582622935034, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_16_0.0036504582622935034_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.077333333333334, Max: 12.95, Min: 6.92
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.224690232292799
Exceeding current best timeout: 8.077333333333334 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 73
Running with params: {'batchsize': 8, 'learning_rate': 0.017286937472695118, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.017286937472695118_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.858333333333336, Max: 15.19, Min: 6.83
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 2.2195297356973365
Exceeding current best timeout: 9.858333333333336 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 74
Running with params: {'batchsize': 64, 'learning_rate': 0.029797162963766336, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.029797162963766336_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.387333333333334, Max: 13.4, Min: 6.8999999999999995
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.1759974367341393
Exceeding current best timeout: 9.387333333333334 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 75
Running with params: {'batchsize': 8, 'learning_rate': 0.005911787903657601, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.005911787903657601_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.619666666666667, Max: 14.52, Min: 6.890000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.0555489170735677
Exceeding current best timeout: 9.619666666666667 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 76
Running with params: {'batchsize': 32, 'learning_rate': 0.00074023487655542, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_32_0.00074023487655542_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.866000000000001, Max: 14.92, Min: 6.89
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.2132669799727487
Exceeding current best timeout: 8.866000000000001 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 77
Running with params: {'batchsize': 128, 'learning_rate': 0.00019838431143363397, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_128_0.00019838431143363397_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.199000000000002, Max: 14.98, Min: 6.84
Passed tests : 25
Failed tests : 5
Converged: True
Convergence score: 0.9899494936611691
Evaluating 30 values out of 30
Overall-timings: Avg: 9.199000000000002, Max: 14.98, Min: 6.84
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.424914361019449
Exceeding max probability of failure: 0.424914361019449
All-Passed: False
Probabilty of failure: 0.424914361019449
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 78
Running with params: {'batchsize': 64, 'learning_rate': 0.00039849199362173855, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.00039849199362173855_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.890000000000002, Max: 13.39, Min: 6.859999999999999
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.1143705310911909
Exceeding current best timeout: 8.890000000000002 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 79
Running with params: {'batchsize': 2, 'learning_rate': 0.0009757645189880728, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_0.0009757645189880728_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 9.387666666666666, Max: 13.459999999999999, Min: 6.92
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 2.275916193656513
Exceeding current best timeout: 9.387666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 80
Running with params: {'batchsize': 8, 'learning_rate': 0.06282942248276782, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.06282942248276782_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.740333333333334, Max: 13.21, Min: 6.87
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 3.3902363886285056
Exceeding current best timeout: 8.740333333333334 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 81
Running with params: {'batchsize': 16, 'learning_rate': 0.25322704801416585, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_16_0.25322704801416585_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.97933333333333, Max: 15.639999999999999, Min: 7.0200000000000005
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 1.5556349186104048
Exceeding current best timeout: 9.97933333333333 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 82
Running with params: {'batchsize': 8, 'learning_rate': 0.12553627563639375, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.12553627563639375_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.533999999999999, Max: 12.25, Min: 7.0
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.8164185363996646
Exceeding current best timeout: 8.533999999999999 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 83
Running with params: {'batchsize': 64, 'learning_rate': 0.011587520150952532, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.011587520150952532_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.382666666666669, Max: 13.24, Min: 6.9
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.6199352038877413
Exceeding current best timeout: 8.382666666666669 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 84
Running with params: {'batchsize': 32, 'learning_rate': 0.001912163282706211, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_32_0.001912163282706211_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.743666666666666, Max: 13.22, Min: 6.859999999999999
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.8188262193808722
Exceeding current best timeout: 8.743666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 85
Running with params: {'batchsize': 128, 'learning_rate': 0.023052618020473734, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_128_0.023052618020473734_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.738000000000001, Max: 14.97, Min: 6.92
Passed tests : 23
Failed tests : 7
Converged: True
Convergence score: 0.8903101928862335
Evaluating 30 values out of 30
Overall-timings: Avg: 9.738000000000001, Max: 14.97, Min: 6.92
Choosing distribution: logistic
Probability of fail (non-zero): 0.5549711467204473
Exceeding max probability of failure: 0.5549711467204473
All-Passed: False
Probabilty of failure: 0.5549711467204473
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 86
Running with params: {'batchsize': 8, 'learning_rate': 0.0005531847750605979, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.0005531847750605979_3
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.495, Max: 14.790000000000001, Min: 7.010000000000001
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 3.3280548924392197
Exceeding current best timeout: 8.495 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 87
Running with params: {'batchsize': 64, 'learning_rate': 0.004982478401303718, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.004982478401303718_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.208666666666666, Max: 15.01, Min: 6.92
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 1.5529351708117891
Exceeding current best timeout: 9.208666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 88
Running with params: {'batchsize': 2, 'learning_rate': 6.741154866083987e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_6.741154866083987e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.756666666666668, Max: 13.68, Min: 6.89
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.3373327757000317
Exceeding current best timeout: 8.756666666666668 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 89
Running with params: {'batchsize': 16, 'learning_rate': 0.003491180667647207, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_16_0.003491180667647207_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.428333333333335, Max: 13.5, Min: 6.88
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.9560177056343995
Exceeding current best timeout: 9.428333333333335 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 90
Running with params: {'batchsize': 8, 'learning_rate': 0.006355287617098146, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.006355287617098146_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.809666666666667, Max: 15.16, Min: 6.8
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 3.21692095669763
Exceeding current best timeout: 9.809666666666667 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 91
Running with params: {'batchsize': 64, 'learning_rate': 0.012818436050300443, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.012818436050300443_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.666, Max: 13.39, Min: 6.8999999999999995
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.835476663893746
Exceeding current best timeout: 8.666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 92
Running with params: {'batchsize': 128, 'learning_rate': 0.06378353938458692, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_128_0.06378353938458692_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.232000000000001, Max: 14.76, Min: 6.88
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.8207119161615126
Exceeding current best timeout: 8.232000000000001 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 93
Running with params: {'batchsize': 8, 'learning_rate': 0.003087724331106103, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.003087724331106103_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 8.328666666666667, Max: 11.959999999999999, Min: 6.84
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.6990282257191556
Exceeding current best timeout: 8.328666666666667 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 94
Running with params: {'batchsize': 32, 'learning_rate': 0.00029644913853235525, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_32_0.00029644913853235525_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 21...
Iter 23...
Iter 20...
Iter 24...
Iter 25...
Iter 22...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.253333333333334, Max: 14.790000000000001, Min: 6.88
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.8216688924379165
Exceeding current best timeout: 9.253333333333334 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 95
Running with params: {'batchsize': 64, 'learning_rate': 2.3867992791212826e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_2.3867992791212826e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 18...
Iter 19...
Iter 16...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.199000000000002, Max: 14.729999999999999, Min: 6.9
Passed tests : 26
Failed tests : 4
Converged: False
Convergence score: 2.10447304047009
Exceeding current best timeout: 9.199000000000002 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 96
Running with params: {'batchsize': 2, 'learning_rate': 0.04144710752199272, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_2_0.04144710752199272_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 4...
Iter 3...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.550999999999998, Max: 15.09, Min: 6.88
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.827567222235825
Exceeding current best timeout: 9.550999999999998 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 97
Running with params: {'batchsize': 8, 'learning_rate': 0.001488603376952357, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.001488603376952357_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.101666666666667, Max: 13.5, Min: 6.9799999999999995
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.588273107802356
Exceeding current best timeout: 9.101666666666667 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 98
Running with params: {'batchsize': 16, 'learning_rate': 0.008652315175916997, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_16_0.008652315175916997_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 27...
Iter 28...
Timings: Avg: 8.397, Max: 11.94, Min: 6.819999999999999
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.997850059613951
Exceeding current best timeout: 8.397 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 99
Running with params: {'batchsize': 8, 'learning_rate': 0.027852242919371818, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_8_0.027852242919371818_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.948666666666666, Max: 14.850000000000001, Min: 6.89
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.7959982617189698
Exceeding current best timeout: 8.948666666666666 > 4.551888888888889
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Optimization Iteration: 100
Running with params: {'batchsize': 64, 'learning_rate': 0.9615965349142669, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597823352/assert_36779984_64_0.9615965349142669_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.248666666666667, Max: 14.56, Min: 6.88
Passed tests : 27
Failed tests : 3
Converged: True
Convergence score: 0.968813899354653
Evaluating 30 values out of 30
Overall-timings: Avg: 8.248666666666667, Max: 14.56, Min: 6.88
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.30366326084614587
Exceeding max probability of failure: 0.30366326084614587
All-Passed: False
Probabilty of failure: 0.30366326084614587
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.551888888888889
Best-param: {'batchsize': 8, 'learning_rate': 0.012524049301142625, 'num_epochs': 1}
Upto iteration 100: {'batchsize': 1, 'learning_rate': 0.012524049301142625, 'num_epochs': 0}
Breaking...
{'batchsize': 1, 'learning_rate': 0.012524049301142625, 'num_epochs': 0}
Best score: 4.551888888888889
Repeated params: 0
Trials: 101
Best param {'batchsize': 1, 'learning_rate': 0.012524049301142625, 'num_epochs': 0}
Reduction: 23.46443600629592%
Speedup: 1.306582127077892x
Optimizer time: 1445.3019649982452
