Repo: parlai
Filename: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/projects/parlai/tests/test_tra.py
ClassName: TestMemNN
Testname: test_eval_fixed
Params: learning_rate,35,25,ParamType.LR,0.007
num_epochs,38,23,ParamType.CHAINS,4
batchsize,36,22,ParamType.CHAINS,16
Assertion: self.assertGreaterEqual(valid['hits@100'], 0.1)
Original runtime: 5.741
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_0.007_4_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.985666666666666, Max: 6.13, Min: 5.88
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.132151913747049
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 27...
Iter 28...
Iter 24...
Iter 29...
Iter 25...
Iter 26...
Timings: Avg: 5.970500000000001, Max: 6.13, Min: 5.82
Passed tests : 60
Failed tests : 0
Converged: False
Convergence score: 1.2444681676606557
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.9573333333333345, Max: 6.13, Min: 5.7700000000000005
Passed tests : 90
Failed tests : 0
Converged: True
Convergence score: 0.839260096716382
Evaluating 90 values out of 90
Overall-timings: Avg: 5.9573333333333345, Max: 6.13, Min: 5.7700000000000005
Choosing distribution: beta
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.9573333333333345
Score: 5.9573333333333345
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
>>Setting original runtime to 5.9573333333333345
Optimization Iteration: 1
Running with params: {'batchsize': 128, 'learning_rate': 0.0009176960029229157, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.0009176960029229157_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.096333333333334, Max: 12.83, Min: 7.57
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9828625508099982
Exceeding current best timeout: 8.096333333333334 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 2
Running with params: {'batchsize': 64, 'learning_rate': 0.0036760885826181296, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_64_0.0036760885826181296_3
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 2...
Iter 0...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.540333333333335, Max: 13.09, Min: 7.55
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.7722837609212085
Exceeding current best timeout: 8.540333333333335 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 3
Running with params: {'batchsize': 64, 'learning_rate': 0.0008247716718554596, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_64_0.0008247716718554596_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.181666666666667, Max: 10.65, Min: 7.49
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9303299157743512
Evaluating 30 values out of 30
Overall-timings: Avg: 8.181666666666667, Max: 10.65, Min: 7.49
Choosing distribution: dweibull
Probability of fail (non-zero): 0.20640454073642667
Exceeding max probability of failure: 0.20640454073642667
All-Passed: False
Probabilty of failure: 0.20640454073642667
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 4
Running with params: {'batchsize': 128, 'learning_rate': 0.0004417038869380048, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.0004417038869380048_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.608, Max: 12.41, Min: 7.5600000000000005
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9253474400921236
Exceeding current best timeout: 8.608 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 5
Running with params: {'batchsize': 8, 'learning_rate': 0.32465679052485086, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_8_0.32465679052485086_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.659, Max: 13.19, Min: 7.61
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.46732297687875
Exceeding current best timeout: 8.659 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 6
Running with params: {'batchsize': 64, 'learning_rate': 0.03213655692173306, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_64_0.03213655692173306_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.753333333333332, Max: 15.27, Min: 7.539999999999999
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.6093855427897612
Evaluating 30 values out of 30
Overall-timings: Avg: 8.753333333333332, Max: 15.27, Min: 7.539999999999999
Choosing distribution: halfcauchy
Probability of fail (non-zero): 0.35750456802165387
Exceeding max probability of failure: 0.35750456802165387
All-Passed: False
Probabilty of failure: 0.35750456802165387
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 7
Running with params: {'batchsize': 2, 'learning_rate': 0.0008818356210869664, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_2_0.0008818356210869664_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7.983333333333334, Max: 12.89, Min: 7.37
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.8824221322879064
Exceeding current best timeout: 7.983333333333334 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 8
Running with params: {'batchsize': 64, 'learning_rate': 0.05545955117906128, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_64_0.05545955117906128_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.012666666666668, Max: 12.59, Min: 7.54
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3218988016002198
Exceeding current best timeout: 9.012666666666668 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 9
Running with params: {'batchsize': 2, 'learning_rate': 0.00012261088943421364, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_2_0.00012261088943421364_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.276666666666667, Max: 13.280000000000001, Min: 7.5
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.1549817953651254
Exceeding current best timeout: 8.276666666666667 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 10
Running with params: {'batchsize': 16, 'learning_rate': 1.399556561563051e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_16_1.399556561563051e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 8.334999999999999, Max: 10.700000000000001, Min: 7.6
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 5.0460732018005725
Exceeding current best timeout: 8.334999999999999 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 11
Running with params: {'batchsize': 32, 'learning_rate': 0.0004070036267949052, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_32_0.0004070036267949052_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 9.399, Max: 15.290000000000001, Min: 7.5200000000000005
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8003580751079136
Exceeding current best timeout: 9.399 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 12
Running with params: {'batchsize': 32, 'learning_rate': 0.030555493028558964, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_32_0.030555493028558964_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.514999999999999, Max: 13.33, Min: 7.6499999999999995
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2290540531822716
Exceeding current best timeout: 8.514999999999999 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 13
Running with params: {'batchsize': 128, 'learning_rate': 0.08164954362425794, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.08164954362425794_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.948333333333332, Max: 15.139999999999999, Min: 7.38
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.9042794530597107
Exceeding current best timeout: 8.948333333333332 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 14
Running with params: {'batchsize': 64, 'learning_rate': 2.48965602633436e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_64_2.48965602633436e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.584333333333332, Max: 13.34, Min: 7.62
Passed tests : 29
Failed tests : 1
Converged: True
Convergence score: 0.7986965403285917
Evaluating 30 values out of 30
Overall-timings: Avg: 8.584333333333332, Max: 13.34, Min: 7.62
Choosing distribution: dweibull
Probability of fail (non-zero): 0.21280151712122006
Exceeding max probability of failure: 0.21280151712122006
All-Passed: False
Probabilty of failure: 0.21280151712122006
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 15
Running with params: {'batchsize': 64, 'learning_rate': 0.2888751237806, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_64_0.2888751237806_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.191333333333334, Max: 13.0, Min: 7.56
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.502165439990222
Exceeding current best timeout: 8.191333333333334 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 16
Running with params: {'batchsize': 64, 'learning_rate': 0.5670638316277393, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_64_0.5670638316277393_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 8.209333333333333, Max: 12.920000000000002, Min: 7.6000000000000005
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6879323163807909
Exceeding current best timeout: 8.209333333333333 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 17
Running with params: {'batchsize': 2, 'learning_rate': 0.030213076199579456, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_2_0.030213076199579456_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.735333333333333, Max: 13.1, Min: 7.42
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.995329528556115
Exceeding current best timeout: 8.735333333333333 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 18
Running with params: {'batchsize': 2, 'learning_rate': 0.026060860335303925, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_2_0.026060860335303925_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.638666666666667, Max: 13.120000000000001, Min: 7.5600000000000005
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9158941159731107
Exceeding current best timeout: 8.638666666666667 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 19
Running with params: {'batchsize': 128, 'learning_rate': 0.40807548301469526, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.40807548301469526_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.232333333333335, Max: 17.47, Min: 7.55
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.094647800255362
Exceeding current best timeout: 9.232333333333335 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 20
Running with params: {'batchsize': 8, 'learning_rate': 3.4255222159354535e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_8_3.4255222159354535e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.388333333333334, Max: 13.18, Min: 7.69
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.679267224650344
Exceeding current best timeout: 8.388333333333334 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 21
Running with params: {'batchsize': 16, 'learning_rate': 0.009743102828144775, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_16_0.009743102828144775_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.924333333333331, Max: 13.309999999999999, Min: 7.58
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.1850500440979395
Exceeding current best timeout: 8.924333333333331 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 22
Running with params: {'batchsize': 128, 'learning_rate': 0.002592228790773711, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.002592228790773711_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.513333333333332, Max: 13.08, Min: 7.59
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 5.119878116463089
Exceeding current best timeout: 8.513333333333332 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 23
Running with params: {'batchsize': 8, 'learning_rate': 5.797347658559441e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_8_5.797347658559441e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.762, Max: 15.06, Min: 7.390000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6368252577447868
Exceeding current best timeout: 8.762 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 24
Running with params: {'batchsize': 16, 'learning_rate': 0.008373114325769768, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_16_0.008373114325769768_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.148, Max: 13.42, Min: 7.529999999999999
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.9771864882368608
Exceeding current best timeout: 9.148 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 25
Running with params: {'batchsize': 128, 'learning_rate': 0.0019760111409903845, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.0019760111409903845_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.792, Max: 13.2, Min: 7.48
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.375294573644544
Exceeding current best timeout: 8.792 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 26
Running with params: {'batchsize': 8, 'learning_rate': 0.00010659572439122411, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_8_0.00010659572439122411_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.778333333333332, Max: 15.15, Min: 7.5600000000000005
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 0.9789970417850916
Exceeding current best timeout: 8.778333333333332 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 27
Running with params: {'batchsize': 16, 'learning_rate': 0.011839421297691905, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_16_0.011839421297691905_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 8.922333333333334, Max: 12.709999999999999, Min: 7.430000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4214874014183654
Exceeding current best timeout: 8.922333333333334 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 28
Running with params: {'batchsize': 128, 'learning_rate': 0.0028508258382560886, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.0028508258382560886_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.322333333333333, Max: 13.01, Min: 7.66
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.7289253506157385
Exceeding current best timeout: 8.322333333333333 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 29
Running with params: {'batchsize': 8, 'learning_rate': 9.691264685101844e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_8_9.691264685101844e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 8.986999999999998, Max: 13.5, Min: 7.45
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.764443364819801
Exceeding current best timeout: 8.986999999999998 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 30
Running with params: {'batchsize': 16, 'learning_rate': 0.007640904976457712, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_16_0.007640904976457712_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.491333333333333, Max: 15.4, Min: 7.47
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.2030201095435789
Exceeding current best timeout: 8.491333333333333 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 31
Running with params: {'batchsize': 128, 'learning_rate': 0.0011746909753927084, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.0011746909753927084_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.151999999999997, Max: 15.39, Min: 7.64
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.728090518312432
Exceeding current best timeout: 9.151999999999997 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 32
Running with params: {'batchsize': 8, 'learning_rate': 0.00025580435142831255, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_8_0.00025580435142831255_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.764333333333333, Max: 13.26, Min: 7.55
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.0508845533038658
Exceeding current best timeout: 8.764333333333333 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 33
Running with params: {'batchsize': 16, 'learning_rate': 0.007088127450190731, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_16_0.007088127450190731_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.219333333333333, Max: 17.380000000000003, Min: 7.62
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2108926306447259
Exceeding current best timeout: 9.219333333333333 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 34
Running with params: {'batchsize': 128, 'learning_rate': 0.00124871508266987, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.00124871508266987_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.552666666666665, Max: 15.18, Min: 7.6899999999999995
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9778294587917529
Exceeding current best timeout: 8.552666666666665 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 35
Running with params: {'batchsize': 8, 'learning_rate': 0.0003254408490647228, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_8_0.0003254408490647228_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.506333333333332, Max: 13.09, Min: 7.5600000000000005
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6873916677505816
Exceeding current best timeout: 8.506333333333332 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 36
Running with params: {'batchsize': 32, 'learning_rate': 3.197079778781095e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_32_3.197079778781095e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.585, Max: 13.21, Min: 7.61
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.6936044386363973
Exceeding current best timeout: 8.585 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 37
Running with params: {'batchsize': 16, 'learning_rate': 0.13294407562877658, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_16_0.13294407562877658_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 13...
Iter 14...
Iter 12...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.131666666666666, Max: 15.040000000000001, Min: 7.540000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4834354695660776
Exceeding current best timeout: 9.131666666666666 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 38
Running with params: {'batchsize': 16, 'learning_rate': 0.0006241946863969136, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_16_0.0006241946863969136_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.2, Max: 13.01, Min: 7.57
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5028363920431491
Exceeding current best timeout: 8.2 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 39
Running with params: {'batchsize': 128, 'learning_rate': 0.0001844052747869857, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.0001844052747869857_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 9.714333333333332, Max: 17.419999999999998, Min: 7.5
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.0268005825122315
Exceeding current best timeout: 9.714333333333332 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 40
Running with params: {'batchsize': 128, 'learning_rate': 0.0015593288127804784, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.0015593288127804784_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.596333333333332, Max: 13.15, Min: 7.36
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2246902322928017
Exceeding current best timeout: 8.596333333333332 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 41
Running with params: {'batchsize': 8, 'learning_rate': 1.0174953666987581e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_8_1.0174953666987581e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.673, Max: 13.01, Min: 7.51
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.3862332637068366
Exceeding current best timeout: 8.673 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 42
Running with params: {'batchsize': 32, 'learning_rate': 5.636922953006304e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_32_5.636922953006304e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.237333333333334, Max: 12.92, Min: 7.55
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.8589556903873338
Evaluating 30 values out of 30
Overall-timings: Avg: 8.237333333333334, Max: 12.92, Min: 7.55
Choosing distribution: beta
Probability of fail (non-zero): 0.2774605411961321
Exceeding max probability of failure: 0.2774605411961321
All-Passed: False
Probabilty of failure: 0.2774605411961321
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 43
Running with params: {'batchsize': 16, 'learning_rate': 0.018522386514915008, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_16_0.018522386514915008_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 27...
Iter 28...
Timings: Avg: 8.258666666666665, Max: 13.08, Min: 7.44
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8482582054898564
Exceeding current best timeout: 8.258666666666665 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 44
Running with params: {'batchsize': 2, 'learning_rate': 0.06461769464546167, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_2_0.06461769464546167_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.267333333333333, Max: 12.299999999999999, Min: 7.66
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2508209679905673
Exceeding current best timeout: 8.267333333333333 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 45
Running with params: {'batchsize': 128, 'learning_rate': 0.004561661809047833, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.004561661809047833_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.001333333333331, Max: 13.26, Min: 7.48
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 3.121835414238099
Exceeding current best timeout: 9.001333333333331 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 46
Running with params: {'batchsize': 128, 'learning_rate': 0.0005809868275537726, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_128_0.0005809868275537726_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.875333333333336, Max: 13.26, Min: 7.45
Passed tests : 29
Failed tests : 1
Converged: True
Convergence score: 0.888628087389476
Evaluating 30 values out of 30
Overall-timings: Avg: 8.875333333333336, Max: 13.26, Min: 7.45
Choosing distribution: invweibull
Probability of fail (non-zero): 0.34944624951256115
Exceeding max probability of failure: 0.34944624951256115
All-Passed: False
Probabilty of failure: 0.34944624951256115
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 47
Running with params: {'batchsize': 8, 'learning_rate': 0.00015898927252677944, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_8_0.00015898927252677944_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 8.605333333333334, Max: 12.58, Min: 7.550000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.237948620447932
Exceeding current best timeout: 8.605333333333334 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 48
Running with params: {'batchsize': 64, 'learning_rate': 1.5378225390475893e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_64_1.5378225390475893e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.866666666666669, Max: 15.05, Min: 7.619999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5762384874688498
Exceeding current best timeout: 8.866666666666669 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 49
Running with params: {'batchsize': 32, 'learning_rate': 0.10222165313695103, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_32_0.10222165313695103_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.554, Max: 15.0, Min: 7.470000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.104182080700863
Exceeding current best timeout: 8.554 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 50
Running with params: {'batchsize': 2, 'learning_rate': 0.013724059411128696, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597817585/assert_47395317_2_0.013724059411128696_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.392666666666665, Max: 15.14, Min: 7.5
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.431794517656073
Exceeding current best timeout: 9.392666666666665 > 5.9573333333333345
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 5.9573333333333345
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Exception>>>
Traceback (most recent call last):
  File "optimizer.py", line 65, in run_optimizer
    result, trialsobj = bayesopt.sample()
  File "/mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/src/strategy/bayesopt.py", line 159, in sample
    verbose=True, timeout=6000)
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 482, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 686, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 516, in fmin
    return trials.argmin
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 622, in argmin
    best_trial = self.best_trial
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 613, in best_trial
    raise AllTrialsFailed
hyperopt.exceptions.AllTrialsFailed

Optimizer time: 718.0516242980957
