Repo: parlai
Filename: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/projects/parlai/tests/test_tra.py
ClassName: TestPolyRanker
Testname: test_train_inline
Params: learning_rate,35,25,ParamType.LR,0.007
num_epochs,38,23,ParamType.CHAINS,4
batchsize,36,22,ParamType.CHAINS,16
Assertion: self.assertGreaterEqual(valid['hits@1'], threshold)
Original runtime: 7.381
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_0.007_4_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7.477666666666667, Max: 7.71, Min: 7.17
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.8832233869814203
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 13...
Iter 12...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 7.475499999999999, Max: 7.71, Min: 7.17
Passed tests : 60
Failed tests : 0
Converged: True
Convergence score: 0.6758062187188164
Evaluating 60 values out of 60
Overall-timings: Avg: 7.475499999999999, Max: 7.71, Min: 7.17
Choosing distribution: t
Probability of fail (non-zero): 0.0004514498909891252
All-Passed: True
Probabilty of failure: 0.0004514498909891252
Runtime: 7.475499999999999
Score: 7.475499999999999
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
>>Setting original runtime to 7.475499999999999
Optimization Iteration: 1
Running with params: {'batchsize': 2, 'learning_rate': 9.021766342754327e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_9.021766342754327e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3080000000000003, Max: 3.41, Min: 3.04
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 2
Running with params: {'batchsize': 32, 'learning_rate': 0.0011905273711567321, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_32_0.0011905273711567321_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 27...
Iter 28...
Timings: Avg: 13.457999999999998, Max: 15.41, Min: 6.66
Passed tests : 7
Failed tests : 23
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 3
Running with params: {'batchsize': 64, 'learning_rate': 0.008378588135315614, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_64_0.008378588135315614_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 6.323666666666665, Max: 8.07, Min: 5.89
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.443352758497384
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.317499999999999, Max: 8.07, Min: 5.89
Passed tests : 60
Failed tests : 0
Converged: False
Convergence score: 0.9920479646383699
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 11...
Iter 12...
Iter 10...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 27...
Iter 28...
Timings: Avg: 6.2827777777777785, Max: 8.07, Min: 5.88
Passed tests : 90
Failed tests : 0
Converged: False
Convergence score: 1.0428771255949023
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.3269166666666665, Max: 8.2, Min: 5.88
Passed tests : 120
Failed tests : 0
Converged: False
Convergence score: 1.7430168538934534
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 6.380866666666667, Max: 9.739999999999998, Min: 5.88
Passed tests : 150
Failed tests : 0
Converged: False
Convergence score: 2.5503392163481555
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.347833333333334, Max: 9.739999999999998, Min: 5.88
Passed tests : 180
Failed tests : 0
Converged: False
Convergence score: 1.6498839966095897
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.362714285714286, Max: 9.739999999999998, Min: 5.88
Passed tests : 210
Failed tests : 0
Converged: False
Convergence score: 1.6424726317822902
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.356125, Max: 9.739999999999998, Min: 5.88
Passed tests : 240
Failed tests : 0
Converged: False
Convergence score: 1.646671605852731
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.380592592592593, Max: 10.82, Min: 5.88
Passed tests : 270
Failed tests : 0
Converged: False
Convergence score: 1.7559801611080104
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.385233333333334, Max: 10.82, Min: 5.88
Passed tests : 300
Failed tests : 0
Converged: False
Convergence score: 1.352014410589111
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.4019696969696955, Max: 10.82, Min: 5.88
Passed tests : 330
Failed tests : 0
Converged: False
Convergence score: 1.3041416501650571
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.409527777777779, Max: 10.82, Min: 5.88
Passed tests : 360
Failed tests : 0
Converged: True
Convergence score: 0.7694072175564316
Evaluating 360 values out of 360
Overall-timings: Avg: 6.409527777777779, Max: 10.82, Min: 5.88
Choosing distribution: beta
Choosing distribution: lognorm
Probability of fail (non-zero): 0.14902526134909078
Exceeding max probability of failure: 0.14902526134909078
All-Passed: False
Probabilty of failure: 0.14902526134909078
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 4
Running with params: {'batchsize': 32, 'learning_rate': 0.00010237151200624044, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_32_0.00010237151200624044_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 15.088666666666667, Max: 15.32, Min: 14.799999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 5
Running with params: {'batchsize': 128, 'learning_rate': 0.07121225056304424, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_128_0.07121225056304424_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 13.188333333333334, Max: 13.42, Min: 12.83
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 6
Running with params: {'batchsize': 8, 'learning_rate': 0.3356715789712225, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_8_0.3356715789712225_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3176666666666668, Max: 3.37, Min: 3.26
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 7
Running with params: {'batchsize': 64, 'learning_rate': 0.2952529772479671, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_64_0.2952529772479671_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 11.358333333333333, Max: 11.67, Min: 11.15
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 8
Running with params: {'batchsize': 8, 'learning_rate': 0.02344484017947263, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_8_0.02344484017947263_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.347333333333333, Max: 3.39, Min: 3.29
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 9
Running with params: {'batchsize': 2, 'learning_rate': 0.01492197154025497, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.01492197154025497_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3133333333333326, Max: 3.3600000000000003, Min: 3.21
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 10
Running with params: {'batchsize': 128, 'learning_rate': 0.004336487753853925, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_128_0.004336487753853925_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.386333333333335, Max: 11.7, Min: 11.18
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 11
Running with params: {'batchsize': 32, 'learning_rate': 0.0006028785424754501, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_32_0.0006028785424754501_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.334, Max: 8.63, Min: 8.19
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 12
Running with params: {'batchsize': 16, 'learning_rate': 0.0005090914834844013, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_16_0.0005090914834844013_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 8.471333333333336, Max: 8.690000000000001, Min: 8.3
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 13
Running with params: {'batchsize': 16, 'learning_rate': 3.147240125881926e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_16_3.147240125881926e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 11.272333333333332, Max: 11.49, Min: 11.040000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 14
Running with params: {'batchsize': 32, 'learning_rate': 0.04677929667239461, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_32_0.04677929667239461_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.190666666666665, Max: 12.94, Min: 5.88
Passed tests : 18
Failed tests : 12
Converged: False
Convergence score: 2.0801257358446095
Exceeding current best timeout: 10.190666666666665 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 15
Running with params: {'batchsize': 128, 'learning_rate': 0.0009292103564501546, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_128_0.0009292103564501546_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.572000000000001, Max: 12.63, Min: 5.85
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 1.8682797457048934
Exceeding current best timeout: 9.572000000000001 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 16
Running with params: {'batchsize': 8, 'learning_rate': 0.25764959957192224, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_8_0.25764959957192224_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.745000000000001, Max: 12.469999999999999, Min: 5.93
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 3.2179934806627393
Exceeding current best timeout: 8.745000000000001 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 17
Running with params: {'batchsize': 64, 'learning_rate': 6.038329026762298e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_64_6.038329026762298e-05_4
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 9.350333333333333, Max: 12.209999999999999, Min: 5.909999999999999
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 3.251486348622528
Exceeding current best timeout: 9.350333333333333 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 18
Running with params: {'batchsize': 64, 'learning_rate': 8.354937959787163e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_64_8.354937959787163e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.414333333333335, Max: 12.53, Min: 5.84
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 4.296536660233131
Exceeding current best timeout: 9.414333333333335 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 19
Running with params: {'batchsize': 64, 'learning_rate': 3.212289579537536e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_64_3.212289579537536e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 4...
Iter 3...
Iter 6...
Iter 5...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 8.666666666666666, Max: 12.51, Min: 5.85
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 1.6497424810119992
Exceeding current best timeout: 8.666666666666666 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 20
Running with params: {'batchsize': 64, 'learning_rate': 0.1658112168180643, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_64_0.1658112168180643_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.905666666666667, Max: 12.7, Min: 5.92
Passed tests : 17
Failed tests : 13
Converged: False
Convergence score: 2.1813145018893443
Exceeding current best timeout: 8.905666666666667 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 21
Running with params: {'batchsize': 2, 'learning_rate': 1.1475222128225313e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_1.1475222128225313e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.277666666666667, Max: 12.8, Min: 5.84
Passed tests : 18
Failed tests : 12
Converged: False
Convergence score: 2.695125612630674
Exceeding current best timeout: 9.277666666666667 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 22
Running with params: {'batchsize': 2, 'learning_rate': 1.031854624919156e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_1.031854624919156e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 9.601333333333335, Max: 12.61, Min: 5.88
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 2.5339278497942535
Exceeding current best timeout: 9.601333333333335 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 23
Running with params: {'batchsize': 2, 'learning_rate': 0.7296274829120157, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.7296274829120157_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.402, Max: 12.34, Min: 5.85
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 1.7863332410713066
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.489666666666668, Max: 12.41, Min: 5.85
Passed tests : 45
Failed tests : 15
Converged: False
Convergence score: 1.3927772895275692
Exceeding current best timeout: 8.489666666666668 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 24
Running with params: {'batchsize': 2, 'learning_rate': 1.2468030227881865e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_1.2468030227881865e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.336666666666666, Max: 12.26, Min: 5.85
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 1.2107527152824926
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 4...
Iter 2...
Iter 3...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.585166666666668, Max: 12.68, Min: 5.85
Passed tests : 36
Failed tests : 24
Converged: False
Convergence score: 1.8130133601139191
Exceeding current best timeout: 9.585166666666668 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 25
Running with params: {'batchsize': 2, 'learning_rate': 0.00027035540814191437, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.00027035540814191437_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.344666666666667, Max: 12.62, Min: 5.86
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.6232841892739533
Exceeding current best timeout: 9.344666666666667 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 26
Running with params: {'batchsize': 2, 'learning_rate': 0.8494649300076232, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.8494649300076232_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.064666666666666, Max: 12.46, Min: 5.8
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 2.6939276015157274
Exceeding current best timeout: 9.064666666666666 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 27
Running with params: {'batchsize': 2, 'learning_rate': 0.00018141740393182884, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.00018141740393182884_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.214333333333334, Max: 12.73, Min: 5.83
Passed tests : 16
Failed tests : 14
Converged: False
Convergence score: 4.541786706598249
Exceeding current best timeout: 10.214333333333334 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 28
Running with params: {'batchsize': 2, 'learning_rate': 0.00024416850213267004, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.00024416850213267004_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.875666666666666, Max: 12.53, Min: 5.85
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 2.8035147058778564
Exceeding current best timeout: 8.875666666666666 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 29
Running with params: {'batchsize': 2, 'learning_rate': 0.0023656786374011314, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.0023656786374011314_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.868333333333334, Max: 12.46, Min: 5.909999999999999
Passed tests : 19
Failed tests : 11
Converged: False
Convergence score: 2.7108880019381107
Exceeding current best timeout: 8.868333333333334 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 30
Running with params: {'batchsize': 16, 'learning_rate': 0.00020975567703633113, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_16_0.00020975567703633113_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.644666666666666, Max: 12.209999999999999, Min: 5.82
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 3.4818652960362706
Exceeding current best timeout: 8.644666666666666 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 31
Running with params: {'batchsize': 2, 'learning_rate': 0.0023977042225735755, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.0023977042225735755_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.466999999999997, Max: 12.49, Min: 5.85
Passed tests : 18
Failed tests : 12
Converged: False
Convergence score: 1.906377030767069
Exceeding current best timeout: 9.466999999999997 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 32
Running with params: {'batchsize': 2, 'learning_rate': 0.0019139696349152594, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.0019139696349152594_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 9.039333333333333, Max: 12.49, Min: 5.92
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 1.8053087118971913
Exceeding current best timeout: 9.039333333333333 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 33
Running with params: {'batchsize': 16, 'learning_rate': 3.043002729888202e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_16_3.043002729888202e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.080000000000002, Max: 12.92, Min: 5.89
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 3.247058427215635
Exceeding current best timeout: 9.080000000000002 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 34
Running with params: {'batchsize': 32, 'learning_rate': 0.005917207386801094, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_32_0.005917207386801094_4
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.529333333333334, Max: 12.45, Min: 5.819999999999999
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.1555182205195846
Exceeding current best timeout: 8.529333333333334 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 35
Running with params: {'batchsize': 128, 'learning_rate': 0.0012355676803892566, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_128_0.0012355676803892566_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 8.541333333333334, Max: 12.510000000000002, Min: 5.859999999999999
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 2.410591299499593
Exceeding current best timeout: 8.541333333333334 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 36
Running with params: {'batchsize': 64, 'learning_rate': 0.11212785215828146, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_64_0.11212785215828146_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 10.405333333333335, Max: 12.55, Min: 5.93
Passed tests : 16
Failed tests : 14
Converged: False
Convergence score: 2.224544728644628
Exceeding current best timeout: 10.405333333333335 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 37
Running with params: {'batchsize': 8, 'learning_rate': 1.5196947429316957e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_8_1.5196947429316957e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.181000000000001, Max: 12.729999999999999, Min: 5.93
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 1.9295776763104697
Exceeding current best timeout: 9.181000000000001 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 38
Running with params: {'batchsize': 2, 'learning_rate': 2.098745167778925e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_2.098745167778925e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.788333333333332, Max: 12.44, Min: 5.73
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 1.8121072604777524
Exceeding current best timeout: 8.788333333333332 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 39
Running with params: {'batchsize': 8, 'learning_rate': 5.909902205333274e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_8_5.909902205333274e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.703, Max: 12.41, Min: 5.8999999999999995
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 2.327797818095395
Exceeding current best timeout: 8.703 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 40
Running with params: {'batchsize': 128, 'learning_rate': 0.00014543722907099546, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_128_0.00014543722907099546_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 9.56133333333333, Max: 12.78, Min: 5.819999999999999
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 4.240764980685606
Exceeding current best timeout: 9.56133333333333 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 41
Running with params: {'batchsize': 32, 'learning_rate': 0.8788235862283093, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_32_0.8788235862283093_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.885, Max: 12.64, Min: 5.93
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 3.3799312258207093
Exceeding current best timeout: 9.885 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 42
Running with params: {'batchsize': 2, 'learning_rate': 0.02627599869792434, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.02627599869792434_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.339666666666668, Max: 12.200000000000001, Min: 5.8999999999999995
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 1.6989412369766745
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 10...
Iter 9...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.326166666666667, Max: 12.42, Min: 5.81
Passed tests : 44
Failed tests : 16
Converged: False
Convergence score: 1.9136279238623983
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 8.630444444444445, Max: 12.42, Min: 5.81
Passed tests : 65
Failed tests : 25
Converged: False
Convergence score: 1.3015148637553131
Exceeding current best timeout: 8.630444444444445 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 43
Running with params: {'batchsize': 2, 'learning_rate': 0.010039528387500257, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.010039528387500257_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.874333333333334, Max: 12.5, Min: 5.83
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.6731709689576388
Exceeding current best timeout: 8.874333333333334 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 44
Running with params: {'batchsize': 16, 'learning_rate': 0.0005267806960203727, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_16_0.0005267806960203727_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.172666666666666, Max: 12.57, Min: 5.869999999999999
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 2.4479458465086332
Exceeding current best timeout: 9.172666666666666 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 45
Running with params: {'batchsize': 32, 'learning_rate': 0.0003056232846176931, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_32_0.0003056232846176931_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.075, Max: 12.399999999999999, Min: 5.8100000000000005
Passed tests : 17
Failed tests : 13
Converged: False
Convergence score: 1.7684834071778963
Exceeding current best timeout: 9.075 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 46
Running with params: {'batchsize': 128, 'learning_rate': 0.00010918055352716323, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_128_0.00010918055352716323_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.839, Max: 12.82, Min: 5.91
Passed tests : 19
Failed tests : 11
Converged: False
Convergence score: 2.7198506882787257
Exceeding current best timeout: 8.839 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 47
Running with params: {'batchsize': 8, 'learning_rate': 0.48657860556694893, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_8_0.48657860556694893_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 10.281333333333334, Max: 12.790000000000001, Min: 5.84
Passed tests : 14
Failed tests : 16
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 48
Running with params: {'batchsize': 2, 'learning_rate': 0.06744193982793804, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_0.06744193982793804_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.349999999999998, Max: 12.49, Min: 5.859999999999999
Passed tests : 22
Failed tests : 8
Converged: False
Convergence score: 1.8814565941057697
Exceeding current best timeout: 9.349999999999998 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 49
Running with params: {'batchsize': 16, 'learning_rate': 0.001040329181086314, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_16_0.001040329181086314_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 13...
Iter 12...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.762333333333334, Max: 12.74, Min: 5.890000000000001
Passed tests : 18
Failed tests : 12
Converged: False
Convergence score: 2.490996614730612
Exceeding current best timeout: 9.762333333333334 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 50
Running with params: {'batchsize': 2, 'learning_rate': 4.337294910963707e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597818949/assert_56116489_2_4.337294910963707e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.389000000000001, Max: 12.56, Min: 5.95
Passed tests : 18
Failed tests : 12
Converged: False
Convergence score: 3.30732416625277
Exceeding current best timeout: 9.389000000000001 > 7.475499999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.475499999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Exception>>>
Traceback (most recent call last):
  File "optimizer.py", line 65, in run_optimizer
    result, trialsobj = bayesopt.sample()
  File "/mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/src/strategy/bayesopt.py", line 159, in sample
    verbose=True, timeout=6000)
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 482, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 686, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 516, in fmin
    return trials.argmin
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 622, in argmin
    best_trial = self.best_trial
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 613, in best_trial
    raise AllTrialsFailed
hyperopt.exceptions.AllTrialsFailed

Optimizer time: 760.6532325744629
