Repo: parlai
Filename: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/projects/parlai/tests/test_tra.py
ClassName: TestTransformerRanker
Testname: test_eval_batch
Params: learning_rate,35,25,ParamType.LR,0.007
num_epochs,38,23,ParamType.CHAINS,4
batchsize,36,22,ParamType.CHAINS,16
Assertion: self.assertGreaterEqual(valid['hits@1'], threshold)
Original runtime: 4.8149999999999995
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_0.007_4_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.158, Max: 5.32, Min: 4.98
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.47757461168788
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.214833333333334, Max: 6.43, Min: 4.9799999999999995
Passed tests : 60
Failed tests : 0
Converged: True
Convergence score: 0.8295383966718308
Evaluating 60 values out of 60
Overall-timings: Avg: 5.214833333333334, Max: 6.43, Min: 4.9799999999999995
Choosing distribution: beta
Probability of fail (non-zero): 0.05141872461268448
Exceeding max probability of failure: 0.05141872461268448
All-Passed: False
Probabilty of failure: 0.05141872461268448
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
>>>!!Warning: Allowing update probability!!<<
Updating probability of failure to: 0.05141872461268448
>>Setting original runtime to 5.214833333333334
Optimization Iteration: 1
Running with params: {'batchsize': 16, 'learning_rate': 0.00019068305722211808, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.00019068305722211808_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3116666666666665, Max: 3.37, Min: 3.16
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 2
Running with params: {'batchsize': 32, 'learning_rate': 0.005680365498510827, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_32_0.005680365498510827_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3086666666666664, Max: 3.36, Min: 3.21
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 3
Running with params: {'batchsize': 128, 'learning_rate': 0.00043357745950059457, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_128_0.00043357745950059457_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3009999999999993, Max: 3.34, Min: 3.18
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 4
Running with params: {'batchsize': 16, 'learning_rate': 0.010745307015645668, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.010745307015645668_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3133333333333335, Max: 3.35, Min: 3.23
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 5
Running with params: {'batchsize': 16, 'learning_rate': 0.01647897192327292, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.01647897192327292_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.314666666666667, Max: 3.3800000000000003, Min: 3.26
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 6
Running with params: {'batchsize': 32, 'learning_rate': 0.03015005196787602, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_32_0.03015005196787602_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.532, Max: 7.739999999999999, Min: 4.5
Passed tests : 24
Failed tests : 6
Converged: False
Convergence score: 2.7517895796028746
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 15...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 23...
Iter 21...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.3053333333333335, Max: 7.739999999999999, Min: 4.5
Passed tests : 53
Failed tests : 7
Converged: False
Convergence score: 1.2351855797342224
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.222444444444444, Max: 7.739999999999999, Min: 4.5
Passed tests : 83
Failed tests : 7
Converged: True
Convergence score: 0.7621577324385247
Evaluating 90 values out of 90
Overall-timings: Avg: 5.222444444444444, Max: 7.739999999999999, Min: 4.5
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.31365824201968445
Exceeding max probability of failure: 0.31365824201968445
All-Passed: False
Probabilty of failure: 0.31365824201968445
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 7
Running with params: {'batchsize': 2, 'learning_rate': 0.00030266548537800046, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_2_0.00030266548537800046_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 15.193000000000001, Max: 25.98, Min: 13.47
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.8878913826956185
Evaluating 30 values out of 30
Overall-timings: Avg: 15.193000000000001, Max: 25.98, Min: 13.47
Choosing distribution: dweibull
Probability of fail (non-zero): 0.06790536023020227
Exceeding max probability of failure: 0.06790536023020227
All-Passed: False
Probabilty of failure: 0.06790536023020227
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 8
Running with params: {'batchsize': 16, 'learning_rate': 0.715825178652103, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.715825178652103_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.308333333333333, Max: 3.38, Min: 3.2300000000000004
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 9
Running with params: {'batchsize': 16, 'learning_rate': 0.07294203652639479, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.07294203652639479_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.308333333333334, Max: 3.36, Min: 3.23
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 10
Running with params: {'batchsize': 8, 'learning_rate': 0.0007422049608943169, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_8_0.0007422049608943169_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.168333333333331, Max: 9.270000000000001, Min: 9.010000000000002
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 11
Running with params: {'batchsize': 8, 'learning_rate': 1.2729214560104299e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_8_1.2729214560104299e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 13.62033333333333, Max: 13.84, Min: 13.31
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 12
Running with params: {'batchsize': 128, 'learning_rate': 0.014784929967514007, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_128_0.014784929967514007_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.136333333333335, Max: 11.38, Min: 10.75
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 13
Running with params: {'batchsize': 8, 'learning_rate': 0.49241007660083036, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_8_0.49241007660083036_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.984999999999999, Max: 7.1000000000000005, Min: 6.8100000000000005
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 14
Running with params: {'batchsize': 32, 'learning_rate': 0.0009280793547789233, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_32_0.0009280793547789233_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.958666666666666, Max: 9.21, Min: 8.76
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 15
Running with params: {'batchsize': 2, 'learning_rate': 1.8752260327954397e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_2_1.8752260327954397e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 12.972000000000003, Max: 13.47, Min: 12.68
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 16
Running with params: {'batchsize': 128, 'learning_rate': 1.2753415562588824e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_128_1.2753415562588824e-05_1
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.194999999999999, Max: 10.88, Min: 9.889999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 17
Running with params: {'batchsize': 2, 'learning_rate': 0.655576446368333, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_2_0.655576446368333_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.312666666666667, Max: 3.3600000000000003, Min: 3.12
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 18
Running with params: {'batchsize': 8, 'learning_rate': 2.5219522278516195e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_8_2.5219522278516195e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.405, Max: 11.8, Min: 11.190000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 19
Running with params: {'batchsize': 16, 'learning_rate': 0.00011403608758850107, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.00011403608758850107_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.203666666666667, Max: 10.44, Min: 9.92
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 20
Running with params: {'batchsize': 128, 'learning_rate': 0.012309797094472821, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_128_0.012309797094472821_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 15...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.175333333333331, Max: 10.36, Min: 9.75
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 21
Running with params: {'batchsize': 64, 'learning_rate': 5.240557586849624e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_64_5.240557586849624e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.783333333333333, Max: 8.98, Min: 8.55
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 22
Running with params: {'batchsize': 16, 'learning_rate': 0.0001393238867566754, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.0001393238867566754_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 7.579666666666666, Max: 7.75, Min: 7.42
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 23
Running with params: {'batchsize': 64, 'learning_rate': 0.0022337669685845735, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_64_0.0022337669685845735_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 7.492333333333334, Max: 7.65, Min: 7.25
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 24
Running with params: {'batchsize': 64, 'learning_rate': 5.562321300580542e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_64_5.562321300580542e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.808333333333334, Max: 8.92, Min: 8.629999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 25
Running with params: {'batchsize': 16, 'learning_rate': 0.00016186107823166698, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.00016186107823166698_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7.568333333333333, Max: 7.71, Min: 7.3500000000000005
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 26
Running with params: {'batchsize': 64, 'learning_rate': 0.001965570059884974, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_64_0.001965570059884974_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7.485333333333334, Max: 7.61, Min: 7.16
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 27
Running with params: {'batchsize': 64, 'learning_rate': 8.49557588140202e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_64_8.49557588140202e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.776, Max: 8.95, Min: 8.58
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 28
Running with params: {'batchsize': 16, 'learning_rate': 0.000248288256113065, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.000248288256113065_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 7.561333333333333, Max: 7.76, Min: 7.390000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 29
Running with params: {'batchsize': 64, 'learning_rate': 0.0034103570931281278, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_64_0.0034103570931281278_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 7.496666666666668, Max: 7.61, Min: 7.31
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 30
Running with params: {'batchsize': 64, 'learning_rate': 6.30838129892548e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_64_6.30838129892548e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.813, Max: 8.99, Min: 8.71
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 31
Running with params: {'batchsize': 16, 'learning_rate': 0.00031762555477650635, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.00031762555477650635_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7.585666666666667, Max: 7.890000000000001, Min: 7.409999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 32
Running with params: {'batchsize': 32, 'learning_rate': 0.0033128386335084295, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_32_0.0033128386335084295_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3389999999999995, Max: 3.38, Min: 3.25
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 33
Running with params: {'batchsize': 64, 'learning_rate': 0.0007143698314560647, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_64_0.0007143698314560647_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.815333333333335, Max: 9.209999999999999, Min: 8.64
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 34
Running with params: {'batchsize': 16, 'learning_rate': 0.001191825035283913, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.001191825035283913_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 7.598666666666666, Max: 7.8, Min: 7.43
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 35
Running with params: {'batchsize': 32, 'learning_rate': 0.12327658089148627, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_32_0.12327658089148627_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.332, Max: 3.38, Min: 3.19
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 36
Running with params: {'batchsize': 128, 'learning_rate': 0.005695459453956093, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_128_0.005695459453956093_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.324666666666667, Max: 3.4, Min: 3.2399999999999998
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 37
Running with params: {'batchsize': 2, 'learning_rate': 4.529572769498276e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_2_4.529572769498276e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 26.544, Max: 29.09, Min: 10.989999999999998
Passed tests : 3
Failed tests : 27
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 38
Running with params: {'batchsize': 64, 'learning_rate': 2.4691904299589994e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_64_2.4691904299589994e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3006666666666664, Max: 3.3499999999999996, Min: 3.1
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 39
Running with params: {'batchsize': 16, 'learning_rate': 0.0004676663052376861, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.0004676663052376861_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7.583333333333333, Max: 7.66, Min: 7.4
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 40
Running with params: {'batchsize': 16, 'learning_rate': 0.0002103350365150257, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.0002103350365150257_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7.562666666666668, Max: 7.7700000000000005, Min: 7.3100000000000005
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 41
Running with params: {'batchsize': 8, 'learning_rate': 0.022378854630020158, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_8_0.022378854630020158_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3093333333333335, Max: 3.37, Min: 3.25
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 42
Running with params: {'batchsize': 32, 'learning_rate': 0.04942396596453303, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_32_0.04942396596453303_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.417666666666667, Max: 6.52, Min: 6.31
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 43
Running with params: {'batchsize': 2, 'learning_rate': 3.7782868306393365e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_2_3.7782868306393365e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 28.47033333333333, Max: 29.45, Min: 27.91
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 44
Running with params: {'batchsize': 64, 'learning_rate': 1.0237701996134268e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_64_1.0237701996134268e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.385666666666664, Max: 9.549999999999999, Min: 8.940000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 45
Running with params: {'batchsize': 16, 'learning_rate': 0.005962253574748543, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.005962253574748543_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.744333333333333, Max: 7.29, Min: 4.17
Passed tests : 20
Failed tests : 10
Converged: False
Convergence score: 3.2929381207145005
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.986166666666665, Max: 7.58, Min: 3.99
Passed tests : 40
Failed tests : 20
Converged: False
Convergence score: 1.7326053300122728
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.873333333333334, Max: 7.58, Min: 3.99
Passed tests : 62
Failed tests : 28
Converged: True
Convergence score: 0.87058829862807
Evaluating 90 values out of 90
Overall-timings: Avg: 5.873333333333334, Max: 7.58, Min: 3.99
Choosing distribution: dweibull
Choosing distribution: laplace
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.7297835017567331
Exceeding max probability of failure: 0.7297835017567331
All-Passed: False
Probabilty of failure: 0.7297835017567331
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 46
Running with params: {'batchsize': 16, 'learning_rate': 0.0001546053410875408, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_16_0.0001546053410875408_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3169999999999997, Max: 3.37, Min: 3.2
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 47
Running with params: {'batchsize': 8, 'learning_rate': 0.001412246815641557, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_8_0.001412246815641557_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.9733333333333345, Max: 7.15, Min: 6.680000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 48
Running with params: {'batchsize': 128, 'learning_rate': 0.0004372266452517046, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_128_0.0004372266452517046_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.156333333333333, Max: 10.36, Min: 9.889999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 49
Running with params: {'batchsize': 2, 'learning_rate': 9.347841361398164e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_2_9.347841361398164e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 23.22833333333334, Max: 28.34, Min: 11.05
Passed tests : 13
Failed tests : 17
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 50
Running with params: {'batchsize': 32, 'learning_rate': 1.672188996711454e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597808598/assert_98685591_32_1.672188996711454e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.960666666666667, Max: 9.100000000000001, Min: 8.770000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Exception>>>
Traceback (most recent call last):
  File "optimizer.py", line 65, in run_optimizer
    result, trialsobj = bayesopt.sample()
  File "/mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/src/strategy/bayesopt.py", line 159, in sample
    verbose=True, timeout=6000)
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 482, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 686, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 516, in fmin
    return trials.argmin
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 622, in argmin
    best_trial = self.best_trial
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 613, in best_trial
    raise AllTrialsFailed
hyperopt.exceptions.AllTrialsFailed

Optimizer time: 501.5265779495239
