#skipF
Repo: magenta
Filename: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/projects/magenta/magenta/models/rl_tuner/rl_tuner_test.py
ClassName: RLTunerTest
Testname: testTraining
Params: num_steps,100,24,ParamType.ITER,31
Assertion: self.assertTrue(len(rlt.eval_avg_reward) >= 1)
Original runtime: 21.376
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'num_steps': 31}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_31
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 21.508666666666667, Max: 21.79, Min: 21.12
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 21.508666666666667, Max: 21.79, Min: 21.12
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 21.508666666666667
Score: 21.508666666666667
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
>>Setting original runtime to 21.508666666666667
Optimization Iteration: 1
Running with params: {'num_steps': 6}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_6
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 9...
Iter 7...
Iter 11...
Iter 10...
Iter 8...
Iter 16...
Iter 12...
Iter 13...
Iter 17...
Iter 15...
Iter 14...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 25...
Iter 26...
Iter 24...
Iter 22...
Iter 23...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.838000000000003, Max: 14.99, Min: 14.35
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 2
Running with params: {'num_steps': 1}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 2...
Iter 3...
Iter 1...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 23...
Iter 24...
Iter 19...
Iter 20...
Iter 25...
Iter 21...
Iter 22...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.881666666666664, Max: 15.03, Min: 14.58
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 3
Running with params: {'num_steps': 5}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_5
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 13...
Iter 11...
Iter 10...
Iter 12...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 23...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 26...
Iter 27...
Iter 24...
Iter 25...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.922333333333336, Max: 15.049999999999999, Min: 14.639999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 4
Running with params: {'num_steps': 3}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 26...
Iter 27...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.958666666666664, Max: 15.09, Min: 14.600000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 5
Running with params: {'num_steps': 6}
Optimization Iteration: 6
Running with params: {'num_steps': 15}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_15
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 7...
Iter 4...
Iter 8...
Iter 5...
Iter 6...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 20...
Iter 21...
Iter 15...
Iter 16...
Iter 22...
Iter 17...
Iter 18...
Iter 19...
Iter 23...
Iter 24...
Iter 26...
Iter 27...
Iter 25...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.940000000000001, Max: 15.149999999999999, Min: 14.52
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 7
Running with params: {'num_steps': 8}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_8
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.830999999999998, Max: 14.97, Min: 14.42
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 8
Running with params: {'num_steps': 1}
Optimization Iteration: 9
Running with params: {'num_steps': 7}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_7
Launching 30 jobs, 30 in parallel
Iter 3...
Iter 4...
Iter 0...
Iter 1...
Iter 2...
Iter 6...
Iter 5...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 17...
Iter 18...
Iter 11...
Iter 16...
Iter 12...
Iter 14...
Iter 21...
Iter 13...
Iter 22...
Iter 15...
Iter 23...
Iter 20...
Iter 19...
Iter 26...
Iter 28...
Iter 29...
Iter 25...
Iter 27...
Iter 24...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 15.003333333333332, Max: 15.18, Min: 14.719999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 10
Running with params: {'num_steps': 13}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_13
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 15...
Iter 13...
Iter 14...
Iter 16...
Iter 18...
Iter 19...
Iter 17...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 28...
Iter 26...
Iter 29...
Iter 27...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.941999999999997, Max: 15.11, Min: 14.55
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 11
Running with params: {'num_steps': 3}
Optimization Iteration: 12
Running with params: {'num_steps': 18}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_18
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 13...
Iter 14...
Iter 15...
Iter 10...
Iter 11...
Iter 16...
Iter 12...
Iter 19...
Iter 20...
Iter 17...
Iter 18...
Iter 21...
Iter 22...
Iter 29...
Iter 23...
Iter 24...
Iter 26...
Iter 28...
Iter 27...
Iter 25...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.964000000000002, Max: 15.129999999999999, Min: 14.55
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 13
Running with params: {'num_steps': 2}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 12...
Iter 8...
Iter 13...
Iter 14...
Iter 9...
Iter 11...
Iter 15...
Iter 10...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 24...
Iter 25...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.951, Max: 15.17, Min: 14.46
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 14
Running with params: {'num_steps': 3}
Optimization Iteration: 15
Running with params: {'num_steps': 3}
Optimization Iteration: 16
Running with params: {'num_steps': 2}
Optimization Iteration: 17
Running with params: {'num_steps': 2}
Optimization Iteration: 18
Running with params: {'num_steps': 17}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_17
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 8...
Iter 5...
Iter 9...
Iter 6...
Iter 10...
Iter 7...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 21...
Iter 22...
Iter 16...
Iter 23...
Iter 17...
Iter 18...
Iter 24...
Iter 19...
Iter 20...
Iter 27...
Iter 26...
Iter 25...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.952000000000002, Max: 15.21, Min: 14.56
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 19
Running with params: {'num_steps': 4}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 7...
Iter 5...
Iter 8...
Iter 6...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 19...
Iter 15...
Iter 18...
Iter 16...
Iter 17...
Iter 25...
Iter 26...
Iter 23...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.854999999999999, Max: 14.99, Min: 14.66
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 20
Running with params: {'num_steps': 29}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_29
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 5...
Iter 3...
Iter 2...
Iter 1...
Iter 4...
Iter 6...
Iter 7...
Iter 9...
Iter 10...
Iter 8...
Iter 11...
Iter 12...
Iter 16...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 18...
Iter 21...
Iter 26...
Iter 27...
Iter 20...
Iter 23...
Iter 19...
Iter 25...
Iter 24...
Iter 22...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.921999999999999, Max: 15.09, Min: 14.709999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 21
Running with params: {'num_steps': 27}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_27
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 13...
Iter 11...
Iter 14...
Iter 15...
Iter 19...
Iter 17...
Iter 16...
Iter 18...
Iter 24...
Iter 26...
Iter 22...
Iter 20...
Iter 23...
Iter 21...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.90833333333333, Max: 15.06, Min: 14.370000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 22
Running with params: {'num_steps': 10}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_10
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.853000000000002, Max: 15.01, Min: 14.56
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 23
Running with params: {'num_steps': 25}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_25
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 4...
Iter 3...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 14...
Iter 15...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 16...
Iter 20...
Iter 18...
Iter 21...
Iter 22...
Iter 17...
Iter 19...
Iter 26...
Iter 28...
Iter 23...
Iter 27...
Iter 24...
Iter 29...
Iter 25...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.944999999999997, Max: 15.09, Min: 14.74
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 24
Running with params: {'num_steps': 25}
Optimization Iteration: 25
Running with params: {'num_steps': 10}
Optimization Iteration: 26
Running with params: {'num_steps': 24}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_24
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 15...
Iter 14...
Iter 13...
Iter 17...
Iter 19...
Iter 16...
Iter 18...
Iter 21...
Iter 20...
Iter 22...
Iter 26...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.884333333333332, Max: 15.049999999999999, Min: 14.47
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 27
Running with params: {'num_steps': 20}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_20
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 13...
Iter 12...
Iter 14...
Iter 15...
Iter 17...
Iter 18...
Iter 16...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 28...
Iter 26...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.966999999999997, Max: 15.08, Min: 14.719999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 28
Running with params: {'num_steps': 11}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_11
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.889333333333333, Max: 15.02, Min: 14.66
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 29
Running with params: {'num_steps': 1}
Optimization Iteration: 30
Running with params: {'num_steps': 20}
Optimization Iteration: 31
Running with params: {'num_steps': 5}
Optimization Iteration: 32
Running with params: {'num_steps': 1}
Optimization Iteration: 33
Running with params: {'num_steps': 6}
Optimization Iteration: 34
Running with params: {'num_steps': 4}
Optimization Iteration: 35
Running with params: {'num_steps': 1}
Optimization Iteration: 36
Running with params: {'num_steps': 13}
Optimization Iteration: 37
Running with params: {'num_steps': 8}
Optimization Iteration: 38
Running with params: {'num_steps': 2}
Optimization Iteration: 39
Running with params: {'num_steps': 9}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_9
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.915333333333333, Max: 15.09, Min: 14.67
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 40
Running with params: {'num_steps': 5}
Optimization Iteration: 41
Running with params: {'num_steps': 14}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_14
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.931000000000003, Max: 15.05, Min: 14.74
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 42
Running with params: {'num_steps': 4}
Optimization Iteration: 43
Running with params: {'num_steps': 7}
Optimization Iteration: 44
Running with params: {'num_steps': 12}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_12
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 19...
Iter 20...
Iter 18...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.825333333333335, Max: 14.98, Min: 14.47
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 45
Running with params: {'num_steps': 6}
Optimization Iteration: 46
Running with params: {'num_steps': 7}
Optimization Iteration: 47
Running with params: {'num_steps': 16}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771549/assert_79372615_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 14.840333333333332, Max: 14.96, Min: 14.450000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 21.508666666666667
Best-param: {'num_steps': 31}
Optimization Iteration: 48
Running with params: {'num_steps': 2}
Optimization Iteration: 49
Running with params: {'num_steps': 20}
Optimization Iteration: 50
Running with params: {'num_steps': 3}
Exception>>>
Traceback (most recent call last):
  File "optimizer.py", line 65, in run_optimizer
    result, trialsobj = bayesopt.sample()
  File "/mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/src/strategy/bayesopt.py", line 143, in sample
    verbose=True, timeout=6000)
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 482, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 686, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 516, in fmin
    return trials.argmin
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 622, in argmin
    best_trial = self.best_trial
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 613, in best_trial
    raise AllTrialsFailed
hyperopt.exceptions.AllTrialsFailed

Optimizer time: 373.58236145973206
