Repo: ml-agents
Filename: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/projects/ml-agents/ml-agents/mlagents/trainers/tests/test_simple_rl.py
ClassName: none
Testname: test_simple_ghost
Params: ppo_config_LR,47,22,ParamType.LR,0.005
max_steps,335,77,ParamType.ITER,2500
batch_size,49,19,ParamType.CHAINS,16
Assertion: assert all(reward > success_threshold for reward in processed_rewards)
Original runtime: 25.631999999999998
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_0.005_2500_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 10...
Iter 9...
Iter 11...
Iter 7...
Iter 12...
Iter 14...
Iter 15...
Iter 13...
Iter 17...
Iter 16...
Iter 18...
Iter 21...
Iter 19...
Iter 20...
Iter 23...
Iter 24...
Iter 25...
Iter 22...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 25.844666666666672, Max: 26.040000000000003, Min: 25.45
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8708286933869946
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 7...
Iter 8...
Iter 3...
Iter 4...
Iter 5...
Iter 9...
Iter 6...
Iter 10...
Iter 11...
Iter 14...
Iter 13...
Iter 12...
Iter 15...
Iter 16...
Iter 19...
Iter 18...
Iter 17...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.83766666666667, Max: 26.12, Min: 25.290000000000003
Passed tests : 60
Failed tests : 0
Converged: False
Convergence score: 1.4719601443879304
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 7...
Iter 8...
Iter 3...
Iter 5...
Iter 4...
Iter 6...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 15...
Iter 13...
Iter 14...
Iter 17...
Iter 16...
Iter 19...
Iter 21...
Iter 18...
Iter 22...
Iter 23...
Iter 24...
Iter 20...
Iter 25...
Iter 29...
Iter 28...
Iter 26...
Iter 27...
Timings: Avg: 25.83588888888889, Max: 26.12, Min: 25.290000000000003
Passed tests : 90
Failed tests : 0
Converged: False
Convergence score: 1.4459976109625023
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 7...
Iter 2...
Iter 3...
Iter 8...
Iter 4...
Iter 9...
Iter 5...
Iter 10...
Iter 6...
Iter 12...
Iter 13...
Iter 14...
Iter 11...
Iter 17...
Iter 16...
Iter 15...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 24...
Iter 23...
Iter 22...
Iter 27...
Iter 28...
Iter 26...
Iter 25...
Iter 29...
Timings: Avg: 25.842499999999998, Max: 26.18, Min: 25.290000000000003
Passed tests : 120
Failed tests : 0
Converged: True
Convergence score: 0.9293203772845852
Evaluating 120 values out of 120
Overall-timings: Avg: 25.842499999999998, Max: 26.18, Min: 25.290000000000003
Variance (0.0) too small, using delta distribution
Variance (0.0) too small, using delta distribution
Choosing distribution: gamma
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 25.842499999999998
Score: 25.842499999999998
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
>>Setting original runtime to 25.842499999999998
Optimization Iteration: 1
Running with params: {'batch_size': 8, 'max_steps': 100, 'ppo_config_LR': 0.007312976312507617}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_8_100_0.007312976312507617
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 13...
Iter 12...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 27...
Iter 28...
Iter 25...
Iter 29...
Iter 26...
Timings: Avg: 9.545666666666667, Max: 9.64, Min: 9.37
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 2
Running with params: {'batch_size': 2, 'max_steps': 300, 'ppo_config_LR': 6.301246839671333e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_2_300_6.301246839671333e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 13...
Iter 12...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 24...
Iter 27...
Timings: Avg: 12.422, Max: 12.620000000000001, Min: 12.04
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 3
Running with params: {'batch_size': 2, 'max_steps': 200, 'ppo_config_LR': 0.005797268411463368}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_2_200_0.005797268411463368
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 10...
Iter 9...
Iter 12...
Iter 11...
Iter 13...
Iter 15...
Iter 14...
Iter 17...
Iter 18...
Iter 16...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.469666666666667, Max: 11.68, Min: 11.05
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 4
Running with params: {'batch_size': 256, 'max_steps': 500, 'ppo_config_LR': 0.016030498411498097}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_256_500_0.016030498411498097
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 5...
Iter 4...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 13...
Iter 14...
Iter 11...
Iter 17...
Iter 16...
Iter 15...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 28...
Iter 27...
Iter 29...
Iter 26...
Timings: Avg: 11.849666666666666, Max: 11.979999999999999, Min: 11.57
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 5
Running with params: {'batch_size': 8, 'max_steps': 800, 'ppo_config_LR': 0.00922273994148569}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_8_800_0.00922273994148569
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 28...
Iter 25...
Iter 29...
Iter 27...
Timings: Avg: 15.146999999999998, Max: 15.27, Min: 14.84
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 6
Running with params: {'batch_size': 256, 'max_steps': 100, 'ppo_config_LR': 0.0007467144775279225}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_256_100_0.0007467144775279225
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 16...
Iter 14...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 25...
Iter 26...
Iter 24...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.520333333333333, Max: 9.66, Min: 9.27
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 7
Running with params: {'batch_size': 128, 'max_steps': 100, 'ppo_config_LR': 0.10722009403255695}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_128_100_0.10722009403255695
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 11...
Iter 10...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.517999999999997, Max: 9.649999999999999, Min: 9.35
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 8
Running with params: {'batch_size': 4, 'max_steps': 1100, 'ppo_config_LR': 0.09429709451933174}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_4_1100_0.09429709451933174
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 18.57766666666667, Max: 18.73, Min: 18.39
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 9
Running with params: {'batch_size': 32, 'max_steps': 800, 'ppo_config_LR': 0.07090110048180968}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_32_800_0.07090110048180968
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 27...
Iter 25...
Iter 28...
Iter 29...
Iter 26...
Timings: Avg: 14.489666666666666, Max: 14.62, Min: 14.13
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 10
Running with params: {'batch_size': 64, 'max_steps': 300, 'ppo_config_LR': 4.213177648954314e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_64_300_4.213177648954314e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 29...
Iter 27...
Iter 28...
Iter 26...
Timings: Avg: 11.456999999999999, Max: 11.58, Min: 11.17
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 11
Running with params: {'batch_size': 2, 'max_steps': 600, 'ppo_config_LR': 8.755767335183153e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_2_600_8.755767335183153e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 14...
Iter 15...
Iter 13...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 29...
Iter 27...
Iter 28...
Timings: Avg: 15.605, Max: 15.770000000000001, Min: 15.21
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 12
Running with params: {'batch_size': 64, 'max_steps': 2000, 'ppo_config_LR': 2.222349401997028e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_64_2000_2.222349401997028e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 21.252999999999997, Max: 21.46, Min: 20.84
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 13
Running with params: {'batch_size': 64, 'max_steps': 200, 'ppo_config_LR': 0.0004566793535079899}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_64_200_0.0004566793535079899
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 9...
Iter 7...
Iter 8...
Iter 14...
Iter 12...
Iter 10...
Iter 11...
Iter 15...
Iter 13...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.762666666666668, Max: 10.87, Min: 10.59
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 14
Running with params: {'batch_size': 2, 'max_steps': 500, 'ppo_config_LR': 7.325456921607468e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_2_500_7.325456921607468e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 23...
Iter 21...
Iter 25...
Iter 26...
Iter 28...
Iter 24...
Iter 29...
Iter 27...
Timings: Avg: 14.446333333333333, Max: 14.59, Min: 14.049999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 15
Running with params: {'batch_size': 64, 'max_steps': 100, 'ppo_config_LR': 7.498067579067132e-05}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_64_100_7.498067579067132e-05
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 17...
Iter 18...
Iter 16...
Iter 19...
Iter 20...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 21...
Iter 27...
Iter 29...
Iter 28...
Iter 26...
Timings: Avg: 9.561333333333334, Max: 9.65, Min: 9.4
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 16
Running with params: {'batch_size': 32, 'max_steps': 1300, 'ppo_config_LR': 0.00416015959658989}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_32_1300_0.00416015959658989
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 4...
Iter 1...
Iter 2...
Iter 5...
Iter 6...
Iter 3...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Iter 26...
Timings: Avg: 17.703666666666663, Max: 17.87, Min: 17.39
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 17
Running with params: {'batch_size': 64, 'max_steps': 700, 'ppo_config_LR': 0.012205979185131667}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_64_700_0.012205979185131667
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 13.763666666666667, Max: 13.94, Min: 13.459999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 18
Running with params: {'batch_size': 256, 'max_steps': 100, 'ppo_config_LR': 0.35385799466174345}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_256_100_0.35385799466174345
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 4...
Iter 3...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 10...
Iter 9...
Iter 12...
Iter 11...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 27...
Iter 25...
Iter 29...
Iter 28...
Iter 26...
Timings: Avg: 9.599333333333334, Max: 9.680000000000001, Min: 9.48
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 19
Running with params: {'batch_size': 4, 'max_steps': 300, 'ppo_config_LR': 0.708558086149996}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_4_300_0.708558086149996
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 5...
Iter 6...
Iter 4...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 27...
Iter 26...
Iter 28...
Iter 25...
Iter 29...
Timings: Avg: 11.878333333333332, Max: 11.97, Min: 11.68
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 20
Running with params: {'batch_size': 16, 'max_steps': 1900, 'ppo_config_LR': 0.00034413623420745235}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_16_1900_0.00034413623420745235
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 21.687999999999995, Max: 21.97, Min: 21.240000000000002
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 21
Running with params: {'batch_size': 8, 'max_steps': 200, 'ppo_config_LR': 0.697309119080947}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_8_200_0.697309119080947
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 15...
Iter 13...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Iter 25...
Timings: Avg: 10.901333333333334, Max: 11.03, Min: 10.67
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 22
Running with params: {'batch_size': 4, 'max_steps': 300, 'ppo_config_LR': 0.00199004291878555}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_4_300_0.00199004291878555
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 11.821999999999997, Max: 12.08, Min: 11.56
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 25.842499999999998
Best-param: {'ppo_config_LR': 0.005, 'max_steps': 2500, 'batch_size': 16}
Optimization Iteration: 23
Running with params: {'batch_size': 16, 'max_steps': 2300, 'ppo_config_LR': 0.00031729280621323153}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/logs/optim_1597795256_ml-agents/run_1597811995/assert_49816847_16_2300_0.00031729280621323153
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 11...
Iter 10...
Iter 13...
Iter 12...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.02, Max: 24.34, Min: 23.36
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2247448713916116
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 21...
Iter 22...
Iter 20...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.079, Max: 24.44, Min: 23.36
Passed tests : 60
Failed tests : 0
Converged: False
Convergence score: 1.0000000000000149
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 15...
Iter 13...
Iter 14...
Iter 17...
Iter 16...
Iter 19...
Iter 20...
Iter 18...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 27...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 24.089, Max: 24.5, Min: 23.36
Passed tests : 90
Failed tests : 0
Converged: True
Convergence score: 0.5929492494452058
Evaluating 90 values out of 90
Overall-timings: Avg: 24.089, Max: 24.5, Min: 23.36
Choosing distribution: dweibull
Choosing distribution: gamma
Choosing distribution: laplace
Exception>>>
Traceback (most recent call last):
  File "optimizer.py", line 65, in run_optimizer
    result, trialsobj = bayesopt.sample()
  File "/mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/src/strategy/bayesopt.py", line 143, in sample
    verbose=True, timeout=6000)
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 482, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 686, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 509, in fmin
    rval.exhaust()
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 330, in exhaust
    self.run(self.max_evals - n_done, block_until_done=self.asynchronous)
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 286, in run
    self.serial_evaluate()
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 165, in serial_evaluate
    result = self.domain.evaluate(spec, ctrl)
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 894, in evaluate
    rval = self.fn(pyll_rval)
  File "/mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/src/strategy/bayesopt.py", line 66, in compute_score
    output = self.runner.run_with_param(params, self.best_runtime if self.enable_timeout and self.best_runtime < np.inf else None, self.best_runtime)
  File "/mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/src/runner/StocRunner.py", line 207, in run_with_param
    prob=compareDist.evaluate()
  File "/mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/CompareDistribution.py", line 230, in evaluate
    p = self.check_assert_greater(actual, expected)
  File "/mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/CompareDistribution.py", line 274, in check_assert_greater
    p = self.check_assert_greater([x[ind] for x in actual], expected if Util.getdims(
  File "/mnt/batch/tasks/workitems/opt1/job-1/Task_ml-agents/wd/borntobeflaky/tool/CompareDistribution.py", line 274, in <listcomp>
    p = self.check_assert_greater([x[ind] for x in actual], expected if Util.getdims(
IndexError: index 3 is out of bounds for axis 0 with size 3

Optimizer time: 482.11355566978455
