Repo: sbi
Filename: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/projects/sbi/tests/multiprocessing_test.py
ClassName: none
Testname: test_benchmarking_sp[1]
Params: num_simulations,30,22,ParamType.ITER,100
Assertion: assert toc_joblib <= toc_sp * 1.1
Original runtime: 10.953
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948583/assert_80817776_100
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 13...
Iter 11...
Iter 12...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.276666666666666, Max: 11.46, Min: 11.09
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Something failed
Optimization Iteration: 2
Running with params: {'num_simulations': 70}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948583/assert_80817776_70
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.191333333333334, Max: 11.34, Min: 11.059999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 3
Running with params: {'num_simulations': 30}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948583/assert_80817776_30
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 11.111333333333334, Max: 11.25, Min: 10.89
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 4
Running with params: {'num_simulations': 40}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948583/assert_80817776_40
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.106333333333335, Max: 11.23, Min: 10.89
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 5
Running with params: {'num_simulations': 100}
Optimization Iteration: 6
Running with params: {'num_simulations': 10}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948583/assert_80817776_10
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.015333333333333, Max: 11.200000000000001, Min: 10.83
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 7
Running with params: {'num_simulations': 20}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948583/assert_80817776_20
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.045666666666667, Max: 11.219999999999999, Min: 10.879999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 8
Running with params: {'num_simulations': 40}
Optimization Iteration: 9
Running with params: {'num_simulations': 20}
Optimization Iteration: 10
Running with params: {'num_simulations': 50}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948583/assert_80817776_50
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.139666666666669, Max: 11.25, Min: 10.94
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 11
Running with params: {'num_simulations': 80}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948583/assert_80817776_80
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.263, Max: 11.39, Min: 11.05
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 12
Running with params: {'num_simulations': 20}
Optimization Iteration: 13
Running with params: {'num_simulations': 30}
Optimization Iteration: 14
Running with params: {'num_simulations': 10}
Optimization Iteration: 15
Running with params: {'num_simulations': 50}
Optimization Iteration: 16
Running with params: {'num_simulations': 70}
Optimization Iteration: 17
Running with params: {'num_simulations': 30}
Optimization Iteration: 18
Running with params: {'num_simulations': 70}
Optimization Iteration: 19
Running with params: {'num_simulations': 40}
Optimization Iteration: 20
Running with params: {'num_simulations': 30}
Optimization Iteration: 21
Running with params: {'num_simulations': 20}
Optimization Iteration: 22
Running with params: {'num_simulations': 90}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948583/assert_80817776_90
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.259666666666666, Max: 11.389999999999999, Min: 11.1
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 23
Running with params: {'num_simulations': 50}
Optimization Iteration: 24
Running with params: {'num_simulations': 10}
Optimization Iteration: 25
Running with params: {'num_simulations': 90}
Optimization Iteration: 26
Running with params: {'num_simulations': 60}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948583/assert_80817776_60
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.160000000000002, Max: 11.290000000000001, Min: 10.96
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 27
Running with params: {'num_simulations': 10}
Optimization Iteration: 28
Running with params: {'num_simulations': 90}
Optimization Iteration: 29
Running with params: {'num_simulations': 60}
Optimization Iteration: 30
Running with params: {'num_simulations': 10}
Optimization Iteration: 31
Running with params: {'num_simulations': 100}
Optimization Iteration: 32
Running with params: {'num_simulations': 60}
Optimization Iteration: 33
Running with params: {'num_simulations': 10}
Optimization Iteration: 34
Running with params: {'num_simulations': 100}
Optimization Iteration: 35
Running with params: {'num_simulations': 70}
Optimization Iteration: 36
Running with params: {'num_simulations': 20}
Optimization Iteration: 37
Running with params: {'num_simulations': 20}
Optimization Iteration: 38
Running with params: {'num_simulations': 40}
Optimization Iteration: 39
Running with params: {'num_simulations': 80}
Optimization Iteration: 40
Running with params: {'num_simulations': 50}
Optimization Iteration: 41
Running with params: {'num_simulations': 40}
Optimization Iteration: 42
Running with params: {'num_simulations': 10}
Optimization Iteration: 43
Running with params: {'num_simulations': 20}
Optimization Iteration: 44
Running with params: {'num_simulations': 80}
Optimization Iteration: 45
Running with params: {'num_simulations': 90}
Optimization Iteration: 46
Running with params: {'num_simulations': 60}
Optimization Iteration: 47
Running with params: {'num_simulations': 30}
Optimization Iteration: 48
Running with params: {'num_simulations': 10}
Optimization Iteration: 49
Running with params: {'num_simulations': 10}
Optimization Iteration: 50
Running with params: {'num_simulations': 70}
Optimization Iteration: 51
Running with params: {'num_simulations': 50}
Exception>>>
Traceback (most recent call last):
  File "optimizer.py", line 65, in run_optimizer
    result, trialsobj = bayesopt.sample()
  File "/mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/src/strategy/bayesopt.py", line 161, in sample
    verbose=True, timeout=6000)
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 482, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 686, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 516, in fmin
    return trials.argmin
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 622, in argmin
    best_trial = self.best_trial
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 613, in best_trial
    raise AllTrialsFailed
hyperopt.exceptions.AllTrialsFailed

Optimizer time: 145.97367477416992
