Repo: sbi
Filename: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/projects/sbi/tests/multiprocessing_test.py
ClassName: none
Testname: test_benchmarking_sp[10]
Params: num_simulations,30,22,ParamType.ITER,100
Assertion: assert toc_joblib <= toc_sp * 1.1
Original runtime: 10.717
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948746/assert_6896815_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.970999999999998, Max: 11.14, Min: 10.47
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Something failed
Optimization Iteration: 2
Running with params: {'num_simulations': 40}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948746/assert_6896815_40
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 7.034000000000001, Max: 7.109999999999999, Min: 6.970000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 3
Running with params: {'num_simulations': 40}
Optimization Iteration: 4
Running with params: {'num_simulations': 70}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948746/assert_6896815_70
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.027666666666667, Max: 9.120000000000001, Min: 8.879999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 5
Running with params: {'num_simulations': 90}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948746/assert_6896815_90
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.267999999999997, Max: 10.39, Min: 10.14
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 6
Running with params: {'num_simulations': 10}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597948746/assert_6896815_10
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 1.4266666666666667, Max: 1.4600000000000002, Min: 1.3
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5536491862701864
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 1.4325000000000003, Max: 1.4700000000000002, Min: 1.3
Passed tests : 60
Failed tests : 0
Converged: False
Convergence score: 1.6513094770859527
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 29...
Iter 27...
Iter 28...
Timings: Avg: 1.4328888888888889, Max: 1.4700000000000002, Min: 1.26
Passed tests : 90
Failed tests : 0
Converged: False
Convergence score: 1.3464342978165011
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 1.4294166666666668, Max: 1.4700000000000002, Min: 1.26
Passed tests : 120
Failed tests : 0
Converged: True
Convergence score: 0.8522339414295215
Evaluating 120 values out of 120
Overall-timings: Avg: 1.4294166666666668, Max: 1.4700000000000002, Min: 1.26
Choosing distribution: norm
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 1.4294166666666668
Score: 1.4294166666666668
Best-score: 1.4294166666666668
Best-param: {'num_simulations': 10}
Optimization Iteration: 7
Running with params: {'num_simulations': 70}
Optimization Iteration: 8
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 9
Running with params: {'num_simulations': 50}
Higher iteration... returning...
Optimization Iteration: 10
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 11
Running with params: {'num_simulations': 90}
Optimization Iteration: 12
Running with params: {'num_simulations': 60}
Higher iteration... returning...
Optimization Iteration: 13
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 14
Running with params: {'num_simulations': 30}
Higher iteration... returning...
Optimization Iteration: 15
Running with params: {'num_simulations': 30}
Higher iteration... returning...
Optimization Iteration: 16
Running with params: {'num_simulations': 60}
Higher iteration... returning...
Optimization Iteration: 17
Running with params: {'num_simulations': 50}
Higher iteration... returning...
Optimization Iteration: 18
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 19
Running with params: {'num_simulations': 10}
Optimization Iteration: 20
Running with params: {'num_simulations': 50}
Higher iteration... returning...
Optimization Iteration: 21
Running with params: {'num_simulations': 80}
Higher iteration... returning...
Optimization Iteration: 22
Running with params: {'num_simulations': 10}
Optimization Iteration: 23
Running with params: {'num_simulations': 10}
Optimization Iteration: 24
Running with params: {'num_simulations': 10}
Optimization Iteration: 25
Running with params: {'num_simulations': 10}
Optimization Iteration: 26
Running with params: {'num_simulations': 10}
Optimization Iteration: 27
Running with params: {'num_simulations': 10}
Optimization Iteration: 28
Running with params: {'num_simulations': 10}
Optimization Iteration: 29
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 30
Running with params: {'num_simulations': 10}
Optimization Iteration: 31
Running with params: {'num_simulations': 10}
Optimization Iteration: 32
Running with params: {'num_simulations': 10}
Optimization Iteration: 33
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 34
Running with params: {'num_simulations': 30}
Higher iteration... returning...
Optimization Iteration: 35
Running with params: {'num_simulations': 10}
Optimization Iteration: 36
Running with params: {'num_simulations': 10}
Optimization Iteration: 37
Running with params: {'num_simulations': 40}
Optimization Iteration: 38
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 39
Running with params: {'num_simulations': 10}
Optimization Iteration: 40
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 41
Running with params: {'num_simulations': 10}
Optimization Iteration: 42
Running with params: {'num_simulations': 10}
Optimization Iteration: 43
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 44
Running with params: {'num_simulations': 40}
Optimization Iteration: 45
Running with params: {'num_simulations': 10}
Optimization Iteration: 46
Running with params: {'num_simulations': 30}
Higher iteration... returning...
Optimization Iteration: 47
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 48
Running with params: {'num_simulations': 10}
Optimization Iteration: 49
Running with params: {'num_simulations': 10}
Optimization Iteration: 50
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 51
Running with params: {'num_simulations': 30}
Higher iteration... returning...
Upto iteration 50: {'num_simulations': 10.0}
Optimization Iteration: 52
Running with params: {'num_simulations': 10}
Optimization Iteration: 53
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 54
Running with params: {'num_simulations': 10}
Optimization Iteration: 55
Running with params: {'num_simulations': 100}
Optimization Iteration: 56
Running with params: {'num_simulations': 40}
Optimization Iteration: 57
Running with params: {'num_simulations': 60}
Higher iteration... returning...
Optimization Iteration: 58
Running with params: {'num_simulations': 10}
Optimization Iteration: 59
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 60
Running with params: {'num_simulations': 10}
Optimization Iteration: 61
Running with params: {'num_simulations': 70}
Optimization Iteration: 62
Running with params: {'num_simulations': 10}
Optimization Iteration: 63
Running with params: {'num_simulations': 10}
Optimization Iteration: 64
Running with params: {'num_simulations': 50}
Higher iteration... returning...
Optimization Iteration: 65
Running with params: {'num_simulations': 10}
Optimization Iteration: 66
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 67
Running with params: {'num_simulations': 10}
Optimization Iteration: 68
Running with params: {'num_simulations': 10}
Optimization Iteration: 69
Running with params: {'num_simulations': 10}
Optimization Iteration: 70
Running with params: {'num_simulations': 10}
Optimization Iteration: 71
Running with params: {'num_simulations': 10}
Optimization Iteration: 72
Running with params: {'num_simulations': 10}
Optimization Iteration: 73
Running with params: {'num_simulations': 10}
Optimization Iteration: 74
Running with params: {'num_simulations': 10}
Optimization Iteration: 75
Running with params: {'num_simulations': 10}
Optimization Iteration: 76
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 77
Running with params: {'num_simulations': 10}
Optimization Iteration: 78
Running with params: {'num_simulations': 10}
Optimization Iteration: 79
Running with params: {'num_simulations': 10}
Optimization Iteration: 80
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 81
Running with params: {'num_simulations': 10}
Optimization Iteration: 82
Running with params: {'num_simulations': 30}
Higher iteration... returning...
Optimization Iteration: 83
Running with params: {'num_simulations': 10}
Optimization Iteration: 84
Running with params: {'num_simulations': 10}
Optimization Iteration: 85
Running with params: {'num_simulations': 80}
Higher iteration... returning...
Optimization Iteration: 86
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 87
Running with params: {'num_simulations': 10}
Optimization Iteration: 88
Running with params: {'num_simulations': 10}
Optimization Iteration: 89
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 90
Running with params: {'num_simulations': 10}
Optimization Iteration: 91
Running with params: {'num_simulations': 10}
Optimization Iteration: 92
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 93
Running with params: {'num_simulations': 30}
Higher iteration... returning...
Optimization Iteration: 94
Running with params: {'num_simulations': 10}
Optimization Iteration: 95
Running with params: {'num_simulations': 10}
Optimization Iteration: 96
Running with params: {'num_simulations': 20}
Higher iteration... returning...
Optimization Iteration: 97
Running with params: {'num_simulations': 10}
Optimization Iteration: 98
Running with params: {'num_simulations': 50}
Higher iteration... returning...
Optimization Iteration: 99
Running with params: {'num_simulations': 10}
Optimization Iteration: 100
Running with params: {'num_simulations': 10}
Optimization Iteration: 101
Running with params: {'num_simulations': 10}
Upto iteration 100: {'num_simulations': 10.0}
Breaking...
{'num_simulations': 10.0}
Best score: 1.4294166666666668
Repeated params: 59
Trials: 102
Best param {'num_simulations': 10.0}
Exception>>>
Traceback (most recent call last):
  File "optimizer.py", line 68, in run_optimizer
    reduction = ((bayesopt.original_runtime-bayesopt.best_runtime+0.0)
TypeError: unsupported operand type(s) for -: 'NoneType' and 'float'

Optimizer time: 70.0780246257782
