Repo: sbi
Filename: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/projects/sbi/tests/inference_with_NaN_simulator_test.py
ClassName: none
Testname: test_inference_with_nan_simulator[SNPE_C-True-0.05]
Params: num_samples,55,18,ParamType.ITER,500
num_simulations,56,22,ParamType.ITER,2000
Assertion: np.testing.assert_allclose(score, val, rtol=0, atol=0.1)
Original runtime: 73.124
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'num_samples': 500, 'num_simulations': 2000}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_500_2000
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 70.363, Max: 73.06, Min: 68.03
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 70.363, Max: 73.06, Min: 68.03
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 70.363
Score: 70.363
Best-score: 70.363
Best-param: {'num_samples': 500, 'num_simulations': 2000}
>>Setting original runtime to 70.363
Optimization Iteration: 1
Running with params: {'num_samples': 290, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_290_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 13...
Iter 11...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 29.0, Max: 29.76, Min: 28.39
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 70.363
Best-param: {'num_samples': 500, 'num_simulations': 2000}
Optimization Iteration: 2
Running with params: {'num_samples': 260, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_260_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 14.478333333333333, Max: 14.9, Min: 14.16
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 70.363
Best-param: {'num_samples': 500, 'num_simulations': 2000}
Optimization Iteration: 3
Running with params: {'num_samples': 140, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_140_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 15.614, Max: 16.37, Min: 15.18
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 70.363
Best-param: {'num_samples': 500, 'num_simulations': 2000}
Optimization Iteration: 4
Running with params: {'num_samples': 210, 'num_simulations': 400}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_210_400
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 20...
Iter 18...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.592999999999996, Max: 25.48, Min: 24.03
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 24.592999999999996, Max: 25.48, Min: 24.03
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 24.592999999999996
Score: 24.592999999999996
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 5
Running with params: {'num_samples': 250, 'num_simulations': 1800}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_250_1800
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 24...
Iter 22...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 61.580000000000005, Max: 63.699999999999996, Min: 59.34
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 61.580000000000005, Max: 63.699999999999996, Min: 59.34
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 61.580000000000005
Score: 61.580000000000005
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 6
Running with params: {'num_samples': 180, 'num_simulations': 1300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_180_1300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 21...
Iter 19...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 56.281666666666666, Max: 57.77, Min: 54.620000000000005
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 56.281666666666666, Max: 57.77, Min: 54.620000000000005
Variance (7.703719777548943e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 56.281666666666666
Score: 56.281666666666666
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 7
Running with params: {'num_samples': 220, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_220_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 15...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 22.622999999999998, Max: 22.91, Min: 22.18
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 8
Running with params: {'num_samples': 160, 'num_simulations': 700}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_160_700
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 37.120666666666665, Max: 38.37, Min: 36.089999999999996
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 9
Running with params: {'num_samples': 310, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_310_200
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 28.93166666666667, Max: 29.73, Min: 28.45
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 10
Running with params: {'num_samples': 300, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_300_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 22...
Iter 20...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 26.416666666666668, Max: 27.220000000000002, Min: 25.64
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 11
Running with params: {'num_samples': 400, 'num_simulations': 1300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_400_1300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 49.37933333333333, Max: 50.91, Min: 47.480000000000004
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 49.37933333333333, Max: 50.91, Min: 47.480000000000004
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 49.37933333333333
Score: 49.37933333333333
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 12
Running with params: {'num_samples': 260, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_260_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 16.797, Max: 17.439999999999998, Min: 16.400000000000002
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 13
Running with params: {'num_samples': 200, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_200_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 21.238000000000007, Max: 21.6, Min: 20.939999999999998
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 14
Running with params: {'num_samples': 270, 'num_simulations': 500}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_270_500
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.71366666666667, Max: 26.59, Min: 25.009999999999998
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 15
Running with params: {'num_samples': 470, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_470_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 13...
Iter 12...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 33.127, Max: 33.93, Min: 32.48
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 33.127, Max: 33.93, Min: 32.48
Variance (4.81482486096809e-35) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 33.127
Score: 33.127
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 16
Running with params: {'num_samples': 110, 'num_simulations': 1000}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_110_1000
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 37.12833333333334, Max: 38.78, Min: 35.71
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 24.592999999999996
Best-param: {'num_samples': 210, 'num_simulations': 400}
Optimization Iteration: 17
Running with params: {'num_samples': 270, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_270_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 17.560333333333332, Max: 18.01, Min: 17.19
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 17.560333333333332, Max: 18.01, Min: 17.19
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 17.560333333333332
Score: 17.560333333333332
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 18
Running with params: {'num_samples': 450, 'num_simulations': 400}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_450_400
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 13...
Iter 12...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 38.758, Max: 39.36, Min: 38.160000000000004
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 19
Running with params: {'num_samples': 300, 'num_simulations': 1300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_300_1300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 49.36433333333332, Max: 50.910000000000004, Min: 47.84
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 49.36433333333332, Max: 50.910000000000004, Min: 47.84
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 49.36433333333332
Score: 49.36433333333332
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 20
Running with params: {'num_samples': 220, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_220_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 20.000666666666667, Max: 20.330000000000002, Min: 19.540000000000003
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 21
Running with params: {'num_samples': 140, 'num_simulations': 700}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_140_700
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 26.55733333333333, Max: 27.69, Min: 25.57
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 26.55733333333333, Max: 27.69, Min: 25.57
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 26.55733333333333
Score: 26.55733333333333
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 22
Running with params: {'num_samples': 360, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_360_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 28.705666666666666, Max: 29.860000000000003, Min: 28.06
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 28.705666666666666, Max: 29.860000000000003, Min: 28.06
Variance (4.81482486096809e-35) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 28.705666666666666
Score: 28.705666666666666
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 23
Running with params: {'num_samples': 360, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_360_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 26.972, Max: 27.62, Min: 26.34
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 24
Running with params: {'num_samples': 180, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_180_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 19...
Iter 17...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 27.094333333333335, Max: 27.95, Min: 26.36
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 27.094333333333335, Max: 27.95, Min: 26.36
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 27.094333333333335
Score: 27.094333333333335
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 25
Running with params: {'num_samples': 120, 'num_simulations': 600}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_120_600
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 11...
Iter 10...
Iter 14...
Iter 13...
Iter 12...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 28...
Iter 26...
Iter 29...
Timings: Avg: 36.245000000000005, Max: 37.769999999999996, Min: 35.099999999999994
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 36.245000000000005, Max: 37.769999999999996, Min: 35.099999999999994
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 36.245000000000005
Score: 36.245000000000005
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 26
Running with params: {'num_samples': 190, 'num_simulations': 2000}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_190_2000
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 68.26533333333333, Max: 70.85000000000001, Min: 66.13
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 68.26533333333333, Max: 70.85000000000001, Min: 66.13
Variance (7.703719777548943e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 68.26533333333333
Score: 68.26533333333333
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 27
Running with params: {'num_samples': 160, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_160_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 16.942666666666668, Max: 17.439999999999998, Min: 16.569999999999997
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 28
Running with params: {'num_samples': 360, 'num_simulations': 400}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_360_400
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 34.41499999999999, Max: 35.41, Min: 33.62
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 34.41499999999999, Max: 35.41, Min: 33.62
Variance (3.009265538105056e-36) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 34.41499999999999
Score: 34.41499999999999
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 29
Running with params: {'num_samples': 230, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_230_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 19.914, Max: 20.39, Min: 19.45
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 30
Running with params: {'num_samples': 210, 'num_simulations': 1000}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_210_1000
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 17...
Iter 15...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 37.08066666666666, Max: 37.9, Min: 35.82
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 37.08066666666666, Max: 37.9, Min: 35.82
Variance (7.703719777548943e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 37.08066666666666
Score: 37.08066666666666
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 31
Running with params: {'num_samples': 240, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_240_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 23.77866666666667, Max: 25.09, Min: 23.209999999999997
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 32
Running with params: {'num_samples': 160, 'num_simulations': 100}
Optimization Iteration: 33
Running with params: {'num_samples': 330, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_330_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 27.70733333333334, Max: 28.75, Min: 27.03
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 34
Running with params: {'num_samples': 270, 'num_simulations': 500}
Optimization Iteration: 35
Running with params: {'num_samples': 140, 'num_simulations': 900}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_140_900
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 30.811999999999998, Max: 31.990000000000002, Min: 29.66
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 36
Running with params: {'num_samples': 180, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_180_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 21.179000000000006, Max: 21.75, Min: 20.77
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 37
Running with params: {'num_samples': 420, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_420_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 28.953999999999994, Max: 29.529999999999998, Min: 28.34
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 38
Running with params: {'num_samples': 330, 'num_simulations': 1700}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_330_1700
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 65.84799999999998, Max: 68.36, Min: 63.580000000000005
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 65.84799999999998, Max: 68.36, Min: 63.580000000000005
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 65.84799999999998
Score: 65.84799999999998
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 39
Running with params: {'num_samples': 280, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_280_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 21.853333333333335, Max: 22.44, Min: 21.369999999999997
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 40
Running with params: {'num_samples': 130, 'num_simulations': 1600}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_130_1600
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 45.802, Max: 47.910000000000004, Min: 44.18
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 45.802, Max: 47.910000000000004, Min: 44.18
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 45.802
Score: 45.802
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 41
Running with params: {'num_samples': 240, 'num_simulations': 400}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_240_400
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 23.761, Max: 24.75, Min: 23.21
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 23.761, Max: 24.75, Min: 23.21
Variance (4.81482486096809e-35) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 23.761
Score: 23.761
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 42
Running with params: {'num_samples': 250, 'num_simulations': 800}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_250_800
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 48.38833333333333, Max: 50.49, Min: 46.730000000000004
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 48.38833333333333, Max: 50.49, Min: 46.730000000000004
Variance (7.703719777548943e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 48.38833333333333
Score: 48.38833333333333
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 43
Running with params: {'num_samples': 330, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_330_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 29.637000000000004, Max: 30.46, Min: 28.91
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 29.637000000000004, Max: 30.46, Min: 28.91
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 29.637000000000004
Score: 29.637000000000004
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 44
Running with params: {'num_samples': 230, 'num_simulations': 600}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_230_600
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 29.430999999999994, Max: 30.259999999999998, Min: 28.650000000000002
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 29.430999999999994, Max: 30.259999999999998, Min: 28.650000000000002
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 29.430999999999994
Score: 29.430999999999994
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 45
Running with params: {'num_samples': 390, 'num_simulations': 400}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_390_400
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 20.740000000000002, Max: 21.43, Min: 20.22
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 20.740000000000002, Max: 21.43, Min: 20.22
Variance (4.81482486096809e-35) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 20.740000000000002
Score: 20.740000000000002
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 46
Running with params: {'num_samples': 490, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_490_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 33.25733333333333, Max: 34.2, Min: 32.510000000000005
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 47
Running with params: {'num_samples': 400, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_400_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 21.45799999999999, Max: 21.990000000000002, Min: 20.82
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 48
Running with params: {'num_samples': 440, 'num_simulations': 1400}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_440_1400
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 49.22666666666667, Max: 50.49, Min: 47.96
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 49.22666666666667, Max: 50.49, Min: 47.96
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 49.22666666666667
Score: 49.22666666666667
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 49
Running with params: {'num_samples': 380, 'num_simulations': 500}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_380_500
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 38.33066666666666, Max: 39.92, Min: 36.86
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 50
Running with params: {'num_samples': 490, 'num_simulations': 1100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_490_1100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 49.87033333333332, Max: 50.77, Min: 48.59
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 49.87033333333332, Max: 50.77, Min: 48.59
Variance (7.703719777548943e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 49.87033333333332
Score: 49.87033333333332
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Upto iteration 50: {'num_samples': 270.0, 'num_simulations': 100.0}
Optimization Iteration: 51
Running with params: {'num_samples': 290, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_290_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 22.959666666666667, Max: 23.9, Min: 22.44
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 52
Running with params: {'num_samples': 390, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_390_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 17.711000000000002, Max: 18.17, Min: 17.139999999999997
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 53
Running with params: {'num_samples': 310, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_310_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.06233333333333, Max: 24.92, Min: 23.44
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 17.560333333333332
Best-param: {'num_samples': 270, 'num_simulations': 100}
Optimization Iteration: 54
Running with params: {'num_samples': 100, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_100_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 16.964333333333332, Max: 17.6, Min: 16.62
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 16.964333333333332, Max: 17.6, Min: 16.62
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 16.964333333333332
Score: 16.964333333333332
Best-score: 16.964333333333332
Best-param: {'num_samples': 100, 'num_simulations': 300}
Optimization Iteration: 55
Running with params: {'num_samples': 110, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_110_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 18.402666666666665, Max: 19.16, Min: 17.939999999999998
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 18.402666666666665, Max: 19.16, Min: 17.939999999999998
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 18.402666666666665
Score: 18.402666666666665
Best-score: 16.964333333333332
Best-param: {'num_samples': 100, 'num_simulations': 300}
Optimization Iteration: 56
Running with params: {'num_samples': 100, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_100_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 17...
Iter 16...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 14.29833333333333, Max: 14.719999999999999, Min: 14.02
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 14.29833333333333, Max: 14.719999999999999, Min: 14.02
Variance (4.81482486096809e-35) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 14.29833333333333
Score: 14.29833333333333
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 57
Running with params: {'num_samples': 100, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_100_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 17.677666666666667, Max: 18.32, Min: 17.33
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 17.677666666666667, Max: 18.32, Min: 17.33
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 17.677666666666667
Score: 17.677666666666667
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 58
Running with params: {'num_samples': 110, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_110_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 16.34166666666667, Max: 16.92, Min: 15.98
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 59
Running with params: {'num_samples': 100, 'num_simulations': 300}
Optimization Iteration: 60
Running with params: {'num_samples': 130, 'num_simulations': 600}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_130_600
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 18.534666666666666, Max: 19.529999999999998, Min: 17.919999999999998
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 18.534666666666666, Max: 19.529999999999998, Min: 17.919999999999998
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 18.534666666666666
Score: 18.534666666666666
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 61
Running with params: {'num_samples': 150, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_150_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.041666666666666, Max: 11.32, Min: 10.72
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 62
Running with params: {'num_samples': 120, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_120_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 16.595000000000002, Max: 17.12, Min: 16.22
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 63
Running with params: {'num_samples': 170, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_170_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 19.242000000000004, Max: 19.96, Min: 18.83
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 64
Running with params: {'num_samples': 100, 'num_simulations': 800}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_100_800
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 35.384, Max: 36.48, Min: 34.209999999999994
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 35.384, Max: 36.48, Min: 34.209999999999994
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 35.384
Score: 35.384
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 65
Running with params: {'num_samples': 120, 'num_simulations': 200}
Optimization Iteration: 66
Running with params: {'num_samples': 100, 'num_simulations': 300}
Optimization Iteration: 67
Running with params: {'num_samples': 110, 'num_simulations': 300}
Optimization Iteration: 68
Running with params: {'num_samples': 130, 'num_simulations': 400}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_130_400
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 20.254, Max: 21.229999999999997, Min: 19.66
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 69
Running with params: {'num_samples': 100, 'num_simulations': 500}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_100_500
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 18.913, Max: 19.53, Min: 18.38
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 18.913, Max: 19.53, Min: 18.38
Variance (7.703719777548943e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 18.913
Score: 18.913
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 70
Running with params: {'num_samples': 140, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_140_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 15.959333333333332, Max: 16.62, Min: 15.540000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 71
Running with params: {'num_samples': 150, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_150_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 15.141333333333336, Max: 15.690000000000001, Min: 14.89
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 15.141333333333336, Max: 15.690000000000001, Min: 14.89
Variance (4.81482486096809e-35) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 15.141333333333336
Score: 15.141333333333336
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 72
Running with params: {'num_samples': 150, 'num_simulations': 200}
Optimization Iteration: 73
Running with params: {'num_samples': 200, 'num_simulations': 100}
Optimization Iteration: 74
Running with params: {'num_samples': 150, 'num_simulations': 100}
Optimization Iteration: 75
Running with params: {'num_samples': 170, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_170_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.247000000000003, Max: 24.79, Min: 23.77
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 24.247000000000003, Max: 24.79, Min: 23.77
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 24.247000000000003
Score: 24.247000000000003
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 76
Running with params: {'num_samples': 190, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_190_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 21.025333333333332, Max: 21.61, Min: 20.68
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 77
Running with params: {'num_samples': 150, 'num_simulations': 100}
Optimization Iteration: 78
Running with params: {'num_samples': 210, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_210_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 21.978999999999996, Max: 22.669999999999998, Min: 21.319999999999997
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 79
Running with params: {'num_samples': 170, 'num_simulations': 100}
Optimization Iteration: 80
Running with params: {'num_samples': 120, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_120_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 14.484, Max: 15.219999999999999, Min: 14.09
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 81
Running with params: {'num_samples': 160, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_160_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 20.105, Max: 20.630000000000003, Min: 19.7
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 82
Running with params: {'num_samples': 140, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_140_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 18...
Iter 16...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 13.121666666666666, Max: 13.41, Min: 12.82
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 83
Running with params: {'num_samples': 190, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_190_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.155000000000005, Max: 25.94, Min: 24.44
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 25.155000000000005, Max: 25.94, Min: 24.44
Variance (4.81482486096809e-35) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 25.155000000000005
Score: 25.155000000000005
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 84
Running with params: {'num_samples': 130, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_130_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.771333333333333, Max: 12.13, Min: 11.340000000000002
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 85
Running with params: {'num_samples': 110, 'num_simulations': 100}
Optimization Iteration: 86
Running with params: {'num_samples': 200, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_200_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 22...
Iter 20...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 23.033333333333335, Max: 23.5, Min: 22.61
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 23.033333333333335, Max: 23.5, Min: 22.61
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 23.033333333333335
Score: 23.033333333333335
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 87
Running with params: {'num_samples': 150, 'num_simulations': 100}
Optimization Iteration: 88
Running with params: {'num_samples': 140, 'num_simulations': 200}
Optimization Iteration: 89
Running with params: {'num_samples': 180, 'num_simulations': 400}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_180_400
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 26.529333333333337, Max: 27.17, Min: 25.93
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 26.529333333333337, Max: 27.17, Min: 25.93
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 26.529333333333337
Score: 26.529333333333337
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 90
Running with params: {'num_samples': 220, 'num_simulations': 100}
Optimization Iteration: 91
Running with params: {'num_samples': 260, 'num_simulations': 200}
Optimization Iteration: 92
Running with params: {'num_samples': 120, 'num_simulations': 100}
Optimization Iteration: 93
Running with params: {'num_samples': 160, 'num_simulations': 100}
Optimization Iteration: 94
Running with params: {'num_samples': 110, 'num_simulations': 700}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_110_700
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 24...
Iter 22...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 29.569666666666667, Max: 30.39, Min: 28.74
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 29.569666666666667, Max: 30.39, Min: 28.74
Variance (4.81482486096809e-35) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 29.569666666666667
Score: 29.569666666666667
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 95
Running with params: {'num_samples': 130, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_130_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 17...
Iter 15...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.482666666666669, Max: 13.09, Min: 12.16
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 96
Running with params: {'num_samples': 230, 'num_simulations': 100}
Optimization Iteration: 97
Running with params: {'num_samples': 180, 'num_simulations': 200}
Optimization Iteration: 98
Running with params: {'num_samples': 170, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_170_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 22.25433333333333, Max: 23.04, Min: 21.63
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 99
Running with params: {'num_samples': 120, 'num_simulations': 100}
Optimization Iteration: 100
Running with params: {'num_samples': 210, 'num_simulations': 400}
Upto iteration 100: {'num_samples': 100.0, 'num_simulations': 100.0}
Optimization Iteration: 101
Running with params: {'num_samples': 240, 'num_simulations': 600}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_240_600
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 19...
Iter 17...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 26.962999999999997, Max: 27.86, Min: 26.180000000000003
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 26.962999999999997, Max: 27.86, Min: 26.180000000000003
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 26.962999999999997
Score: 26.962999999999997
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 102
Running with params: {'num_samples': 160, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_160_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 26.826, Max: 27.9, Min: 26.119999999999997
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 26.826, Max: 27.9, Min: 26.119999999999997
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 26.826
Score: 26.826
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 103
Running with params: {'num_samples': 130, 'num_simulations': 100}
Optimization Iteration: 104
Running with params: {'num_samples': 190, 'num_simulations': 500}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_190_500
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 34.958, Max: 36.07, Min: 33.69
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 34.958, Max: 36.07, Min: 33.69
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 34.958
Score: 34.958
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 105
Running with params: {'num_samples': 200, 'num_simulations': 100}
Optimization Iteration: 106
Running with params: {'num_samples': 150, 'num_simulations': 200}
Optimization Iteration: 107
Running with params: {'num_samples': 110, 'num_simulations': 200}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_110_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 16.163666666666668, Max: 16.59, Min: 15.709999999999999
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 16.163666666666668, Max: 16.59, Min: 15.709999999999999
Variance (7.703719777548943e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 16.163666666666668
Score: 16.163666666666668
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 108
Running with params: {'num_samples': 140, 'num_simulations': 100}
Optimization Iteration: 109
Running with params: {'num_samples': 120, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_120_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 20.832666666666665, Max: 21.62, Min: 20.380000000000003
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 20.832666666666665, Max: 21.62, Min: 20.380000000000003
Variance (7.703719777548943e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 20.832666666666665
Score: 20.832666666666665
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 110
Running with params: {'num_samples': 110, 'num_simulations': 400}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_110_400
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 22.351333333333333, Max: 23.14, Min: 21.6
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 22.351333333333333, Max: 23.14, Min: 21.6
Variance (3.009265538105056e-36) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 22.351333333333333
Score: 22.351333333333333
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 111
Running with params: {'num_samples': 160, 'num_simulations': 200}
Optimization Iteration: 112
Running with params: {'num_samples': 280, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_280_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Iter 17...
Timings: Avg: 22.65966666666667, Max: 23.18, Min: 22.0
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 113
Running with params: {'num_samples': 180, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_180_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 20.679666666666662, Max: 21.16, Min: 20.3
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 20.679666666666662, Max: 21.16, Min: 20.3
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 20.679666666666662
Score: 20.679666666666662
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 114
Running with params: {'num_samples': 100, 'num_simulations': 200}
Optimization Iteration: 115
Running with params: {'num_samples': 250, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_250_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.150000000000002, Max: 25.82, Min: 24.44
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 116
Running with params: {'num_samples': 220, 'num_simulations': 100}
Optimization Iteration: 117
Running with params: {'num_samples': 350, 'num_simulations': 1100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_350_1100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 49.230999999999995, Max: 50.84, Min: 47.849999999999994
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 49.230999999999995, Max: 50.84, Min: 47.849999999999994
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 49.230999999999995
Score: 49.230999999999995
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 118
Running with params: {'num_samples': 130, 'num_simulations': 100}
Optimization Iteration: 119
Running with params: {'num_samples': 100, 'num_simulations': 200}
Optimization Iteration: 120
Running with params: {'num_samples': 310, 'num_simulations': 500}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_310_500
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 33.79533333333333, Max: 34.879999999999995, Min: 32.91
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 33.79533333333333, Max: 34.879999999999995, Min: 32.91
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 33.79533333333333
Score: 33.79533333333333
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 121
Running with params: {'num_samples': 170, 'num_simulations': 100}
Optimization Iteration: 122
Running with params: {'num_samples': 150, 'num_simulations': 400}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_150_400
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 21.003666666666668, Max: 21.880000000000003, Min: 20.46
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 21.003666666666668, Max: 21.880000000000003, Min: 20.46
Variance (4.81482486096809e-35) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 21.003666666666668
Score: 21.003666666666668
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 123
Running with params: {'num_samples': 120, 'num_simulations': 100}
Optimization Iteration: 124
Running with params: {'num_samples': 140, 'num_simulations': 800}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_140_800
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 26...
Iter 24...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 28.509333333333327, Max: 29.68, Min: 27.45
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 28.509333333333327, Max: 29.68, Min: 27.45
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 28.509333333333327
Score: 28.509333333333327
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 125
Running with params: {'num_samples': 150, 'num_simulations': 200}
Optimization Iteration: 126
Running with params: {'num_samples': 190, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_190_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.336333333333332, Max: 26.15, Min: 24.64
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 25.336333333333332, Max: 26.15, Min: 24.64
Variance (1.925929944387236e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 25.336333333333332
Score: 25.336333333333332
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 127
Running with params: {'num_samples': 200, 'num_simulations': 100}
Optimization Iteration: 128
Running with params: {'num_samples': 110, 'num_simulations': 200}
Optimization Iteration: 129
Running with params: {'num_samples': 130, 'num_simulations': 900}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_130_900
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 19...
Iter 17...
Iter 20...
Iter 21...
Iter 23...
Iter 24...
Iter 22...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 28.008, Max: 28.869999999999997, Min: 27.18
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 130
Running with params: {'num_samples': 210, 'num_simulations': 100}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_210_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 21.736333333333324, Max: 22.73, Min: 21.24
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 131
Running with params: {'num_samples': 100, 'num_simulations': 700}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_100_700
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 22.823, Max: 23.95, Min: 21.96
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 22.823, Max: 23.95, Min: 21.96
Variance (7.703719777548943e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 22.823
Score: 22.823
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 132
Running with params: {'num_samples': 170, 'num_simulations': 200}
Optimization Iteration: 133
Running with params: {'num_samples': 140, 'num_simulations': 300}
Optimization Iteration: 134
Running with params: {'num_samples': 260, 'num_simulations': 100}
Optimization Iteration: 135
Running with params: {'num_samples': 120, 'num_simulations': 1500}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_120_1500
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 59.40599999999999, Max: 61.53, Min: 57.559999999999995
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 59.40599999999999, Max: 61.53, Min: 57.559999999999995
Variance (7.703719777548943e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 59.40599999999999
Score: 59.40599999999999
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 136
Running with params: {'num_samples': 180, 'num_simulations': 200}
Optimization Iteration: 137
Running with params: {'num_samples': 290, 'num_simulations': 100}
Optimization Iteration: 138
Running with params: {'num_samples': 110, 'num_simulations': 100}
Optimization Iteration: 139
Running with params: {'num_samples': 230, 'num_simulations': 300}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_230_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 27.242333333333328, Max: 28.080000000000002, Min: 26.57
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 140
Running with params: {'num_samples': 140, 'num_simulations': 2000}
Logdir: /mnt/batch/tasks/workitems/optsbi2/job-1/Task_sbi/wd/borntobeflaky/tool/logs/optim_1597948583_sbi/run_1597949032/assert_41267339_140_2000
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 60.62333333333334, Max: 63.14, Min: 58.64
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 60.62333333333334, Max: 63.14, Min: 58.64
Variance (4.81482486096809e-35) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 60.62333333333334
Score: 60.62333333333334
Best-score: 14.29833333333333
Best-param: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 141
Running with params: {'num_samples': 130, 'num_simulations': 600}
Optimization Iteration: 142
Running with params: {'num_samples': 160, 'num_simulations': 200}
Optimization Iteration: 143
Running with params: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 144
Running with params: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 145
Running with params: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 146
Running with params: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 147
Running with params: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 148
Running with params: {'num_samples': 100, 'num_simulations': 100}
Optimization Iteration: 149
Running with params: {'num_samples': 110, 'num_simulations': 100}
Optimization Iteration: 150
Running with params: {'num_samples': 110, 'num_simulations': 100}
Upto iteration 150: {'num_samples': 100.0, 'num_simulations': 100.0}
Breaking...
{'num_samples': 100.0, 'num_simulations': 100.0}
Best score: 14.29833333333333
Repeated params: 52
Trials: 151
Best param {'num_samples': 100.0, 'num_simulations': 100.0}
Reduction: 79.67918745173837%
Speedup: 4.921063060962817x
Optimizer time: 2922.9639117717743
