Repo: pymc-learn
Filename: /home/jselvam2/projects/research/borntobeflaky/projects/pymc-learn/pmlearn/linear_model/tests/test_logistic.py
ClassName: TestHierarchicalLogisticRegressionScore
Testname: test_score_scores
Params: n,141,67,ParamType.ITER,50000
minibatch_size,141,41,ParamType.ITER,500
Assertion: npt.assert_array_less(naive_score, score)
Original runtime: 71.55199999999999
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'n': 50000, 'minibatch_size': 500}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_50000_500
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 56.55233333333332, Max: 71.74, Min: 48.79
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1026328381341406
Continuing to next batch...
Evaluating 30 values out of 30
Overall-timings: Avg: 56.55233333333332, Max: 71.74, Min: 48.79
Choosing distribution: dweibull
Probability of fail (non-zero): 0.04903043796299256
Exceeding max probability of failure: 0.04903043796299256
All-Passed: False
Probabilty of failure: 0.04903043796299256
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Something failed
Optimization Iteration: 2
Running with params: {'minibatch_size': 110, 'n': 3200}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_110_3200
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 38.449666666666666, Max: 49.06, Min: 34.38
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2366013311065147
Continuing to next batch...
Evaluating 30 values out of 30
Overall-timings: Avg: 38.449666666666666, Max: 49.06, Min: 34.38
Choosing distribution: beta
Probability of fail (non-zero): 0.05116843190629128
Exceeding max probability of failure: 0.05116843190629128
All-Passed: False
Probabilty of failure: 0.05116843190629128
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 3
Running with params: {'minibatch_size': 250, 'n': 100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_250_100
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 37.254000000000005, Max: 47.480000000000004, Min: 33.16
Passed tests : 21
Failed tests : 9
Converged: False
Convergence score: 2.322454455582763
Continuing to next batch...
Evaluating 30 values out of 30
Overall-timings: Avg: 37.254000000000005, Max: 47.480000000000004, Min: 33.16
Choosing distribution: beta
Probability of fail (non-zero): 0.3833420507811216
Exceeding max probability of failure: 0.3833420507811216
All-Passed: False
Probabilty of failure: 0.3833420507811216
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 4
Running with params: {'minibatch_size': 220, 'n': 100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_220_100
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 6...
Iter 5...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 37.98733333333333, Max: 46.95, Min: 33.67
Passed tests : 23
Failed tests : 7
Converged: False
Convergence score: 1.936379366357248
Continuing to next batch...
Evaluating 30 values out of 30
Overall-timings: Avg: 37.98733333333333, Max: 46.95, Min: 33.67
Choosing distribution: beta
Probability of fail (non-zero): 0.3635276804728709
Exceeding max probability of failure: 0.3635276804728709
All-Passed: False
Probabilty of failure: 0.3635276804728709
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 5
Running with params: {'minibatch_size': 130, 'n': 1100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_130_1100
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 38.98733333333333, Max: 48.790000000000006, Min: 33.46
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.876408050800221
Continuing to next batch...
Evaluating 30 values out of 30
Overall-timings: Avg: 38.98733333333333, Max: 48.790000000000006, Min: 33.46
Choosing distribution: beta
Probability of fail (non-zero): 0.05164169750875447
Exceeding max probability of failure: 0.05164169750875447
All-Passed: False
Probabilty of failure: 0.05164169750875447
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 6
Running with params: {'minibatch_size': 410, 'n': 14600}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_410_14600
Launching 30 jobs, 15 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 42.711000000000006, Max: 56.22, Min: 38.15
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.7935407668136647
Continuing to next batch...
Evaluating 30 values out of 30
Overall-timings: Avg: 42.711000000000006, Max: 56.22, Min: 38.15
Choosing distribution: beta
Probability of fail (non-zero): 0.00790230095037392
All-Passed: True
Probabilty of failure: 0.00790230095037392
Runtime: 42.711000000000006
Score: 42.711000000000006
Best-score: 42.711000000000006
Best-param: {'minibatch_size': 410, 'n': 14600}
Optimization Iteration: 7
Running with params: {'minibatch_size': 260, 'n': 200}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_260_200
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 7...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 38.72233333333333, Max: 50.43, Min: 33.35
Passed tests : 25
Failed tests : 5
Converged: False
Convergence score: 1.8471666324004863
Continuing to next batch...
Evaluating 30 values out of 30
Overall-timings: Avg: 38.72233333333333, Max: 50.43, Min: 33.35
Choosing distribution: gamma
Probability of fail (non-zero): 0.10860717521303287
Exceeding max probability of failure: 0.10860717521303287
All-Passed: False
Probabilty of failure: 0.10860717521303287
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.711000000000006
Best-param: {'minibatch_size': 410, 'n': 14600}
Optimization Iteration: 8
Running with params: {'minibatch_size': 480, 'n': 9500}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_480_9500
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 42.34733333333334, Max: 50.69, Min: 37.9
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.0063810739753256
Continuing to next batch...
Evaluating 30 values out of 30
Overall-timings: Avg: 42.34733333333334, Max: 50.69, Min: 37.9
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.0010540688834816958
All-Passed: True
Probabilty of failure: 0.0010540688834816958
Runtime: 42.34733333333334
Score: 42.34733333333334
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 9
Running with params: {'minibatch_size': 130, 'n': 16900}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_130_16900
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 12...
Iter 11...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 42.792666666666676, Max: 56.400000000000006, Min: 37.699999999999996
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4180027982292662
Continuing to next batch...
Evaluating 30 values out of 30
Overall-timings: Avg: 42.792666666666676, Max: 56.400000000000006, Min: 37.699999999999996
Choosing distribution: t
Probability of fail (non-zero): 0.06584077192098814
Exceeding max probability of failure: 0.06584077192098814
All-Passed: False
Probabilty of failure: 0.06584077192098814
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 10
Running with params: {'minibatch_size': 180, 'n': 400}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_180_400
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 38.34233333333332, Max: 48.76, Min: 32.83
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.175185099798657
Continuing to next batch...
Evaluating 30 values out of 30
Overall-timings: Avg: 38.34233333333332, Max: 48.76, Min: 32.83
Choosing distribution: laplace
Probability of fail (non-zero): 0.06857489034858955
Exceeding max probability of failure: 0.06857489034858955
All-Passed: False
Probabilty of failure: 0.06857489034858955
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 11
Running with params: {'minibatch_size': 300, 'n': 33800}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_300_33800
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 49.48866666666667, Max: 65.24, Min: 42.94
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.6035818100936785
Exceeding current best timeout: 49.48866666666667 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 12
Running with params: {'minibatch_size': 330, 'n': 6500}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_330_6500
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 49.31733333333332, Max: 59.39, Min: 42.980000000000004
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8728401127428274
Exceeding current best timeout: 49.31733333333332 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 13
Running with params: {'minibatch_size': 260, 'n': 11700}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_260_11700
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 48.08633333333333, Max: 61.43, Min: 43.07
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.6534659758970864
Exceeding current best timeout: 48.08633333333333 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 14
Running with params: {'minibatch_size': 150, 'n': 10600}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_150_10600
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 10...
Iter 9...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 48.359, Max: 62.45, Min: 42.97
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6357639578233203
Exceeding current best timeout: 48.359 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 15
Running with params: {'minibatch_size': 130, 'n': 700}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_130_700
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 47.94933333333333, Max: 58.8, Min: 43.45
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6933113979551409
Exceeding current best timeout: 47.94933333333333 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 16
Running with params: {'minibatch_size': 370, 'n': 400}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_370_400
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 48.84566666666667, Max: 61.49, Min: 43.68
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.7184661757335595
Exceeding current best timeout: 48.84566666666667 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 17
Running with params: {'minibatch_size': 230, 'n': 100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_230_100
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 11...
Iter 10...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 48.321333333333335, Max: 60.81, Min: 43.34
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2388093878475819
Exceeding current best timeout: 48.321333333333335 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 18
Running with params: {'minibatch_size': 130, 'n': 4500}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_130_4500
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 48.874333333333325, Max: 59.16, Min: 43.3
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2608540034785785
Exceeding current best timeout: 48.874333333333325 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Upto iteration 50: {'minibatch_size': 480.0, 'n': 9500.0}
Optimization Iteration: 19
Running with params: {'minibatch_size': 420, 'n': 35700}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_420_35700
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 50.230000000000004, Max: 62.34, Min: 44.040000000000006
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9722908493666509
Exceeding current best timeout: 50.230000000000004 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 20
Running with params: {'minibatch_size': 260, 'n': 7000}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_260_7000
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 7...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 50.53999999999999, Max: 62.44, Min: 44.55
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1246928525170314
Exceeding current best timeout: 50.53999999999999 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 21
Running with params: {'minibatch_size': 180, 'n': 400}
Optimization Iteration: 22
Running with params: {'minibatch_size': 500, 'n': 1900}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_500_1900
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 49.48233333333334, Max: 66.26, Min: 43.11
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.208834647373828
Exceeding current best timeout: 49.48233333333334 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 23
Running with params: {'minibatch_size': 500, 'n': 24400}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_500_24400
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 10...
Iter 9...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 49.12866666666666, Max: 60.01, Min: 43.99
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.1513832826934656
Exceeding current best timeout: 49.12866666666666 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 24
Running with params: {'minibatch_size': 400, 'n': 16400}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_400_16400
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 7...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 49.81033333333335, Max: 59.440000000000005, Min: 44.16
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 3.7920481238903165
Exceeding current best timeout: 49.81033333333335 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 25
Running with params: {'minibatch_size': 450, 'n': 2000}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_450_2000
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 48.907000000000004, Max: 62.4, Min: 44.0
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1177115906846953
Exceeding current best timeout: 48.907000000000004 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 26
Running with params: {'minibatch_size': 320, 'n': 48200}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_320_48200
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 49.21199999999999, Max: 59.4, Min: 43.33
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 3.293895992784734
Exceeding current best timeout: 49.21199999999999 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 27
Running with params: {'minibatch_size': 360, 'n': 6600}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_360_6600
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 7...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 50.37500000000001, Max: 67.44, Min: 43.83
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.6840850128706677
Exceeding current best timeout: 50.37500000000001 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 28
Running with params: {'minibatch_size': 480, 'n': 3600}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_480_3600
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 13...
Iter 14...
Iter 12...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 51.97566666666667, Max: 67.9, Min: 45.85
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.6449398137172455
Exceeding current best timeout: 51.97566666666667 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 29
Running with params: {'minibatch_size': 430, 'n': 48500}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_430_48500
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 51.476, Max: 65.81, Min: 45.34
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.24613554174739
Exceeding current best timeout: 51.476 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 30
Running with params: {'minibatch_size': 380, 'n': 2600}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_380_2600
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 52.900999999999996, Max: 61.47, Min: 47.23
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 4.169021619778667
Exceeding current best timeout: 52.900999999999996 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 31
Running with params: {'minibatch_size': 300, 'n': 18400}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_300_18400
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 7...
Iter 6...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 52.15966666666665, Max: 69.3, Min: 45.61
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.7187902881222294
Exceeding current best timeout: 52.15966666666665 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 32
Running with params: {'minibatch_size': 500, 'n': 10300}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_500_10300
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 52.46266666666667, Max: 63.78, Min: 45.94
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.9694076417511064
Exceeding current best timeout: 52.46266666666667 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 33
Running with params: {'minibatch_size': 200, 'n': 4800}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_200_4800
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 7...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 52.559, Max: 72.74000000000001, Min: 46.55
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.5152975948539242
Exceeding current best timeout: 52.559 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Optimization Iteration: 34
Running with params: {'minibatch_size': 340, 'n': 24100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597840741/assert_59428421_340_24100
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 52.29766666666667, Max: 63.05, Min: 46.86
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.7314703066880772
Exceeding current best timeout: 52.29766666666667 > 42.34733333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 42.34733333333334
Best-param: {'minibatch_size': 480, 'n': 9500}
Upto iteration 100: {'minibatch_size': 480.0, 'n': 9500.0}
Breaking...
{'minibatch_size': 480.0, 'n': 9500.0}
Best score: 42.34733333333334
Repeated params: 1
Trials: 35
Best param {'minibatch_size': 480.0, 'n': 9500.0}
Exception>>>
Traceback (most recent call last):
  File "optimizer.py", line 68, in run_optimizer
    reduction = ((bayesopt.original_runtime-bayesopt.best_runtime+0.0)
TypeError: unsupported operand type(s) for -: 'NoneType' and 'float'

Optimizer time: 12799.538800239563
