Repo: pymc-learn
Filename: /home/jselvam2/projects/research/borntobeflaky/projects/pymc-learn/pmlearn/linear_model/tests/test_logistic.py
ClassName: TestHierarchicalLogisticRegressionScore
Testname: test_score_scores
Params: n,141,67,ParamType.ITER,50000
minibatch_size,141,41,ParamType.ITER,500
Assertion: npt.assert_array_less(naive_score, score)
Original runtime: 59.06
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'n': 50000, 'minibatch_size': 500}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_50000_500
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 7...
Iter 6...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 60.022666666666666, Max: 64.65, Min: 56.660000000000004
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.1946317793684003
Continuing to next batch...
Evaluating 30 values out of 30
Overall-timings: Avg: 60.022666666666666, Max: 64.65, Min: 56.660000000000004
Choosing distribution: beta
Probability of fail (non-zero): 0.08406395173230585
Exceeding max probability of failure: 0.08406395173230585
All-Passed: False
Probabilty of failure: 0.08406395173230585
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
>>>!!Warning: Allowing update probability!!<<
Updating probability of failure to: 0.08406395173230585
>>Setting original runtime to 60.022666666666666
Optimization Iteration: 1
Running with params: {'minibatch_size': 240, 'n': 1900}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_240_1900
Launching 30 jobs, 10 in parallel
Iter 1...
Iter 0...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 43.00233333333334, Max: 46.669999999999995, Min: 33.53
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.7419595286505938
Continuing to next batch...
Evaluating 29 values out of 30
Overall-timings: Avg: 43.00233333333334, Max: 46.669999999999995, Min: 33.53
Choosing distribution: dweibull
Probability of fail (non-zero): 0.015912097398322222
All-Passed: True
Probabilty of failure: 0.015912097398322222
Runtime: 43.00233333333334
Score: 43.00233333333334
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 2
Running with params: {'minibatch_size': 230, 'n': 45300}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_230_45300
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 54.98833333333334, Max: 63.89, Min: 52.54
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.4455129761814425
Exceeding current best timeout: 54.98833333333334 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 3
Running with params: {'minibatch_size': 310, 'n': 3700}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_310_3700
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 55.62833333333333, Max: 60.5, Min: 53.47
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.314726394819144
Exceeding current best timeout: 55.62833333333333 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 4
Running with params: {'minibatch_size': 120, 'n': 900}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_120_900
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 56.105333333333334, Max: 62.519999999999996, Min: 53.13
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.5458587313562515
Exceeding current best timeout: 56.105333333333334 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 5
Running with params: {'minibatch_size': 460, 'n': 100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_460_100
Launching 30 jobs, 10 in parallel
Iter 1...
Iter 0...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 57.190000000000005, Max: 64.28, Min: 53.95
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9214571895254295
Evaluating 30 values out of 30
Overall-timings: Avg: 57.190000000000005, Max: 64.28, Min: 53.95
Choosing distribution: dweibull
Probability of fail (non-zero): 0.009257436367625771
All-Passed: True
Probabilty of failure: 0.009257436367625771
Runtime: 57.190000000000005
Score: 57.190000000000005
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 6
Running with params: {'minibatch_size': 260, 'n': 100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_260_100
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 55.96033333333333, Max: 66.22, Min: 34.34
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 1.4026879305661204
Exceeding current best timeout: 55.96033333333333 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 7
Running with params: {'minibatch_size': 100, 'n': 10400}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_100_10400
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 9...
Iter 7...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 55.714666666666666, Max: 70.75, Min: 46.81
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.1759340562030633
Exceeding current best timeout: 55.714666666666666 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 8
Running with params: {'minibatch_size': 120, 'n': 200}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_120_200
Launching 30 jobs, 10 in parallel
Iter 2...
Iter 1...
Iter 0...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 56.50166666666666, Max: 65.89, Min: 53.22
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.608634978801682
Exceeding current best timeout: 56.50166666666666 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 9
Running with params: {'minibatch_size': 220, 'n': 16800}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_220_16800
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 56.172000000000004, Max: 63.52, Min: 53.440000000000005
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.957202532279941
Exceeding current best timeout: 56.172000000000004 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 10
Running with params: {'minibatch_size': 200, 'n': 200}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_200_200
Launching 30 jobs, 10 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 5...
Iter 4...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 56.18066666666667, Max: 66.49, Min: 34.77
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.70313869033881
Exceeding current best timeout: 56.18066666666667 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 11
Running with params: {'minibatch_size': 100, 'n': 40300}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_100_40300
Launching 30 jobs, 10 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 58.82966666666666, Max: 73.54, Min: 54.04
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0246807672616596
Exceeding current best timeout: 58.82966666666666 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 12
Running with params: {'minibatch_size': 130, 'n': 100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_130_100
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 58.24199999999999, Max: 66.87, Min: 53.04
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 3.1842932970735
Exceeding current best timeout: 58.24199999999999 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 13
Running with params: {'minibatch_size': 280, 'n': 15700}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_280_15700
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 58.34433333333333, Max: 73.48, Min: 54.760000000000005
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.3880330634594387
Exceeding current best timeout: 58.34433333333333 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 14
Running with params: {'minibatch_size': 210, 'n': 200}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_210_200
Launching 30 jobs, 10 in parallel
Iter 1...
Iter 0...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 57.75566666666666, Max: 66.54, Min: 39.52
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.4247247228635307
Exceeding current best timeout: 57.75566666666666 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Upto iteration 50: {'minibatch_size': 240.0, 'n': 1900.0}
Optimization Iteration: 15
Running with params: {'minibatch_size': 470, 'n': 2900}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_470_2900
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 59.698, Max: 73.59, Min: 56.37
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 3.786802144331818
Exceeding current best timeout: 59.698 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 16
Running with params: {'minibatch_size': 100, 'n': 22900}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_100_22900
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 7...
Iter 6...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 59.513333333333335, Max: 71.16, Min: 56.49
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.0433250317525922
Exceeding current best timeout: 59.513333333333335 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 17
Running with params: {'minibatch_size': 190, 'n': 19100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_190_19100
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 60.74033333333333, Max: 74.91, Min: 57.11
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.405042393135457
Exceeding current best timeout: 60.74033333333333 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 18
Running with params: {'minibatch_size': 110, 'n': 31600}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_110_31600
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 60.56933333333334, Max: 70.0, Min: 56.410000000000004
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3689928328138627
Exceeding current best timeout: 60.56933333333334 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 19
Running with params: {'minibatch_size': 160, 'n': 2000}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_160_2000
Launching 30 jobs, 10 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 60.464999999999996, Max: 70.16, Min: 56.580000000000005
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.4129451611156876
Exceeding current best timeout: 60.464999999999996 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 20
Running with params: {'minibatch_size': 110, 'n': 17000}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_110_17000
Launching 30 jobs, 10 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 59.53733333333333, Max: 69.14, Min: 56.44
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2445424690860065
Exceeding current best timeout: 59.53733333333333 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 21
Running with params: {'minibatch_size': 490, 'n': 800}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_490_800
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Timings: Avg: 58.573, Max: 66.74000000000001, Min: 36.53
Passed tests : 28
Failed tests : 2
Converged: False
Convergence score: 2.4362740082056296
Exceeding current best timeout: 58.573 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 22
Running with params: {'minibatch_size': 390, 'n': 500}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_390_500
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 59.53333333333334, Max: 69.58, Min: 56.5
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.0728423997710643
Exceeding current best timeout: 59.53333333333334 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 23
Running with params: {'minibatch_size': 350, 'n': 5100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_350_5100
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 9...
Iter 7...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 59.72033333333333, Max: 66.99, Min: 56.78
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.019607970916546
Exceeding current best timeout: 59.72033333333333 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 24
Running with params: {'minibatch_size': 420, 'n': 1600}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_420_1600
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 58.99933333333334, Max: 69.69, Min: 48.620000000000005
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.062379478797995
Exceeding current best timeout: 58.99933333333334 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 25
Running with params: {'minibatch_size': 170, 'n': 400}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_170_400
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 59.47066666666665, Max: 68.34, Min: 49.05
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.438865774319502
Exceeding current best timeout: 59.47066666666665 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 26
Running with params: {'minibatch_size': 330, 'n': 1200}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_330_1200
Launching 30 jobs, 10 in parallel
Iter 1...
Iter 0...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 60.68033333333333, Max: 69.27000000000001, Min: 56.72
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.216917258889529
Exceeding current best timeout: 60.68033333333333 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Optimization Iteration: 27
Running with params: {'minibatch_size': 150, 'n': 6100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597930857_pymc-learn/run_1597951243/assert_59428421_150_6100
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 59.99066666666668, Max: 68.34, Min: 56.410000000000004
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5303550512513746
Exceeding current best timeout: 59.99066666666668 > 43.00233333333334
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 43.00233333333334
Best-param: {'minibatch_size': 240, 'n': 1900}
Upto iteration 100: {'minibatch_size': 240.0, 'n': 1900.0}
Breaking...
{'minibatch_size': 240.0, 'n': 1900.0}
Best score: 43.00233333333334
Repeated params: 0
Trials: 28
Best param {'minibatch_size': 240.0, 'n': 1900.0}
Reduction: 28.35650976297842%
Speedup: 1.3958002278946102x
Optimizer time: 13041.026151657104
