Repo: pymc-learn
Filename: /home/jselvam2/projects/research/borntobeflaky/projects/pymc-learn/pmlearn/gaussian_process/tests/test_gpr.py
ClassName: TestSparseGaussianProcessRegressorPredict
Testname: test_predict_returns_mean_predictions_and_std
Params: n,338,48,ParamType.ITER,25000
Assertion: npt.assert_equal(self.y_test.shape, preds.shape)
Original runtime: 100.844
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'n': 25000}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597965666_pymc-learn/run_1597965666/assert_43933399_25000
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 102.71000000000001, Max: 122.55999999999999, Min: 98.24000000000001
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 102.71000000000001, Max: 122.55999999999999, Min: 98.24000000000001
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 102.71000000000001
Score: 102.71000000000001
Best-score: 102.71000000000001
Best-param: {'n': 25000}
>>Setting original runtime to 102.71000000000001
Optimization Iteration: 1
Running with params: {'n': 3400}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597965666_pymc-learn/run_1597965666/assert_43933399_3400
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 83.66399999999999, Max: 112.92, Min: 77.55
Passed tests : 29
Failed tests : 1
Converged: True
Convergence score: 0.0
Evaluating 29 values out of 30
Overall-timings: Avg: 83.66399999999999, Max: 112.92, Min: 77.55
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 83.66399999999999
Score: 83.66399999999999
Best-score: 83.66399999999999
Best-param: {'n': 3400}
Optimization Iteration: 2
Running with params: {'n': 1100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597965666_pymc-learn/run_1597965666/assert_43933399_1100
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 7...
Iter 6...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 79.28533333333334, Max: 99.17, Min: 44.78
Passed tests : 29
Failed tests : 1
Converged: True
Convergence score: 0.0
Evaluating 29 values out of 30
Overall-timings: Avg: 79.28533333333334, Max: 99.17, Min: 44.78
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 79.28533333333334
Score: 79.28533333333334
Best-score: 79.28533333333334
Best-param: {'n': 1100}
Optimization Iteration: 3
Running with params: {'n': 300}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597965666_pymc-learn/run_1597965666/assert_43933399_300
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 75.98700000000001, Max: 93.96000000000001, Min: 39.53
Passed tests : 27
Failed tests : 3
Converged: True
Convergence score: 0.0
Evaluating 27 values out of 30
Overall-timings: Avg: 75.98700000000001, Max: 93.96000000000001, Min: 39.53
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 75.98700000000001
Score: 75.98700000000001
Best-score: 75.98700000000001
Best-param: {'n': 300}
Optimization Iteration: 4
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 5
Running with params: {'n': 1200}
Higher iteration... returning...
Optimization Iteration: 6
Running with params: {'n': 3900}
Higher iteration... returning...
Optimization Iteration: 7
Running with params: {'n': 16300}
Higher iteration... returning...
Optimization Iteration: 8
Running with params: {'n': 2700}
Higher iteration... returning...
Optimization Iteration: 9
Running with params: {'n': 10700}
Higher iteration... returning...
Optimization Iteration: 10
Running with params: {'n': 5700}
Higher iteration... returning...
Optimization Iteration: 11
Running with params: {'n': 10100}
Higher iteration... returning...
Optimization Iteration: 12
Running with params: {'n': 300}
Optimization Iteration: 13
Running with params: {'n': 7200}
Higher iteration... returning...
Optimization Iteration: 14
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 15
Running with params: {'n': 3900}
Higher iteration... returning...
Optimization Iteration: 16
Running with params: {'n': 12000}
Higher iteration... returning...
Optimization Iteration: 17
Running with params: {'n': 10900}
Higher iteration... returning...
Optimization Iteration: 18
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 19
Running with params: {'n': 800}
Higher iteration... returning...
Optimization Iteration: 20
Running with params: {'n': 2100}
Higher iteration... returning...
Optimization Iteration: 21
Running with params: {'n': 100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597965666_pymc-learn/run_1597965666/assert_43933399_100
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Timings: Avg: 77.91533333333332, Max: 97.78, Min: 42.620000000000005
Passed tests : 29
Failed tests : 1
Converged: True
Convergence score: 0.0
Evaluating 29 values out of 30
Overall-timings: Avg: 77.91533333333332, Max: 97.78, Min: 42.620000000000005
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 77.91533333333332
Score: 77.91533333333332
Best-score: 75.98700000000001
Best-param: {'n': 300}
Optimization Iteration: 22
Running with params: {'n': 100}
Optimization Iteration: 23
Running with params: {'n': 200}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597965666_pymc-learn/run_1597965666/assert_43933399_200
Launching 30 jobs, 10 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Timings: Avg: 78.96433333333333, Max: 93.58, Min: 44.230000000000004
Passed tests : 28
Failed tests : 2
Converged: True
Convergence score: 0.0
Evaluating 28 values out of 30
Overall-timings: Avg: 78.96433333333333, Max: 93.58, Min: 44.230000000000004
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 78.96433333333333
Score: 78.96433333333333
Best-score: 75.98700000000001
Best-param: {'n': 300}
Optimization Iteration: 24
Running with params: {'n': 200}
Optimization Iteration: 25
Running with params: {'n': 200}
Optimization Iteration: 26
Running with params: {'n': 700}
Higher iteration... returning...
Optimization Iteration: 27
Running with params: {'n': 100}
Optimization Iteration: 28
Running with params: {'n': 300}
Optimization Iteration: 29
Running with params: {'n': 600}
Higher iteration... returning...
Optimization Iteration: 30
Running with params: {'n': 200}
Optimization Iteration: 31
Running with params: {'n': 1600}
Higher iteration... returning...
Optimization Iteration: 32
Running with params: {'n': 300}
Optimization Iteration: 33
Running with params: {'n': 1100}
Optimization Iteration: 34
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 35
Running with params: {'n': 100}
Optimization Iteration: 36
Running with params: {'n': 900}
Higher iteration... returning...
Optimization Iteration: 37
Running with params: {'n': 1500}
Higher iteration... returning...
Optimization Iteration: 38
Running with params: {'n': 300}
Optimization Iteration: 39
Running with params: {'n': 100}
Optimization Iteration: 40
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 41
Running with params: {'n': 200}
Optimization Iteration: 42
Running with params: {'n': 2700}
Higher iteration... returning...
Optimization Iteration: 43
Running with params: {'n': 5300}
Higher iteration... returning...
Optimization Iteration: 44
Running with params: {'n': 300}
Optimization Iteration: 45
Running with params: {'n': 1300}
Higher iteration... returning...
Optimization Iteration: 46
Running with params: {'n': 24200}
Higher iteration... returning...
Optimization Iteration: 47
Running with params: {'n': 100}
Optimization Iteration: 48
Running with params: {'n': 1000}
Higher iteration... returning...
Optimization Iteration: 49
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 50
Running with params: {'n': 2000}
Higher iteration... returning...
Upto iteration 50: {'n': 300.0}
Optimization Iteration: 51
Running with params: {'n': 700}
Higher iteration... returning...
Optimization Iteration: 52
Running with params: {'n': 100}
Optimization Iteration: 53
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 54
Running with params: {'n': 200}
Optimization Iteration: 55
Running with params: {'n': 300}
Optimization Iteration: 56
Running with params: {'n': 3600}
Higher iteration... returning...
Optimization Iteration: 57
Running with params: {'n': 8200}
Higher iteration... returning...
Optimization Iteration: 58
Running with params: {'n': 300}
Optimization Iteration: 59
Running with params: {'n': 4700}
Higher iteration... returning...
Optimization Iteration: 60
Running with params: {'n': 2900}
Higher iteration... returning...
Optimization Iteration: 61
Running with params: {'n': 1900}
Higher iteration... returning...
Optimization Iteration: 62
Running with params: {'n': 100}
Optimization Iteration: 63
Running with params: {'n': 15500}
Higher iteration... returning...
Optimization Iteration: 64
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 65
Running with params: {'n': 200}
Optimization Iteration: 66
Running with params: {'n': 600}
Higher iteration... returning...
Optimization Iteration: 67
Running with params: {'n': 300}
Optimization Iteration: 68
Running with params: {'n': 200}
Optimization Iteration: 69
Running with params: {'n': 100}
Optimization Iteration: 70
Running with params: {'n': 800}
Higher iteration... returning...
Optimization Iteration: 71
Running with params: {'n': 300}
Optimization Iteration: 72
Running with params: {'n': 100}
Optimization Iteration: 73
Running with params: {'n': 200}
Optimization Iteration: 74
Running with params: {'n': 600}
Higher iteration... returning...
Optimization Iteration: 75
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 76
Running with params: {'n': 100}
Optimization Iteration: 77
Running with params: {'n': 1200}
Higher iteration... returning...
Optimization Iteration: 78
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 79
Running with params: {'n': 200}
Optimization Iteration: 80
Running with params: {'n': 900}
Higher iteration... returning...
Optimization Iteration: 81
Running with params: {'n': 1500}
Higher iteration... returning...
Optimization Iteration: 82
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 83
Running with params: {'n': 300}
Optimization Iteration: 84
Running with params: {'n': 100}
Optimization Iteration: 85
Running with params: {'n': 700}
Higher iteration... returning...
Optimization Iteration: 86
Running with params: {'n': 300}
Optimization Iteration: 87
Running with params: {'n': 200}
Optimization Iteration: 88
Running with params: {'n': 100}
Optimization Iteration: 89
Running with params: {'n': 100}
Optimization Iteration: 90
Running with params: {'n': 300}
Optimization Iteration: 91
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 92
Running with params: {'n': 1000}
Higher iteration... returning...
Optimization Iteration: 93
Running with params: {'n': 2400}
Higher iteration... returning...
Optimization Iteration: 94
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 95
Running with params: {'n': 1800}
Higher iteration... returning...
Optimization Iteration: 96
Running with params: {'n': 600}
Higher iteration... returning...
Optimization Iteration: 97
Running with params: {'n': 1300}
Higher iteration... returning...
Optimization Iteration: 98
Running with params: {'n': 200}
Optimization Iteration: 99
Running with params: {'n': 200}
Optimization Iteration: 100
Running with params: {'n': 100}
Upto iteration 100: {'n': 300.0}
Breaking...
{'n': 300.0}
Best score: 75.98700000000001
Repeated params: 39
Trials: 101
Best param {'n': 300.0}
Reduction: 26.017914516600133%
Speedup: 1.3516785765986286x
Optimizer time: 3560.98627948761
