Repo: pymc-learn
Filename: /home/jselvam2/projects/research/borntobeflaky/projects/pymc-learn/pmlearn/gaussian_process/tests/test_gpr.py
ClassName: TestSparseGaussianProcessRegressorPredict
Testname: test_predict_returns_predictions
Params: n,331,48,ParamType.ITER,25000
Assertion: npt.assert_equal(self.y_test.shape, preds.shape)
Original runtime: 105.5
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'n': 25000}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597786095/assert_33667757_25000
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 13...
Iter 12...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 70.88966666666667, Max: 81.28, Min: 64.87
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 70.88966666666667, Max: 81.28, Min: 64.87
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 70.88966666666667
Score: 70.88966666666667
Best-score: 70.88966666666667
Best-param: {'n': 25000}
>>Setting original runtime to 70.88966666666667
Optimization Iteration: 1
Running with params: {'n': 900}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597786095/assert_33667757_900
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 7...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 50.85800000000002, Max: 69.97000000000001, Min: 42.12
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 50.85800000000002, Max: 69.97000000000001, Min: 42.12
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 50.85800000000002
Score: 50.85800000000002
Best-score: 50.85800000000002
Best-param: {'n': 900}
Optimization Iteration: 2
Running with params: {'n': 13500}
Higher iteration... returning...
Optimization Iteration: 3
Running with params: {'n': 20600}
Higher iteration... returning...
Optimization Iteration: 4
Running with params: {'n': 200}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597786095/assert_33667757_200
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 52.48733333333334, Max: 70.3, Min: 43.2
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 52.48733333333334, Max: 70.3, Min: 43.2
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 52.48733333333334
Score: 52.48733333333334
Best-score: 50.85800000000002
Best-param: {'n': 900}
Optimization Iteration: 5
Running with params: {'n': 1000}
Higher iteration... returning...
Optimization Iteration: 6
Running with params: {'n': 21500}
Higher iteration... returning...
Optimization Iteration: 7
Running with params: {'n': 14800}
Higher iteration... returning...
Optimization Iteration: 8
Running with params: {'n': 400}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597786095/assert_33667757_400
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 42.94733333333334, Max: 51.86, Min: 9.22
Passed tests : 27
Failed tests : 3
Converged: True
Convergence score: 0.0
Evaluating 27 values out of 30
Overall-timings: Avg: 42.94733333333334, Max: 51.86, Min: 9.22
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 42.94733333333334
Score: 42.94733333333334
Best-score: 42.94733333333334
Best-param: {'n': 400}
Optimization Iteration: 9
Running with params: {'n': 100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597786095/assert_33667757_100
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 47.65333333333333, Max: 63.68, Min: 42.56
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 47.65333333333333, Max: 63.68, Min: 42.56
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 47.65333333333333
Score: 47.65333333333333
Best-score: 42.94733333333334
Best-param: {'n': 400}
Optimization Iteration: 10
Running with params: {'n': 9500}
Higher iteration... returning...
Optimization Iteration: 11
Running with params: {'n': 700}
Higher iteration... returning...
Optimization Iteration: 12
Running with params: {'n': 2000}
Higher iteration... returning...
Optimization Iteration: 13
Running with params: {'n': 10800}
Higher iteration... returning...
Optimization Iteration: 14
Running with params: {'n': 21000}
Higher iteration... returning...
Optimization Iteration: 15
Running with params: {'n': 1900}
Higher iteration... returning...
Optimization Iteration: 16
Running with params: {'n': 6000}
Higher iteration... returning...
Optimization Iteration: 17
Running with params: {'n': 600}
Higher iteration... returning...
Optimization Iteration: 18
Running with params: {'n': 10900}
Higher iteration... returning...
Optimization Iteration: 19
Running with params: {'n': 4400}
Higher iteration... returning...
Optimization Iteration: 20
Running with params: {'n': 1900}
Higher iteration... returning...
Optimization Iteration: 21
Running with params: {'n': 100}
Optimization Iteration: 22
Running with params: {'n': 200}
Optimization Iteration: 23
Running with params: {'n': 200}
Optimization Iteration: 24
Running with params: {'n': 400}
Optimization Iteration: 25
Running with params: {'n': 400}
Optimization Iteration: 26
Running with params: {'n': 400}
Optimization Iteration: 27
Running with params: {'n': 300}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597786095/assert_33667757_300
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 11...
Iter 10...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 48.279333333333334, Max: 67.01, Min: 41.88
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 48.279333333333334, Max: 67.01, Min: 41.88
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 48.279333333333334
Score: 48.279333333333334
Best-score: 42.94733333333334
Best-param: {'n': 400}
Optimization Iteration: 28
Running with params: {'n': 1300}
Higher iteration... returning...
Optimization Iteration: 29
Running with params: {'n': 3500}
Higher iteration... returning...
Optimization Iteration: 30
Running with params: {'n': 100}
Optimization Iteration: 31
Running with params: {'n': 600}
Higher iteration... returning...
Optimization Iteration: 32
Running with params: {'n': 300}
Optimization Iteration: 33
Running with params: {'n': 1000}
Higher iteration... returning...
Optimization Iteration: 34
Running with params: {'n': 400}
Optimization Iteration: 35
Running with params: {'n': 100}
Optimization Iteration: 36
Running with params: {'n': 200}
Optimization Iteration: 37
Running with params: {'n': 1400}
Higher iteration... returning...
Optimization Iteration: 38
Running with params: {'n': 800}
Higher iteration... returning...
Optimization Iteration: 39
Running with params: {'n': 300}
Optimization Iteration: 40
Running with params: {'n': 2900}
Higher iteration... returning...
Optimization Iteration: 41
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 42
Running with params: {'n': 200}
Optimization Iteration: 43
Running with params: {'n': 1100}
Higher iteration... returning...
Optimization Iteration: 44
Running with params: {'n': 100}
Optimization Iteration: 45
Running with params: {'n': 2700}
Higher iteration... returning...
Optimization Iteration: 46
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 47
Running with params: {'n': 800}
Higher iteration... returning...
Optimization Iteration: 48
Running with params: {'n': 6700}
Higher iteration... returning...
Optimization Iteration: 49
Running with params: {'n': 300}
Optimization Iteration: 50
Running with params: {'n': 100}
Upto iteration 50: {'n': 400.0}
Optimization Iteration: 51
Running with params: {'n': 200}
Optimization Iteration: 52
Running with params: {'n': 600}
Higher iteration... returning...
Optimization Iteration: 53
Running with params: {'n': 100}
Optimization Iteration: 54
Running with params: {'n': 1600}
Higher iteration... returning...
Optimization Iteration: 55
Running with params: {'n': 2400}
Higher iteration... returning...
Optimization Iteration: 56
Running with params: {'n': 1200}
Higher iteration... returning...
Optimization Iteration: 57
Running with params: {'n': 900}
Optimization Iteration: 58
Running with params: {'n': 400}
Optimization Iteration: 59
Running with params: {'n': 4900}
Higher iteration... returning...
Optimization Iteration: 60
Running with params: {'n': 200}
Optimization Iteration: 61
Running with params: {'n': 300}
Optimization Iteration: 62
Running with params: {'n': 1600}
Higher iteration... returning...
Optimization Iteration: 63
Running with params: {'n': 100}
Optimization Iteration: 64
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 65
Running with params: {'n': 700}
Higher iteration... returning...
Optimization Iteration: 66
Running with params: {'n': 400}
Optimization Iteration: 67
Running with params: {'n': 400}
Optimization Iteration: 68
Running with params: {'n': 200}
Optimization Iteration: 69
Running with params: {'n': 300}
Optimization Iteration: 70
Running with params: {'n': 200}
Optimization Iteration: 71
Running with params: {'n': 100}
Optimization Iteration: 72
Running with params: {'n': 17100}
Higher iteration... returning...
Optimization Iteration: 73
Running with params: {'n': 700}
Higher iteration... returning...
Optimization Iteration: 74
Running with params: {'n': 1000}
Higher iteration... returning...
Optimization Iteration: 75
Running with params: {'n': 600}
Higher iteration... returning...
Optimization Iteration: 76
Running with params: {'n': 400}
Optimization Iteration: 77
Running with params: {'n': 100}
Optimization Iteration: 78
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 79
Running with params: {'n': 2100}
Higher iteration... returning...
Optimization Iteration: 80
Running with params: {'n': 1400}
Higher iteration... returning...
Optimization Iteration: 81
Running with params: {'n': 300}
Optimization Iteration: 82
Running with params: {'n': 200}
Optimization Iteration: 83
Running with params: {'n': 100}
Optimization Iteration: 84
Running with params: {'n': 800}
Higher iteration... returning...
Optimization Iteration: 85
Running with params: {'n': 300}
Optimization Iteration: 86
Running with params: {'n': 400}
Optimization Iteration: 87
Running with params: {'n': 100}
Optimization Iteration: 88
Running with params: {'n': 200}
Optimization Iteration: 89
Running with params: {'n': 1100}
Higher iteration... returning...
Optimization Iteration: 90
Running with params: {'n': 3000}
Higher iteration... returning...
Optimization Iteration: 91
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 92
Running with params: {'n': 900}
Optimization Iteration: 93
Running with params: {'n': 1700}
Higher iteration... returning...
Optimization Iteration: 94
Running with params: {'n': 700}
Higher iteration... returning...
Optimization Iteration: 95
Running with params: {'n': 3600}
Higher iteration... returning...
Optimization Iteration: 96
Running with params: {'n': 200}
Optimization Iteration: 97
Running with params: {'n': 6800}
Higher iteration... returning...
Optimization Iteration: 98
Running with params: {'n': 100}
Optimization Iteration: 99
Running with params: {'n': 24100}
Higher iteration... returning...
Optimization Iteration: 100
Running with params: {'n': 600}
Higher iteration... returning...
Upto iteration 100: {'n': 400.0}
Breaking...
{'n': 400.0}
Best score: 42.94733333333334
Repeated params: 41
Trials: 101
Best param {'n': 400.0}
Reduction: 39.416652168393135%
Speedup: 1.6506185871066887x
Optimizer time: 2243.360761642456
