Repo: pymc-learn
Filename: /mnt/batch/tasks/workitems/optpymclearn/job-1/Task_pymc-learn/wd/borntobeflaky/projects/pymc-learn/pmlearn/gaussian_process/tests/test_gpr.py
ClassName: TestGaussianProcessRegressorPredict
Testname: test_predict_returns_predictions
Params: n,91,47,ParamType.ITER,25000
Assertion: npt.assert_equal(self.y_test.shape, preds.shape)
Original runtime: 168.757
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'n': 25000}
Logdir: /mnt/batch/tasks/workitems/optpymclearn/job-1/Task_pymc-learn/wd/borntobeflaky/tool/logs/optim_1598428115_pymc-learn/run_1598428115/assert_54702668_25000
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 136.85399999999998, Max: 190.12, Min: 109.81
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 136.85399999999998, Max: 190.12, Min: 109.81
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 136.85399999999998
Score: 136.85399999999998
Best-score: 136.85399999999998
Best-param: {'n': 25000}
>>Setting original runtime to 136.85399999999998
Optimization Iteration: 1
Running with params: {'n': 11300}
Logdir: /mnt/batch/tasks/workitems/optpymclearn/job-1/Task_pymc-learn/wd/borntobeflaky/tool/logs/optim_1598428115_pymc-learn/run_1598428115/assert_54702668_11300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 74.102, Max: 94.69, Min: 61.4
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 74.102, Max: 94.69, Min: 61.4
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 74.102
Score: 74.102
Best-score: 74.102
Best-param: {'n': 11300}
Optimization Iteration: 2
Running with params: {'n': 4900}
Logdir: /mnt/batch/tasks/workitems/optpymclearn/job-1/Task_pymc-learn/wd/borntobeflaky/tool/logs/optim_1598428115_pymc-learn/run_1598428115/assert_54702668_4900
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 43.12400000000001, Max: 47.94, Min: 40.54
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 43.12400000000001, Max: 47.94, Min: 40.54
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 43.12400000000001
Score: 43.12400000000001
Best-score: 43.12400000000001
Best-param: {'n': 4900}
Optimization Iteration: 3
Running with params: {'n': 3800}
Logdir: /mnt/batch/tasks/workitems/optpymclearn/job-1/Task_pymc-learn/wd/borntobeflaky/tool/logs/optim_1598428115_pymc-learn/run_1598428115/assert_54702668_3800
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 29...
Iter 26...
Iter 27...
Iter 28...
Timings: Avg: 41.97533333333333, Max: 54.66, Min: 36.599999999999994
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 41.97533333333333, Max: 54.66, Min: 36.599999999999994
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 41.97533333333333
Score: 41.97533333333333
Best-score: 41.97533333333333
Best-param: {'n': 3800}
Optimization Iteration: 4
Running with params: {'n': 14200}
Higher iteration... returning...
Optimization Iteration: 5
Running with params: {'n': 1400}
Logdir: /mnt/batch/tasks/workitems/optpymclearn/job-1/Task_pymc-learn/wd/borntobeflaky/tool/logs/optim_1598428115_pymc-learn/run_1598428115/assert_54702668_1400
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 31.50633333333333, Max: 36.15, Min: 29.29
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 31.50633333333333, Max: 36.15, Min: 29.29
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 31.50633333333333
Score: 31.50633333333333
Best-score: 31.50633333333333
Best-param: {'n': 1400}
Optimization Iteration: 6
Running with params: {'n': 16700}
Higher iteration... returning...
Optimization Iteration: 7
Running with params: {'n': 5600}
Higher iteration... returning...
Optimization Iteration: 8
Running with params: {'n': 300}
Logdir: /mnt/batch/tasks/workitems/optpymclearn/job-1/Task_pymc-learn/wd/borntobeflaky/tool/logs/optim_1598428115_pymc-learn/run_1598428115/assert_54702668_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 9...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 27.412333333333333, Max: 29.91, Min: 25.36
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 27.412333333333333, Max: 29.91, Min: 25.36
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 27.412333333333333
Score: 27.412333333333333
Best-score: 27.412333333333333
Best-param: {'n': 300}
Optimization Iteration: 9
Running with params: {'n': 24100}
Higher iteration... returning...
Optimization Iteration: 10
Running with params: {'n': 2700}
Higher iteration... returning...
Optimization Iteration: 11
Running with params: {'n': 20800}
Higher iteration... returning...
Optimization Iteration: 12
Running with params: {'n': 200}
Logdir: /mnt/batch/tasks/workitems/optpymclearn/job-1/Task_pymc-learn/wd/borntobeflaky/tool/logs/optim_1598428115_pymc-learn/run_1598428115/assert_54702668_200
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 26.923, Max: 30.13, Min: 25.33
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 26.923, Max: 30.13, Min: 25.33
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 26.923
Score: 26.923
Best-score: 26.923
Best-param: {'n': 200}
Optimization Iteration: 13
Running with params: {'n': 4100}
Higher iteration... returning...
Optimization Iteration: 14
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 15
Running with params: {'n': 1500}
Higher iteration... returning...
Optimization Iteration: 16
Running with params: {'n': 100}
Logdir: /mnt/batch/tasks/workitems/optpymclearn/job-1/Task_pymc-learn/wd/borntobeflaky/tool/logs/optim_1598428115_pymc-learn/run_1598428115/assert_54702668_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 27.380999999999993, Max: 30.56, Min: 25.41
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 27.380999999999993, Max: 30.56, Min: 25.41
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 27.380999999999993
Score: 27.380999999999993
Best-score: 26.923
Best-param: {'n': 200}
Optimization Iteration: 17
Running with params: {'n': 1800}
Higher iteration... returning...
Optimization Iteration: 18
Running with params: {'n': 100}
Optimization Iteration: 19
Running with params: {'n': 9900}
Higher iteration... returning...
Optimization Iteration: 20
Running with params: {'n': 2100}
Higher iteration... returning...
Optimization Iteration: 21
Running with params: {'n': 100}
Optimization Iteration: 22
Running with params: {'n': 200}
Optimization Iteration: 23
Running with params: {'n': 300}
Optimization Iteration: 24
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 25
Running with params: {'n': 700}
Higher iteration... returning...
Optimization Iteration: 26
Running with params: {'n': 200}
Optimization Iteration: 27
Running with params: {'n': 900}
Higher iteration... returning...
Optimization Iteration: 28
Running with params: {'n': 200}
Optimization Iteration: 29
Running with params: {'n': 200}
Optimization Iteration: 30
Running with params: {'n': 900}
Higher iteration... returning...
Optimization Iteration: 31
Running with params: {'n': 100}
Optimization Iteration: 32
Running with params: {'n': 200}
Optimization Iteration: 33
Running with params: {'n': 600}
Higher iteration... returning...
Optimization Iteration: 34
Running with params: {'n': 300}
Optimization Iteration: 35
Running with params: {'n': 1000}
Higher iteration... returning...
Optimization Iteration: 36
Running with params: {'n': 100}
Optimization Iteration: 37
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 38
Running with params: {'n': 200}
Optimization Iteration: 39
Running with params: {'n': 1200}
Higher iteration... returning...
Optimization Iteration: 40
Running with params: {'n': 100}
Optimization Iteration: 41
Running with params: {'n': 5800}
Higher iteration... returning...
Optimization Iteration: 42
Running with params: {'n': 7400}
Higher iteration... returning...
Optimization Iteration: 43
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 44
Running with params: {'n': 3100}
Higher iteration... returning...
Optimization Iteration: 45
Running with params: {'n': 700}
Higher iteration... returning...
Optimization Iteration: 46
Running with params: {'n': 300}
Optimization Iteration: 47
Running with params: {'n': 100}
Optimization Iteration: 48
Running with params: {'n': 200}
Optimization Iteration: 49
Running with params: {'n': 2000}
Higher iteration... returning...
Optimization Iteration: 50
Running with params: {'n': 500}
Higher iteration... returning...
Upto iteration 50: {'n': 200.0}
Optimization Iteration: 51
Running with params: {'n': 100}
Optimization Iteration: 52
Running with params: {'n': 1300}
Higher iteration... returning...
Optimization Iteration: 53
Running with params: {'n': 14000}
Higher iteration... returning...
Optimization Iteration: 54
Running with params: {'n': 2800}
Higher iteration... returning...
Optimization Iteration: 55
Running with params: {'n': 100}
Optimization Iteration: 56
Running with params: {'n': 300}
Optimization Iteration: 57
Running with params: {'n': 200}
Optimization Iteration: 58
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 59
Running with params: {'n': 4200}
Higher iteration... returning...
Optimization Iteration: 60
Running with params: {'n': 700}
Higher iteration... returning...
Optimization Iteration: 61
Running with params: {'n': 1600}
Higher iteration... returning...
Optimization Iteration: 62
Running with params: {'n': 100}
Optimization Iteration: 63
Running with params: {'n': 300}
Optimization Iteration: 64
Running with params: {'n': 24200}
Higher iteration... returning...
Optimization Iteration: 65
Running with params: {'n': 200}
Optimization Iteration: 66
Running with params: {'n': 200}
Optimization Iteration: 67
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 68
Running with params: {'n': 100}
Optimization Iteration: 69
Running with params: {'n': 100}
Optimization Iteration: 70
Running with params: {'n': 200}
Optimization Iteration: 71
Running with params: {'n': 1000}
Higher iteration... returning...
Optimization Iteration: 72
Running with params: {'n': 300}
Optimization Iteration: 73
Running with params: {'n': 200}
Optimization Iteration: 74
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 75
Running with params: {'n': 600}
Higher iteration... returning...
Optimization Iteration: 76
Running with params: {'n': 100}
Optimization Iteration: 77
Running with params: {'n': 100}
Optimization Iteration: 78
Running with params: {'n': 200}
Optimization Iteration: 79
Running with params: {'n': 800}
Higher iteration... returning...
Optimization Iteration: 80
Running with params: {'n': 100}
Optimization Iteration: 81
Running with params: {'n': 600}
Higher iteration... returning...
Optimization Iteration: 82
Running with params: {'n': 200}
Optimization Iteration: 83
Running with params: {'n': 300}
Optimization Iteration: 84
Running with params: {'n': 400}
Higher iteration... returning...
Optimization Iteration: 85
Running with params: {'n': 100}
Optimization Iteration: 86
Running with params: {'n': 1200}
Higher iteration... returning...
Optimization Iteration: 87
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 88
Running with params: {'n': 9600}
Higher iteration... returning...
Optimization Iteration: 89
Running with params: {'n': 300}
Optimization Iteration: 90
Running with params: {'n': 100}
Optimization Iteration: 91
Running with params: {'n': 2300}
Higher iteration... returning...
Optimization Iteration: 92
Running with params: {'n': 200}
Optimization Iteration: 93
Running with params: {'n': 100}
Optimization Iteration: 94
Running with params: {'n': 200}
Optimization Iteration: 95
Running with params: {'n': 800}
Higher iteration... returning...
Optimization Iteration: 96
Running with params: {'n': 19500}
Higher iteration... returning...
Optimization Iteration: 97
Running with params: {'n': 500}
Higher iteration... returning...
Optimization Iteration: 98
Running with params: {'n': 100}
Optimization Iteration: 99
Running with params: {'n': 3300}
Higher iteration... returning...
Optimization Iteration: 100
Running with params: {'n': 300}
Upto iteration 100: {'n': 200.0}
Breaking...
{'n': 200.0}
Best score: 26.923
Repeated params: 43
Trials: 101
Best param {'n': 200.0}
Reduction: 80.32721001943678%
Speedup: 5.083163094751699x
Optimizer time: 3257.9064605236053
