Repo: pymc-learn
Filename: /home/jselvam2/projects/research/borntobeflaky/projects/pymc-learn/pmlearn/gaussian_process/tests/test_gpr.py
ClassName: TestStudentsTProcessRegressorScore
Testname: test_score_matches_sklearn_performance
Params: n,238,48,ParamType.ITER,25000
Assertion: npt.assert_almost_equal(sk_gpr_score, advi_stpr_score, 0)
Original runtime: 11369.78
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'n': 25000}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597760059/assert_40370986_25000
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7086.6170833333335, Max: 8293.41, Min: 6615.32
Passed tests : 26
Failed tests : 4
Converged: True
Convergence score: 0.4101351200039506
Evaluating 30 values out of 30
Overall-timings: Avg: 7086.6170833333335, Max: 8293.41, Min: 6615.32
Choosing distribution: expon
Probability of fail (non-zero): 1.0
Exceeding max probability of failure: 1.0
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Something failed
Optimization Iteration: 2
Running with params: {'n': 2200}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597760059/assert_40370986_2200
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 7...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 1577.8093333333334, Max: 2363.51, Min: 1259.73
Passed tests : 22
Failed tests : 8
Converged: True
Convergence score: 0.4249728102173248
Evaluating 30 values out of 30
Overall-timings: Avg: 1577.8093333333334, Max: 2363.51, Min: 1259.73
Choosing distribution: expon
Probability of fail (non-zero): 1.0
Exceeding max probability of failure: 1.0
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
Optimization Iteration: 3
Running with params: {'n': 100}
Logdir: /home/jselvam2/projects/research/borntobeflaky/tool/logs/optim_1597760059_pymc-learn/run_1597760059/assert_40370986_100
Launching 30 jobs, 15 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 7...
Iter 9...
Iter 11...
Iter 10...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Exception>>>
Traceback (most recent call last):
  File "optimizer.py", line 65, in run_optimizer
    result, trialsobj = bayesopt.sample()
  File "/home/jselvam2/projects/research/borntobeflaky/tool/src/strategy/bayesopt.py", line 143, in sample
    verbose=True, timeout=6000)
  File "/home/jselvam2/anaconda3/lib/python3.7/site-packages/hyperopt/fmin.py", line 482, in fmin
    show_progressbar=show_progressbar,
  File "/home/jselvam2/anaconda3/lib/python3.7/site-packages/hyperopt/base.py", line 686, in fmin
    show_progressbar=show_progressbar,
  File "/home/jselvam2/anaconda3/lib/python3.7/site-packages/hyperopt/fmin.py", line 509, in fmin
    rval.exhaust()
  File "/home/jselvam2/anaconda3/lib/python3.7/site-packages/hyperopt/fmin.py", line 330, in exhaust
    self.run(self.max_evals - n_done, block_until_done=self.asynchronous)
  File "/home/jselvam2/anaconda3/lib/python3.7/site-packages/hyperopt/fmin.py", line 286, in run
    self.serial_evaluate()
  File "/home/jselvam2/anaconda3/lib/python3.7/site-packages/hyperopt/fmin.py", line 165, in serial_evaluate
    result = self.domain.evaluate(spec, ctrl)
  File "/home/jselvam2/anaconda3/lib/python3.7/site-packages/hyperopt/base.py", line 894, in evaluate
    rval = self.fn(pyll_rval)
  File "/home/jselvam2/projects/research/borntobeflaky/tool/src/strategy/bayesopt.py", line 66, in compute_score
    output = self.runner.run_with_param(params, self.best_runtime if self.enable_timeout and self.best_runtime < np.inf else None, self.best_runtime)
  File "/home/jselvam2/projects/research/borntobeflaky/tool/src/runner/StocRunner.py", line 123, in run_with_param
    results=self.mp_handler(list(range(next_batch_iterations)))
  File "/home/jselvam2/projects/research/borntobeflaky/tool/src/runner/StocRunner.py", line 83, in mp_handler
    results = p.map(self.run_test_wrapper, data)
  File "/home/jselvam2/anaconda3/lib/python3.7/multiprocessing/pool.py", line 268, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/home/jselvam2/anaconda3/lib/python3.7/multiprocessing/pool.py", line 651, in get
    self.wait(timeout)
  File "/home/jselvam2/anaconda3/lib/python3.7/multiprocessing/pool.py", line 648, in wait
    self._event.wait(timeout)
  File "/home/jselvam2/anaconda3/lib/python3.7/threading.py", line 552, in wait
    signaled = self._cond.wait(timeout)
  File "/home/jselvam2/anaconda3/lib/python3.7/threading.py", line 296, in wait
    waiter.acquire()
KeyboardInterrupt

Optimizer time: 25775.275404691696
