Repo: pymc3
Filename: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/projects/pymc3/pymc3/tests/test_variational_inference.py
ClassName: none
Testname: test_fit_oo[ASVGD-full]
Params: samples,708,47,ParamType.ITER,10000
lr,687,58,ParamType.LR,0.07
Assertion: np.testing.assert_allclose(np.mean(trace['mu']), mu_post, rtol=0.05)
Original runtime: 32.278999999999996
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'samples': 10000, 'lr': 0.07}
Logdir: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/logs/optim_1597945912_pymc3/run_1597993582/assert_1308529_10000_0.07
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 33.374, Max: 36.269999999999996, Min: 32.54
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
updating...
Evaluating 30 values out of 30
Overall-timings: Avg: 33.374, Max: 36.269999999999996, Min: 32.54
Variance (7.703719777548943e-34) too small, using delta distribution
Variance (7.703719777548943e-34) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 33.374
Score: 33.374
Best-score: 33.374
Best-param: {'samples': 10000, 'lr': 0.07}
>>Setting original runtime to 33.374
Optimization Iteration: 1
Running with params: {'lr': 0.004358124497711255, 'samples': 2200}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.004358124497711255
Optimization Iteration: 2
Running with params: {'lr': 0.0032403055232162483, 'samples': 4800}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0032403055232162483
Optimization Iteration: 3
Running with params: {'lr': 0.10391877273428082, 'samples': 100}
Logdir: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/logs/optim_1597945912_pymc3/run_1597993582/assert_1308529_0.10391877273428082_100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 32.656666666666666, Max: 33.11, Min: 31.35
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 33.374
Best-param: {'samples': 10000, 'lr': 0.07}
Optimization Iteration: 4
Running with params: {'lr': 0.11758885211216412, 'samples': 6100}
Logdir: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/logs/optim_1597945912_pymc3/run_1597993582/assert_1308529_0.11758885211216412_6100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 21...
Iter 19...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 33.221333333333334, Max: 34.800000000000004, Min: 31.68
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 33.374
Best-param: {'samples': 10000, 'lr': 0.07}
Optimization Iteration: 5
Running with params: {'lr': 0.0009366549066072615, 'samples': 100}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0009366549066072615
Optimization Iteration: 6
Running with params: {'lr': 0.05435284958893562, 'samples': 4100}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.05435284958893562
Optimization Iteration: 7
Running with params: {'lr': 0.0001176904449828359, 'samples': 200}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0001176904449828359
Optimization Iteration: 8
Running with params: {'lr': 0.00030913456380696766, 'samples': 1700}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.00030913456380696766
Optimization Iteration: 9
Running with params: {'lr': 0.004441759584115115, 'samples': 3900}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.004441759584115115
Optimization Iteration: 10
Running with params: {'lr': 0.00017423794602156248, 'samples': 4100}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.00017423794602156248
Optimization Iteration: 11
Running with params: {'lr': 0.0007482764786426212, 'samples': 100}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0007482764786426212
Optimization Iteration: 12
Running with params: {'lr': 0.055664045990347515, 'samples': 400}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.055664045990347515
Optimization Iteration: 13
Running with params: {'lr': 0.0006848719224113116, 'samples': 700}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0006848719224113116
Optimization Iteration: 14
Running with params: {'lr': 0.00851080073138396, 'samples': 4200}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.00851080073138396
Optimization Iteration: 15
Running with params: {'lr': 0.00044005666857967104, 'samples': 4600}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.00044005666857967104
Optimization Iteration: 16
Running with params: {'lr': 0.08830875955872032, 'samples': 1500}
Logdir: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/logs/optim_1597945912_pymc3/run_1597993582/assert_1308529_0.08830875955872032_1500
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 33.60633333333333, Max: 35.28, Min: 32.82
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 33.374
Best-param: {'samples': 10000, 'lr': 0.07}
Optimization Iteration: 17
Running with params: {'lr': 0.002258008081805187, 'samples': 1900}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.002258008081805187
Optimization Iteration: 18
Running with params: {'lr': 0.012836967661965694, 'samples': 300}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.012836967661965694
Optimization Iteration: 19
Running with params: {'lr': 0.041870065719776965, 'samples': 8100}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.041870065719776965
Optimization Iteration: 20
Running with params: {'lr': 0.00016803170958520867, 'samples': 1000}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.00016803170958520867
Optimization Iteration: 21
Running with params: {'lr': 0.012919521151458781, 'samples': 400}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.012919521151458781
Optimization Iteration: 22
Running with params: {'lr': 0.026773548361930938, 'samples': 9700}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.026773548361930938
Optimization Iteration: 23
Running with params: {'lr': 0.3394441960383787, 'samples': 1100}
Logdir: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/logs/optim_1597945912_pymc3/run_1597993582/assert_1308529_0.3394441960383787_1100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 33.82899999999999, Max: 37.379999999999995, Min: 32.18
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 33.374
Best-param: {'samples': 10000, 'lr': 0.07}
Optimization Iteration: 24
Running with params: {'lr': 0.018410743913583282, 'samples': 500}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.018410743913583282
Optimization Iteration: 25
Running with params: {'lr': 0.2772391718082646, 'samples': 9900}
Logdir: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/logs/optim_1597945912_pymc3/run_1597993582/assert_1308529_0.2772391718082646_9900
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 34.599666666666664, Max: 37.13, Min: 32.35
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 33.374
Best-param: {'samples': 10000, 'lr': 0.07}
Optimization Iteration: 26
Running with params: {'lr': 0.48253729484420416, 'samples': 2600}
Logdir: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/logs/optim_1597945912_pymc3/run_1597993582/assert_1308529_0.48253729484420416_2600
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 33.946333333333335, Max: 35.59, Min: 32.97
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 33.374
Best-param: {'samples': 10000, 'lr': 0.07}
Optimization Iteration: 27
Running with params: {'lr': 0.0017832015298924096, 'samples': 700}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0017832015298924096
Optimization Iteration: 28
Running with params: {'lr': 0.006880707710518264, 'samples': 2700}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.006880707710518264
Optimization Iteration: 29
Running with params: {'lr': 0.0027930068868067034, 'samples': 2900}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0027930068868067034
Optimization Iteration: 30
Running with params: {'lr': 0.0013937930398975884, 'samples': 800}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0013937930398975884
Optimization Iteration: 31
Running with params: {'lr': 0.008649014892083638, 'samples': 2700}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.008649014892083638
Optimization Iteration: 32
Running with params: {'lr': 0.003323626501942466, 'samples': 6500}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.003323626501942466
Optimization Iteration: 33
Running with params: {'lr': 0.001747334577673921, 'samples': 200}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.001747334577673921
Optimization Iteration: 34
Running with params: {'lr': 0.005704213972904718, 'samples': 2100}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.005704213972904718
Optimization Iteration: 35
Running with params: {'lr': 0.0038470135461897313, 'samples': 6400}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0038470135461897313
Optimization Iteration: 36
Running with params: {'lr': 0.00010767487106354307, 'samples': 1300}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.00010767487106354307
Optimization Iteration: 37
Running with params: {'lr': 0.01892220416867513, 'samples': 200}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.01892220416867513
Optimization Iteration: 38
Running with params: {'lr': 0.10512415756220746, 'samples': 300}
Logdir: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/logs/optim_1597945912_pymc3/run_1597993582/assert_1308529_0.10512415756220746_300
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 34.162666666666674, Max: 36.57, Min: 32.5
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 33.374
Best-param: {'samples': 10000, 'lr': 0.07}
Optimization Iteration: 39
Running with params: {'lr': 0.024199128305780686, 'samples': 9900}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.024199128305780686
Optimization Iteration: 40
Running with params: {'lr': 0.03208195804582338, 'samples': 5500}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.03208195804582338
Optimization Iteration: 41
Running with params: {'lr': 0.3007259757913733, 'samples': 1100}
Logdir: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/logs/optim_1597945912_pymc3/run_1597993582/assert_1308529_0.3007259757913733_1100
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 34.802666666666674, Max: 37.230000000000004, Min: 33.57
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 33.374
Best-param: {'samples': 10000, 'lr': 0.07}
Optimization Iteration: 42
Running with params: {'lr': 0.0012025003699277167, 'samples': 3200}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0012025003699277167
Optimization Iteration: 43
Running with params: {'lr': 0.17310442979041302, 'samples': 500}
Logdir: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/logs/optim_1597945912_pymc3/run_1597993582/assert_1308529_0.17310442979041302_500
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 34.23433333333333, Max: 35.33, Min: 32.81
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 33.374
Best-param: {'samples': 10000, 'lr': 0.07}
Optimization Iteration: 44
Running with params: {'lr': 0.015432756536558064, 'samples': 500}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.015432756536558064
Optimization Iteration: 45
Running with params: {'lr': 0.17337690220224822, 'samples': 7600}
Logdir: /mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/logs/optim_1597945912_pymc3/run_1597993582/assert_1308529_0.17337690220224822_7600
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 35.24733333333334, Max: 37.62, Min: 33.82
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 33.374
Best-param: {'samples': 10000, 'lr': 0.07}
Optimization Iteration: 46
Running with params: {'lr': 0.0005286028054422103, 'samples': 2100}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0005286028054422103
Optimization Iteration: 47
Running with params: {'lr': 0.00512980315390908, 'samples': 5200}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.00512980315390908
Optimization Iteration: 48
Running with params: {'lr': 0.000453441012017024, 'samples': 3500}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.000453441012017024
Optimization Iteration: 49
Running with params: {'lr': 0.00028273983246261176, 'samples': 700}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.00028273983246261176
Optimization Iteration: 50
Running with params: {'lr': 0.0009416939224695914, 'samples': 100}
Lower learning rate.. returning... Best: 0.07, Proposed: 0.0009416939224695914
Exception>>>
Traceback (most recent call last):
  File "optimizer.py", line 65, in run_optimizer
    result, trialsobj = bayesopt.sample()
  File "/mnt/batch/tasks/workitems/optpymc3seed/job-1/Task_pymc3/wd/borntobeflaky/tool/src/strategy/bayesopt.py", line 161, in sample
    verbose=True, timeout=6000)
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 482, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 686, in fmin
    show_progressbar=show_progressbar,
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/fmin.py", line 516, in fmin
    return trials.argmin
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 622, in argmin
    best_trial = self.best_trial
  File "/usr/local/lib/python3.6/dist-packages/hyperopt/base.py", line 613, in best_trial
    raise AllTrialsFailed
hyperopt.exceptions.AllTrialsFailed

Optimizer time: 3707.2159094810486
