Repo: magenta
Filename: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/projects/magenta/magenta/contrib/rnn_test.py
ClassName: StackBidirectionalRNNTest
Testname: testBidirectionalRNN
Params: input_size,272,17,ParamType.CHAINS,5
Assertion: self.assertAllEqual(st_5_bw[0], st_5p_bw[0])
Original runtime: 14.779
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'input_size': 5}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771938/assert_45032446_5
Launching 30 jobs, 30 in parallel
Iter 4...
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 8...
Iter 5...
Iter 6...
Iter 7...
Iter 10...
Iter 9...
Iter 15...
Iter 16...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 17...
Iter 18...
Iter 19...
Iter 25...
Iter 20...
Iter 26...
Iter 27...
Iter 22...
Iter 23...
Iter 21...
Iter 24...
Iter 28...
Iter 29...
Timings: Avg: 15.233333333333333, Max: 15.360000000000001, Min: 14.98
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 15.233333333333333, Max: 15.360000000000001, Min: 14.98
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 15.233333333333333
Score: 15.233333333333333
Best-score: 15.233333333333333
Best-param: {'input_size': 5}
>>Setting original runtime to 15.233333333333333
Optimization Iteration: 1
Running with params: {'input_size': 5}
Optimization Iteration: 2
Running with params: {'input_size': None}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771938/assert_45032446_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Iter 25...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 6.927000000000001, Max: 7.02, Min: 6.61
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 15.233333333333333
Best-param: {'input_size': 5}
Optimization Iteration: 3
Running with params: {'input_size': None}
Optimization Iteration: 4
Running with params: {'input_size': 1}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771938/assert_45032446_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 15.206333333333335, Max: 15.31, Min: 14.81
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 15.206333333333335, Max: 15.31, Min: 14.81
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 15.206333333333335
Score: 15.206333333333335
Best-score: 15.206333333333335
Best-param: {'input_size': 1}
Optimization Iteration: 5
Running with params: {'input_size': 1}
Optimization Iteration: 6
Running with params: {'input_size': 2}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771938/assert_45032446_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 14...
Iter 13...
Iter 16...
Iter 15...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 15.168000000000001, Max: 15.309999999999999, Min: 14.870000000000001
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 15.168000000000001, Max: 15.309999999999999, Min: 14.870000000000001
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 15.168000000000001
Score: 15.168000000000001
Best-score: 15.168000000000001
Best-param: {'input_size': 2}
Optimization Iteration: 7
Running with params: {'input_size': 1}
Optimization Iteration: 8
Running with params: {'input_size': None}
Optimization Iteration: 9
Running with params: {'input_size': 3}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771938/assert_45032446_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 15.212, Max: 15.33, Min: 14.92
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 15.212, Max: 15.33, Min: 14.92
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 15.212
Score: 15.212
Best-score: 15.168000000000001
Best-param: {'input_size': 2}
Optimization Iteration: 10
Running with params: {'input_size': None}
Optimization Iteration: 11
Running with params: {'input_size': 3}
Optimization Iteration: 12
Running with params: {'input_size': 3}
Optimization Iteration: 13
Running with params: {'input_size': None}
Optimization Iteration: 14
Running with params: {'input_size': 3}
Optimization Iteration: 15
Running with params: {'input_size': 5}
Optimization Iteration: 16
Running with params: {'input_size': 4}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_magenta/wd/borntobeflaky/tool/logs/optim_1597771549_magenta/run_1597771938/assert_45032446_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 15.170666666666667, Max: 15.299999999999999, Min: 14.93
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 15.170666666666667, Max: 15.299999999999999, Min: 14.93
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 15.170666666666667
Score: 15.170666666666667
Best-score: 15.168000000000001
Best-param: {'input_size': 2}
Optimization Iteration: 17
Running with params: {'input_size': 3}
Optimization Iteration: 18
Running with params: {'input_size': 1}
Optimization Iteration: 19
Running with params: {'input_size': 4}
Optimization Iteration: 20
Running with params: {'input_size': 5}
Optimization Iteration: 21
Running with params: {'input_size': 2}
Optimization Iteration: 22
Running with params: {'input_size': 2}
Optimization Iteration: 23
Running with params: {'input_size': 2}
Optimization Iteration: 24
Running with params: {'input_size': 2}
Optimization Iteration: 25
Running with params: {'input_size': 2}
Optimization Iteration: 26
Running with params: {'input_size': 2}
Optimization Iteration: 27
Running with params: {'input_size': 2}
Optimization Iteration: 28
Running with params: {'input_size': 2}
Optimization Iteration: 29
Running with params: {'input_size': 2}
Optimization Iteration: 30
Running with params: {'input_size': 4}
Optimization Iteration: 31
Running with params: {'input_size': 2}
Optimization Iteration: 32
Running with params: {'input_size': 5}
Optimization Iteration: 33
Running with params: {'input_size': 2}
Optimization Iteration: 34
Running with params: {'input_size': 2}
Optimization Iteration: 35
Running with params: {'input_size': 2}
Optimization Iteration: 36
Running with params: {'input_size': 1}
Optimization Iteration: 37
Running with params: {'input_size': 4}
Optimization Iteration: 38
Running with params: {'input_size': 5}
Optimization Iteration: 39
Running with params: {'input_size': None}
Optimization Iteration: 40
Running with params: {'input_size': 2}
Optimization Iteration: 41
Running with params: {'input_size': 2}
Optimization Iteration: 42
Running with params: {'input_size': 1}
Optimization Iteration: 43
Running with params: {'input_size': None}
Optimization Iteration: 44
Running with params: {'input_size': 2}
Optimization Iteration: 45
Running with params: {'input_size': 3}
Optimization Iteration: 46
Running with params: {'input_size': 1}
Optimization Iteration: 47
Running with params: {'input_size': None}
Optimization Iteration: 48
Running with params: {'input_size': 4}
Optimization Iteration: 49
Running with params: {'input_size': 3}
Optimization Iteration: 50
Running with params: {'input_size': 5}
Upto iteration 50: {'input_size': 1}
Optimization Iteration: 51
Running with params: {'input_size': 2}
Optimization Iteration: 52
Running with params: {'input_size': 2}
Optimization Iteration: 53
Running with params: {'input_size': 1}
Optimization Iteration: 54
Running with params: {'input_size': None}
Optimization Iteration: 55
Running with params: {'input_size': 4}
Optimization Iteration: 56
Running with params: {'input_size': 3}
Optimization Iteration: 57
Running with params: {'input_size': 5}
Optimization Iteration: 58
Running with params: {'input_size': 2}
Optimization Iteration: 59
Running with params: {'input_size': 2}
Optimization Iteration: 60
Running with params: {'input_size': 2}
Optimization Iteration: 61
Running with params: {'input_size': 3}
Optimization Iteration: 62
Running with params: {'input_size': 2}
Optimization Iteration: 63
Running with params: {'input_size': 4}
Optimization Iteration: 64
Running with params: {'input_size': 5}
Optimization Iteration: 65
Running with params: {'input_size': 1}
Optimization Iteration: 66
Running with params: {'input_size': 2}
Optimization Iteration: 67
Running with params: {'input_size': 2}
Optimization Iteration: 68
Running with params: {'input_size': 2}
Optimization Iteration: 69
Running with params: {'input_size': 2}
Optimization Iteration: 70
Running with params: {'input_size': 2}
Optimization Iteration: 71
Running with params: {'input_size': 2}
Optimization Iteration: 72
Running with params: {'input_size': 2}
Optimization Iteration: 73
Running with params: {'input_size': None}
Optimization Iteration: 74
Running with params: {'input_size': 2}
Optimization Iteration: 75
Running with params: {'input_size': 2}
Optimization Iteration: 76
Running with params: {'input_size': 2}
Optimization Iteration: 77
Running with params: {'input_size': 4}
Optimization Iteration: 78
Running with params: {'input_size': 5}
Optimization Iteration: 79
Running with params: {'input_size': 1}
Optimization Iteration: 80
Running with params: {'input_size': 3}
Optimization Iteration: 81
Running with params: {'input_size': None}
Optimization Iteration: 82
Running with params: {'input_size': 2}
Optimization Iteration: 83
Running with params: {'input_size': 2}
Optimization Iteration: 84
Running with params: {'input_size': 2}
Optimization Iteration: 85
Running with params: {'input_size': 2}
Optimization Iteration: 86
Running with params: {'input_size': 4}
Optimization Iteration: 87
Running with params: {'input_size': 1}
Optimization Iteration: 88
Running with params: {'input_size': 3}
Optimization Iteration: 89
Running with params: {'input_size': 5}
Optimization Iteration: 90
Running with params: {'input_size': None}
Optimization Iteration: 91
Running with params: {'input_size': 2}
Optimization Iteration: 92
Running with params: {'input_size': 2}
Optimization Iteration: 93
Running with params: {'input_size': 2}
Optimization Iteration: 94
Running with params: {'input_size': 2}
Optimization Iteration: 95
Running with params: {'input_size': 4}
Optimization Iteration: 96
Running with params: {'input_size': 1}
Optimization Iteration: 97
Running with params: {'input_size': 3}
Optimization Iteration: 98
Running with params: {'input_size': 5}
Optimization Iteration: 99
Running with params: {'input_size': None}
Optimization Iteration: 100
Running with params: {'input_size': 2}
Upto iteration 100: {'input_size': 1}
Breaking...
{'input_size': 1}
Best score: 15.168000000000001
Repeated params: 95
Trials: 101
Best param {'input_size': 1}
Reduction: 0.42888402625819344%
Speedup: 1.0043073136427565x
Optimizer time: 85.37546730041504
