Repo: autokeras
Filename: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/projects/autokeras/tests/integration_tests/task_api_test.py
ClassName: none
Testname: test_structured_data_from_numpy_regressor
Params: num_epochs,57,37,ParamType.CHAINS,11
Assertion: assert clf.predict(x_test).shape == (len(y_test), 1)
Original runtime: 18.355999999999998
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'num_epochs': 11}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/tool/logs/optim_1597614558_autokeras/run_1597614558/assert_77613208_11
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 18.711000000000002, Max: 18.9, Min: 18.32
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 18.711000000000002, Max: 18.9, Min: 18.32
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 18.711000000000002
Score: 18.711000000000002
Best-score: 18.711000000000002
Best-param: {'num_epochs': 11}
>>Setting original runtime to 18.711000000000002
Optimization Iteration: 1
Running with params: {'num_epochs': 9}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/tool/logs/optim_1597614558_autokeras/run_1597614558/assert_77613208_9
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 18.251666666666665, Max: 18.43, Min: 17.9
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 18.251666666666665, Max: 18.43, Min: 17.9
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 18.251666666666665
Score: 18.251666666666665
Best-score: 18.251666666666665
Best-param: {'num_epochs': 9}
Optimization Iteration: 2
Running with params: {'num_epochs': 10}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/tool/logs/optim_1597614558_autokeras/run_1597614558/assert_77613208_10
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 17.592666666666666, Max: 18.1, Min: 16.540000000000003
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 17.592666666666666, Max: 18.1, Min: 16.540000000000003
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 17.592666666666666
Score: 17.592666666666666
Best-score: 17.592666666666666
Best-param: {'num_epochs': 10}
Optimization Iteration: 3
Running with params: {'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/tool/logs/optim_1597614558_autokeras/run_1597614558/assert_77613208_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 16.865666666666666, Max: 17.06, Min: 16.41
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 16.865666666666666, Max: 17.06, Min: 16.41
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 16.865666666666666
Score: 16.865666666666666
Best-score: 16.865666666666666
Best-param: {'num_epochs': 4}
Optimization Iteration: 4
Running with params: {'num_epochs': 6}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/tool/logs/optim_1597614558_autokeras/run_1597614558/assert_77613208_6
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 17.457666666666668, Max: 17.62, Min: 17.130000000000003
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 17.457666666666668, Max: 17.62, Min: 17.130000000000003
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 17.457666666666668
Score: 17.457666666666668
Best-score: 16.865666666666666
Best-param: {'num_epochs': 4}
Optimization Iteration: 5
Running with params: {'num_epochs': 9}
Optimization Iteration: 6
Running with params: {'num_epochs': 9}
Optimization Iteration: 7
Running with params: {'num_epochs': 8}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/tool/logs/optim_1597614558_autokeras/run_1597614558/assert_77613208_8
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 17.998333333333335, Max: 18.209999999999997, Min: 17.32
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 17.998333333333335, Max: 18.209999999999997, Min: 17.32
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 17.998333333333335
Score: 17.998333333333335
Best-score: 16.865666666666666
Best-param: {'num_epochs': 4}
Optimization Iteration: 8
Running with params: {'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/tool/logs/optim_1597614558_autokeras/run_1597614558/assert_77613208_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 16.62666666666667, Max: 16.82, Min: 16.39
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 16.62666666666667, Max: 16.82, Min: 16.39
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 16.62666666666667
Score: 16.62666666666667
Best-score: 16.62666666666667
Best-param: {'num_epochs': 3}
Optimization Iteration: 9
Running with params: {'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/tool/logs/optim_1597614558_autokeras/run_1597614558/assert_77613208_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 16.09333333333333, Max: 16.23, Min: 15.85
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 16.09333333333333, Max: 16.23, Min: 15.85
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 16.09333333333333
Score: 16.09333333333333
Best-score: 16.09333333333333
Best-param: {'num_epochs': 2}
Optimization Iteration: 10
Running with params: {'num_epochs': 10}
Optimization Iteration: 11
Running with params: {'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/tool/logs/optim_1597614558_autokeras/run_1597614558/assert_77613208_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 16.152666666666665, Max: 16.33, Min: 15.67
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 16.152666666666665, Max: 16.33, Min: 15.67
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 16.152666666666665
Score: 16.152666666666665
Best-score: 16.09333333333333
Best-param: {'num_epochs': 2}
Optimization Iteration: 12
Running with params: {'num_epochs': 7}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/tool/logs/optim_1597614558_autokeras/run_1597614558/assert_77613208_7
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 17.66466666666667, Max: 17.91, Min: 17.1
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 17.66466666666667, Max: 17.91, Min: 17.1
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 17.66466666666667
Score: 17.66466666666667
Best-score: 16.09333333333333
Best-param: {'num_epochs': 2}
Optimization Iteration: 13
Running with params: {'num_epochs': 10}
Optimization Iteration: 14
Running with params: {'num_epochs': 7}
Optimization Iteration: 15
Running with params: {'num_epochs': 1}
Optimization Iteration: 16
Running with params: {'num_epochs': 8}
Optimization Iteration: 17
Running with params: {'num_epochs': 7}
Optimization Iteration: 18
Running with params: {'num_epochs': 6}
Optimization Iteration: 19
Running with params: {'num_epochs': 1}
Optimization Iteration: 20
Running with params: {'num_epochs': 7}
Optimization Iteration: 21
Running with params: {'num_epochs': 2}
Optimization Iteration: 22
Running with params: {'num_epochs': 2}
Optimization Iteration: 23
Running with params: {'num_epochs': 2}
Optimization Iteration: 24
Running with params: {'num_epochs': 2}
Optimization Iteration: 25
Running with params: {'num_epochs': 11}
Optimization Iteration: 26
Running with params: {'num_epochs': 5}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_autokeras/wd/borntobeflaky/tool/logs/optim_1597614558_autokeras/run_1597614558/assert_77613208_5
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 17.180333333333333, Max: 17.38, Min: 16.57
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 17.180333333333333, Max: 17.38, Min: 16.57
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 17.180333333333333
Score: 17.180333333333333
Best-score: 16.09333333333333
Best-param: {'num_epochs': 2}
Optimization Iteration: 27
Running with params: {'num_epochs': 2}
Optimization Iteration: 28
Running with params: {'num_epochs': 2}
Optimization Iteration: 29
Running with params: {'num_epochs': 2}
Optimization Iteration: 30
Running with params: {'num_epochs': 5}
Optimization Iteration: 31
Running with params: {'num_epochs': 3}
Optimization Iteration: 32
Running with params: {'num_epochs': 4}
Optimization Iteration: 33
Running with params: {'num_epochs': 11}
Optimization Iteration: 34
Running with params: {'num_epochs': 2}
Optimization Iteration: 35
Running with params: {'num_epochs': 4}
Optimization Iteration: 36
Running with params: {'num_epochs': 6}
Optimization Iteration: 37
Running with params: {'num_epochs': 9}
Optimization Iteration: 38
Running with params: {'num_epochs': 2}
Optimization Iteration: 39
Running with params: {'num_epochs': 8}
Optimization Iteration: 40
Running with params: {'num_epochs': 3}
Optimization Iteration: 41
Running with params: {'num_epochs': 9}
Optimization Iteration: 42
Running with params: {'num_epochs': 10}
Optimization Iteration: 43
Running with params: {'num_epochs': 2}
Optimization Iteration: 44
Running with params: {'num_epochs': 5}
Optimization Iteration: 45
Running with params: {'num_epochs': 11}
Optimization Iteration: 46
Running with params: {'num_epochs': 4}
Optimization Iteration: 47
Running with params: {'num_epochs': 6}
Optimization Iteration: 48
Running with params: {'num_epochs': 8}
Optimization Iteration: 49
Running with params: {'num_epochs': 1}
Optimization Iteration: 50
Running with params: {'num_epochs': 10}
Upto iteration 50: {'num_epochs': 1}
Optimization Iteration: 51
Running with params: {'num_epochs': 2}
Optimization Iteration: 52
Running with params: {'num_epochs': 3}
Optimization Iteration: 53
Running with params: {'num_epochs': 2}
Optimization Iteration: 54
Running with params: {'num_epochs': 7}
Optimization Iteration: 55
Running with params: {'num_epochs': 2}
Optimization Iteration: 56
Running with params: {'num_epochs': 9}
Optimization Iteration: 57
Running with params: {'num_epochs': 1}
Optimization Iteration: 58
Running with params: {'num_epochs': 2}
Optimization Iteration: 59
Running with params: {'num_epochs': 6}
Optimization Iteration: 60
Running with params: {'num_epochs': 5}
Optimization Iteration: 61
Running with params: {'num_epochs': 8}
Optimization Iteration: 62
Running with params: {'num_epochs': 11}
Optimization Iteration: 63
Running with params: {'num_epochs': 10}
Optimization Iteration: 64
Running with params: {'num_epochs': 2}
Optimization Iteration: 65
Running with params: {'num_epochs': 7}
Optimization Iteration: 66
Running with params: {'num_epochs': 2}
Optimization Iteration: 67
Running with params: {'num_epochs': 2}
Optimization Iteration: 68
Running with params: {'num_epochs': 2}
Optimization Iteration: 69
Running with params: {'num_epochs': 2}
Optimization Iteration: 70
Running with params: {'num_epochs': 4}
Optimization Iteration: 71
Running with params: {'num_epochs': 3}
Optimization Iteration: 72
Running with params: {'num_epochs': 2}
Optimization Iteration: 73
Running with params: {'num_epochs': 2}
Optimization Iteration: 74
Running with params: {'num_epochs': 9}
Optimization Iteration: 75
Running with params: {'num_epochs': 2}
Optimization Iteration: 76
Running with params: {'num_epochs': 11}
Optimization Iteration: 77
Running with params: {'num_epochs': 1}
Optimization Iteration: 78
Running with params: {'num_epochs': 5}
Optimization Iteration: 79
Running with params: {'num_epochs': 6}
Optimization Iteration: 80
Running with params: {'num_epochs': 8}
Optimization Iteration: 81
Running with params: {'num_epochs': 2}
Optimization Iteration: 82
Running with params: {'num_epochs': 4}
Optimization Iteration: 83
Running with params: {'num_epochs': 7}
Optimization Iteration: 84
Running with params: {'num_epochs': 2}
Optimization Iteration: 85
Running with params: {'num_epochs': 10}
Optimization Iteration: 86
Running with params: {'num_epochs': 3}
Optimization Iteration: 87
Running with params: {'num_epochs': 2}
Optimization Iteration: 88
Running with params: {'num_epochs': 9}
Optimization Iteration: 89
Running with params: {'num_epochs': 1}
Optimization Iteration: 90
Running with params: {'num_epochs': 2}
Optimization Iteration: 91
Running with params: {'num_epochs': 5}
Optimization Iteration: 92
Running with params: {'num_epochs': 6}
Optimization Iteration: 93
Running with params: {'num_epochs': 11}
Optimization Iteration: 94
Running with params: {'num_epochs': 8}
Optimization Iteration: 95
Running with params: {'num_epochs': 10}
Optimization Iteration: 96
Running with params: {'num_epochs': 2}
Optimization Iteration: 97
Running with params: {'num_epochs': 4}
Optimization Iteration: 98
Running with params: {'num_epochs': 7}
Optimization Iteration: 99
Running with params: {'num_epochs': 2}
Optimization Iteration: 100
Running with params: {'num_epochs': 3}
Upto iteration 100: {'num_epochs': 1}
Breaking...
{'num_epochs': 1}
Best score: 16.09333333333333
Repeated params: 90
Trials: 101
Best param {'num_epochs': 1}
Reduction: 13.989988064062166%
Speedup: 1.1626553438276723x
Optimizer time: 201.00027084350586
