Repo: parlai
Filename: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/projects/parlai/tests/test_tra.py
ClassName: TestMemNN
Testname: test_eval_batch
Params: learning_rate,35,25,ParamType.LR,0.007
num_epochs,38,23,ParamType.CHAINS,4
batchsize,36,22,ParamType.CHAINS,16
Assertion: self.assertGreaterEqual(valid['hits@1'], threshold)
Original runtime: 4.836
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_0.007_4_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 4.2413333333333325, Max: 5.6000000000000005, Min: 3.82
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 3.162277660168381
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 22...
Iter 20...
Iter 24...
Iter 21...
Iter 25...
Iter 23...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 4.154999999999999, Max: 5.6000000000000005, Min: 3.71
Passed tests : 59
Failed tests : 1
Converged: False
Convergence score: 1.276362607036252
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 4.135555555555555, Max: 5.680000000000001, Min: 3.68
Passed tests : 88
Failed tests : 2
Converged: True
Convergence score: 0.8442791535804491
Evaluating 90 values out of 90
Overall-timings: Avg: 4.135555555555555, Max: 5.680000000000001, Min: 3.68
Choosing distribution: dweibull
Probability of fail (non-zero): 0.233154348722686
Exceeding max probability of failure: 0.233154348722686
All-Passed: False
Probabilty of failure: 0.233154348722686
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
>>>!!Warning: Allowing update probability!!<<
Updating probability of failure to: 0.233154348722686
>>Setting original runtime to 4.135555555555555
Optimization Iteration: 1
Running with params: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.8436621460762177_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 26...
Iter 25...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 4.426, Max: 5.510000000000001, Min: 4.25
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.283551238614285
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 4.438999999999999, Max: 5.510000000000001, Min: 4.25
Passed tests : 60
Failed tests : 0
Converged: False
Convergence score: 1.123434597738905
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 4.426555555555555, Max: 5.510000000000001, Min: 4.25
Passed tests : 90
Failed tests : 0
Converged: True
Convergence score: 0.6565945396884517
Evaluating 90 values out of 90
Overall-timings: Avg: 4.426555555555555, Max: 5.510000000000001, Min: 4.25
Choosing distribution: dweibull
Probability of fail (non-zero): 0.027982219872329274
All-Passed: True
Probabilty of failure: 0.027982219872329274
Runtime: 4.426555555555555
Score: 4.426555555555555
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 2
Running with params: {'batchsize': 32, 'learning_rate': 0.0118472179648991, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.0118472179648991_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.892666666666666, Max: 6.130000000000001, Min: 3.5500000000000003
Passed tests : 1
Failed tests : 29
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 3
Running with params: {'batchsize': 32, 'learning_rate': 0.001144164040767951, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.001144164040767951_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 1...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 6.866666666666665, Max: 6.9799999999999995, Min: 6.72
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 4
Running with params: {'batchsize': 128, 'learning_rate': 0.0849053548464557, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_0.0849053548464557_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 9.642999999999999, Max: 9.82, Min: 9.49
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 5
Running with params: {'batchsize': 2, 'learning_rate': 0.10333049240284128, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.10333049240284128_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.583, Max: 5.68, Min: 5.39
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.583 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 6
Running with params: {'batchsize': 8, 'learning_rate': 0.01497644707422796, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_8_0.01497644707422796_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.597, Max: 5.71, Min: 5.45
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.597 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 7
Running with params: {'batchsize': 2, 'learning_rate': 0.0005747982135862241, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.0005747982135862241_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 23...
Iter 22...
Iter 21...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.594333333333333, Max: 5.66, Min: 5.46
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.594333333333333, Max: 5.66, Min: 5.46
Variance (1.1093356479670479e-31) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.594333333333333
Score: 5.594333333333333
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 8
Running with params: {'batchsize': 8, 'learning_rate': 0.006480152887754349, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_8_0.006480152887754349_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 5.569333333333335, Max: 5.65, Min: 5.380000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.6666666666666297
Exceeding current best timeout: 5.569333333333335 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 9
Running with params: {'batchsize': 32, 'learning_rate': 0.00016069254352089757, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.00016069254352089757_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.609333333333335, Max: 5.67, Min: 5.529999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0690449676497034
Exceeding current best timeout: 5.609333333333335 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 10
Running with params: {'batchsize': 2, 'learning_rate': 0.9335625753499666, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.9335625753499666_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 5...
Iter 4...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.586666666666668, Max: 5.779999999999999, Min: 5.43
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.828427124746206
Exceeding current best timeout: 5.586666666666668 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 11
Running with params: {'batchsize': 2, 'learning_rate': 0.002847919073258252, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.002847919073258252_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.6080000000000005, Max: 5.88, Min: 5.41
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.6666666666666674
Exceeding current best timeout: 5.6080000000000005 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 12
Running with params: {'batchsize': 128, 'learning_rate': 0.012973998271963681, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_0.012973998271963681_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.586999999999999, Max: 5.67, Min: 5.44
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.19611613513817533
Evaluating 30 values out of 30
Overall-timings: Avg: 5.586999999999999, Max: 5.67, Min: 5.44
Choosing distribution: logistic
Probability of fail (non-zero): 2.926807680199685e-214
All-Passed: True
Probabilty of failure: 2.926807680199685e-214
Runtime: 5.586999999999999
Score: 5.586999999999999
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 13
Running with params: {'batchsize': 128, 'learning_rate': 0.00212463773372538, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_0.00212463773372538_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 2...
Iter 1...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.625, Max: 5.7, Min: 5.52
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.15075567228886505
Evaluating 30 values out of 30
Overall-timings: Avg: 5.625, Max: 5.7, Min: 5.52
Choosing distribution: gumbel_l
Probability of fail (non-zero): 1.51972486391644e-57
All-Passed: True
Probabilty of failure: 1.51972486391644e-57
Runtime: 5.625
Score: 5.625
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 14
Running with params: {'batchsize': 2, 'learning_rate': 0.01085416323383382, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.01085416323383382_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.631, Max: 5.71, Min: 5.46
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 1.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.631, Max: 5.71, Min: 5.46
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.631
Score: 5.631
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 15
Running with params: {'batchsize': 2, 'learning_rate': 0.08932832052589945, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.08932832052589945_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 5.622666666666666, Max: 5.7, Min: 5.529999999999999
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.7745966692414661
Evaluating 30 values out of 30
Overall-timings: Avg: 5.622666666666666, Max: 5.7, Min: 5.529999999999999
Choosing distribution: logistic
Probability of fail (non-zero): 2.926807680199685e-214
All-Passed: True
Probabilty of failure: 2.926807680199685e-214
Runtime: 5.622666666666666
Score: 5.622666666666666
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 16
Running with params: {'batchsize': 64, 'learning_rate': 0.03097683786404885, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.03097683786404885_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.584666666666666, Max: 5.65, Min: 5.45
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.828427124746206
Exceeding current best timeout: 5.584666666666666 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 17
Running with params: {'batchsize': 16, 'learning_rate': 0.0037246143259707194, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_16_0.0037246143259707194_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.589666666666668, Max: 5.66, Min: 5.44
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0245435281108413
Exceeding current best timeout: 5.589666666666668 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 18
Running with params: {'batchsize': 128, 'learning_rate': 1.7457325468124564e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_1.7457325468124564e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.599000000000001, Max: 5.8100000000000005, Min: 5.4399999999999995
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 3.040470972244056e-14
Evaluating 30 values out of 30
Overall-timings: Avg: 5.599000000000001, Max: 5.8100000000000005, Min: 5.4399999999999995
Choosing distribution: gamma
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.599000000000001
Score: 5.599000000000001
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 19
Running with params: {'batchsize': 32, 'learning_rate': 0.509650711537448, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.509650711537448_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.578666666666669, Max: 5.680000000000001, Min: 5.43
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 1.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.578666666666669, Max: 5.680000000000001, Min: 5.43
Choosing distribution: gumbel_l
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.578666666666669
Score: 5.578666666666669
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 20
Running with params: {'batchsize': 32, 'learning_rate': 0.00030481722679891746, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.00030481722679891746_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.609333333333335, Max: 5.67, Min: 5.4799999999999995
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.49751859510500784
Evaluating 30 values out of 30
Overall-timings: Avg: 5.609333333333335, Max: 5.67, Min: 5.4799999999999995
Choosing distribution: laplace
Probability of fail (non-zero): 1.0384661021935908e-128
All-Passed: True
Probabilty of failure: 1.0384661021935908e-128
Runtime: 5.609333333333335
Score: 5.609333333333335
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 21
Running with params: {'batchsize': 64, 'learning_rate': 0.8302268753441094, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.8302268753441094_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.601666666666665, Max: 5.789999999999999, Min: 5.4799999999999995
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.024543528110822
Exceeding current best timeout: 5.601666666666665 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 22
Running with params: {'batchsize': 64, 'learning_rate': 0.38220618095043346, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.38220618095043346_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 5.600333333333333, Max: 5.71, Min: 5.4
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.6255432421712289
Evaluating 30 values out of 30
Overall-timings: Avg: 5.600333333333333, Max: 5.71, Min: 5.4
Choosing distribution: gumbel_l
Probability of fail (non-zero): 2.0470055950527973e-160
All-Passed: True
Probabilty of failure: 2.0470055950527973e-160
Runtime: 5.600333333333333
Score: 5.600333333333333
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 23
Running with params: {'batchsize': 64, 'learning_rate': 0.2696286498725328, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.2696286498725328_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 5.5743333333333345, Max: 5.68, Min: 5.4
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.1213203435596424
Exceeding current best timeout: 5.5743333333333345 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 24
Running with params: {'batchsize': 16, 'learning_rate': 0.34131368401289486, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_16_0.34131368401289486_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 21...
Iter 19...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.596999999999999, Max: 5.66, Min: 5.4799999999999995
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 1.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.596999999999999, Max: 5.66, Min: 5.4799999999999995
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.596999999999999
Score: 5.596999999999999
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 25
Running with params: {'batchsize': 32, 'learning_rate': 0.04086046506736072, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.04086046506736072_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 5.603666666666667, Max: 5.7, Min: 5.529999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.012579110833419
Exceeding current best timeout: 5.603666666666667 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 26
Running with params: {'batchsize': 64, 'learning_rate': 5.389254296895677e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_5.389254296895677e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.626333333333335, Max: 5.71, Min: 5.3999999999999995
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.626333333333335 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 27
Running with params: {'batchsize': 32, 'learning_rate': 0.9638886094855161, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.9638886094855161_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 5.597666666666666, Max: 5.71, Min: 5.5
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 1.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.597666666666666, Max: 5.71, Min: 5.5
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.597666666666666
Score: 5.597666666666666
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 28
Running with params: {'batchsize': 16, 'learning_rate': 0.23117033995136108, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_16_0.23117033995136108_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Iter 26...
Timings: Avg: 5.601000000000001, Max: 5.680000000000001, Min: 5.52
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.601000000000001 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 29
Running with params: {'batchsize': 8, 'learning_rate': 0.5232049485757789, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_8_0.5232049485757789_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.605666666666665, Max: 5.7, Min: 5.51
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.018266349953211
Exceeding current best timeout: 5.605666666666665 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 30
Running with params: {'batchsize': 64, 'learning_rate': 0.1332933307511007, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.1332933307511007_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.626333333333333, Max: 5.710000000000001, Min: 5.44
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.7867957924694606
Evaluating 30 values out of 30
Overall-timings: Avg: 5.626333333333333, Max: 5.710000000000001, Min: 5.44
Choosing distribution: gumbel_l
Probability of fail (non-zero): 1.5197248639149282e-57
All-Passed: True
Probabilty of failure: 1.5197248639149282e-57
Runtime: 5.626333333333333
Score: 5.626333333333333
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 31
Running with params: {'batchsize': 32, 'learning_rate': 0.044309896617841876, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.044309896617841876_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.589, Max: 5.760000000000001, Min: 5.430000000000001
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 1.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.589, Max: 5.760000000000001, Min: 5.430000000000001
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.589
Score: 5.589
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 32
Running with params: {'batchsize': 32, 'learning_rate': 0.1623496600380453, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.1623496600380453_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.603333333333335, Max: 5.680000000000001, Min: 5.52
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 1.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.603333333333335, Max: 5.680000000000001, Min: 5.52
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.603333333333335
Score: 5.603333333333335
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 33
Running with params: {'batchsize': 64, 'learning_rate': 0.9823869054159012, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.9823869054159012_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 5.591666666666668, Max: 5.6899999999999995, Min: 5.4399999999999995
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.3922322702763898
Evaluating 30 values out of 30
Overall-timings: Avg: 5.591666666666668, Max: 5.6899999999999995, Min: 5.4399999999999995
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.591666666666668
Score: 5.591666666666668
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 34
Running with params: {'batchsize': 32, 'learning_rate': 0.058528622862736183, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.058528622862736183_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 5.601333333333333, Max: 5.67, Min: 5.5
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.33333333333329634
Evaluating 30 values out of 30
Overall-timings: Avg: 5.601333333333333, Max: 5.67, Min: 5.5
Choosing distribution: gumbel_l
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.601333333333333
Score: 5.601333333333333
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 35
Running with params: {'batchsize': 8, 'learning_rate': 0.0009650958331191244, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_8_0.0009650958331191244_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 5.6193333333333335, Max: 5.68, Min: 5.550000000000001
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.816496580927726
Evaluating 30 values out of 30
Overall-timings: Avg: 5.6193333333333335, Max: 5.68, Min: 5.550000000000001
Choosing distribution: laplace
Probability of fail (non-zero): 1.2466596550956708e-160
All-Passed: True
Probabilty of failure: 1.2466596550956708e-160
Runtime: 5.6193333333333335
Score: 5.6193333333333335
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 36
Running with params: {'batchsize': 16, 'learning_rate': 0.025087317850579466, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_16_0.025087317850579466_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 24...
Iter 28...
Iter 29...
Timings: Avg: 5.593000000000002, Max: 5.710000000000001, Min: 5.48
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.3535533905932581
Evaluating 30 values out of 30
Overall-timings: Avg: 5.593000000000002, Max: 5.710000000000001, Min: 5.48
Choosing distribution: gumbel_l
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.593000000000002
Score: 5.593000000000002
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 37
Running with params: {'batchsize': 64, 'learning_rate': 1.1252387451412774e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_1.1252387451412774e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.634666666666669, Max: 5.7, Min: 5.49
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 1.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.634666666666669, Max: 5.7, Min: 5.49
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.634666666666669
Score: 5.634666666666669
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 38
Running with params: {'batchsize': 32, 'learning_rate': 0.5701750146503994, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.5701750146503994_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.586000000000001, Max: 5.65, Min: 5.42
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.586000000000001, Max: 5.65, Min: 5.42
Variance (1.1093356479670479e-31) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.586000000000001
Score: 5.586000000000001
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 39
Running with params: {'batchsize': 8, 'learning_rate': 0.005380940028770285, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_8_0.005380940028770285_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 23...
Iter 21...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.600000000000002, Max: 5.75, Min: 5.5
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.600000000000002 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 40
Running with params: {'batchsize': 32, 'learning_rate': 0.019923695657439316, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.019923695657439316_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 5.602333333333334, Max: 5.66, Min: 5.51
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0141349766622059
Exceeding current best timeout: 5.602333333333334 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 41
Running with params: {'batchsize': 128, 'learning_rate': 0.00010096561805617276, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_0.00010096561805617276_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.601666666666668, Max: 5.6899999999999995, Min: 5.460000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.601666666666668 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 42
Running with params: {'batchsize': 64, 'learning_rate': 0.07459933070090795, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.07459933070090795_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.612666666666667, Max: 5.69, Min: 5.45
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.0000000000000004
Exceeding current best timeout: 5.612666666666667 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 43
Running with params: {'batchsize': 2, 'learning_rate': 0.2109576433401636, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.2109576433401636_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 4...
Iter 3...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 13...
Iter 11...
Iter 14...
Iter 15...
Iter 17...
Iter 18...
Iter 16...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.612333333333333, Max: 5.67, Min: 5.52
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.3535533905932581
Evaluating 30 values out of 30
Overall-timings: Avg: 5.612333333333333, Max: 5.67, Min: 5.52
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.612333333333333
Score: 5.612333333333333
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 44
Running with params: {'batchsize': 128, 'learning_rate': 0.0013513323504156392, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_0.0013513323504156392_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.597666666666667, Max: 5.7, Min: 5.51
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.7875615306482192
Evaluating 30 values out of 30
Overall-timings: Avg: 5.597666666666667, Max: 5.7, Min: 5.51
Choosing distribution: gumbel_l
Probability of fail (non-zero): 1.0654e-319
All-Passed: True
Probabilty of failure: 1.0654e-319
Runtime: 5.597666666666667
Score: 5.597666666666667
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 45
Running with params: {'batchsize': 8, 'learning_rate': 0.011369557697589015, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_8_0.011369557697589015_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.6273333333333335, Max: 5.680000000000001, Min: 5.529999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.794733192202076
Exceeding current best timeout: 5.6273333333333335 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 46
Running with params: {'batchsize': 32, 'learning_rate': 0.5557036647299012, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.5557036647299012_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.623, Max: 5.7700000000000005, Min: 5.52
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 1.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.623, Max: 5.7700000000000005, Min: 5.52
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.623
Score: 5.623
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 47
Running with params: {'batchsize': 16, 'learning_rate': 0.13130096336004415, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_16_0.13130096336004415_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 5.61, Max: 5.7, Min: 5.39
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.61 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 48
Running with params: {'batchsize': 2, 'learning_rate': 0.0003984506494650336, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.0003984506494650336_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.614000000000001, Max: 5.7, Min: 5.47
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.816496580927726
Evaluating 30 values out of 30
Overall-timings: Avg: 5.614000000000001, Max: 5.7, Min: 5.47
Choosing distribution: gumbel_l
Probability of fail (non-zero): 1.5197248639149282e-57
All-Passed: True
Probabilty of failure: 1.5197248639149282e-57
Runtime: 5.614000000000001
Score: 5.614000000000001
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 49
Running with params: {'batchsize': 64, 'learning_rate': 0.07064981901738837, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.07064981901738837_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.637999999999999, Max: 5.77, Min: 5.5
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.6666666666666297
Exceeding current best timeout: 5.637999999999999 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 50
Running with params: {'batchsize': 128, 'learning_rate': 0.008204994650275224, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_0.008204994650275224_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 5.597333333333333, Max: 5.71, Min: 5.470000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.597333333333333 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Upto iteration 50: {'batchsize': 4, 'learning_rate': 0.8436621460762177, 'num_epochs': 3}
Optimization Iteration: 51
Running with params: {'batchsize': 32, 'learning_rate': 3.255887641599583e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_3.255887641599583e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 4...
Iter 3...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 5.583333333333334, Max: 5.68, Min: 5.39
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.583333333333334 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 52
Running with params: {'batchsize': 64, 'learning_rate': 0.004100467868899726, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.004100467868899726_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.636333333333332, Max: 5.7299999999999995, Min: 5.55
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.8432740427115772
Evaluating 30 values out of 30
Overall-timings: Avg: 5.636333333333332, Max: 5.7299999999999995, Min: 5.55
Choosing distribution: logistic
Probability of fail (non-zero): 1.8732391223654664e-160
All-Passed: True
Probabilty of failure: 1.8732391223654664e-160
Runtime: 5.636333333333332
Score: 5.636333333333332
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 53
Running with params: {'batchsize': 2, 'learning_rate': 0.018117654257133242, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.018117654257133242_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.604666666666666, Max: 5.67, Min: 5.4399999999999995
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 3.040470972244056e-14
Evaluating 30 values out of 30
Overall-timings: Avg: 5.604666666666666, Max: 5.67, Min: 5.4399999999999995
Choosing distribution: gamma
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.604666666666666
Score: 5.604666666666666
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 54
Running with params: {'batchsize': 64, 'learning_rate': 0.3918869180696413, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.3918869180696413_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.608666666666667, Max: 5.699999999999999, Min: 5.5
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.7293249574894889
Evaluating 30 values out of 30
Overall-timings: Avg: 5.608666666666667, Max: 5.699999999999999, Min: 5.5
Choosing distribution: gumbel_l
Probability of fail (non-zero): 1.0654e-319
All-Passed: True
Probabilty of failure: 1.0654e-319
Runtime: 5.608666666666667
Score: 5.608666666666667
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 55
Running with params: {'batchsize': 16, 'learning_rate': 0.002156660863029788, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_16_0.002156660863029788_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 5.603, Max: 5.67, Min: 5.470000000000001
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.603, Max: 5.67, Min: 5.470000000000001
Variance (1.1093356479670479e-31) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.603
Score: 5.603
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 56
Running with params: {'batchsize': 32, 'learning_rate': 0.00016700840973548657, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.00016700840973548657_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.608333333333333, Max: 5.68, Min: 5.54
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.8966654385477271
Evaluating 30 values out of 30
Overall-timings: Avg: 5.608333333333333, Max: 5.68, Min: 5.54
Choosing distribution: logistic
Probability of fail (non-zero): 2.843829899209781e-129
All-Passed: True
Probabilty of failure: 2.843829899209781e-129
Runtime: 5.608333333333333
Score: 5.608333333333333
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 57
Running with params: {'batchsize': 8, 'learning_rate': 0.6593974815496969, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_8_0.6593974815496969_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 5.5873333333333335, Max: 5.65, Min: 5.47
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.5000000000000278
Evaluating 30 values out of 30
Overall-timings: Avg: 5.5873333333333335, Max: 5.65, Min: 5.47
Choosing distribution: pareto
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.5873333333333335
Score: 5.5873333333333335
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 58
Running with params: {'batchsize': 128, 'learning_rate': 0.09958340669885653, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_0.09958340669885653_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 5.597333333333333, Max: 5.67, Min: 5.42
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.597333333333333 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 59
Running with params: {'batchsize': 64, 'learning_rate': 0.000769133767597848, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.000769133767597848_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.568666666666668, Max: 5.67, Min: 5.33
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0000000000000222
Exceeding current best timeout: 5.568666666666668 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 60
Running with params: {'batchsize': 32, 'learning_rate': 0.3177379691839807, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.3177379691839807_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 5.602666666666667, Max: 5.680000000000001, Min: 5.49
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.0000000000000004
Exceeding current best timeout: 5.602666666666667 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 61
Running with params: {'batchsize': 2, 'learning_rate': 0.030310603968159978, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.030310603968159978_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 28...
Iter 29...
Iter 27...
Iter 26...
Timings: Avg: 5.597666666666667, Max: 5.66, Min: 5.52
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.6666666666666297
Exceeding current best timeout: 5.597666666666667 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 62
Running with params: {'batchsize': 64, 'learning_rate': 0.04613743749974676, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.04613743749974676_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 5.6146666666666665, Max: 5.68, Min: 5.46
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.3452078799116887
Exceeding current best timeout: 5.6146666666666665 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 63
Running with params: {'batchsize': 16, 'learning_rate': 0.16539319496511265, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_16_0.16539319496511265_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 21...
Iter 19...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.605333333333332, Max: 5.78, Min: 5.52
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0000000000000222
Exceeding current best timeout: 5.605333333333332 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 64
Running with params: {'batchsize': 32, 'learning_rate': 0.897935779012713, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.897935779012713_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.5873333333333335, Max: 5.71, Min: 5.38
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 90071992547411.0
Exceeding current best timeout: 5.5873333333333335 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 65
Running with params: {'batchsize': 8, 'learning_rate': 0.007390908198465886, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_8_0.007390908198465886_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.605999999999999, Max: 5.68, Min: 5.47
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.7947331922020373
Exceeding current best timeout: 5.605999999999999 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 66
Running with params: {'batchsize': 32, 'learning_rate': 0.4487042573639897, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.4487042573639897_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 19...
Iter 17...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.614666666666667, Max: 5.7, Min: 5.510000000000001
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.8075728530872661
Evaluating 30 values out of 30
Overall-timings: Avg: 5.614666666666667, Max: 5.7, Min: 5.510000000000001
Choosing distribution: gumbel_l
Probability of fail (non-zero): 1.5197248639149282e-57
All-Passed: True
Probabilty of failure: 1.5197248639149282e-57
Runtime: 5.614666666666667
Score: 5.614666666666667
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 67
Running with params: {'batchsize': 32, 'learning_rate': 0.7792380231645242, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.7792380231645242_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 27...
Iter 25...
Iter 28...
Iter 29...
Timings: Avg: 5.604666666666666, Max: 5.69, Min: 5.52
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.3922322702763898
Evaluating 30 values out of 30
Overall-timings: Avg: 5.604666666666666, Max: 5.69, Min: 5.52
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.604666666666666
Score: 5.604666666666666
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 68
Running with params: {'batchsize': 32, 'learning_rate': 0.19935174943850834, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.19935174943850834_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.602000000000001, Max: 5.74, Min: 5.39
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0000000000000222
Exceeding current best timeout: 5.602000000000001 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 69
Running with params: {'batchsize': 32, 'learning_rate': 0.12449234484182477, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.12449234484182477_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.610333333333333, Max: 5.69, Min: 5.510000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.5355339059327218
Exceeding current best timeout: 5.610333333333333 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 70
Running with params: {'batchsize': 32, 'learning_rate': 0.6059967918847095, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.6059967918847095_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.623333333333333, Max: 5.720000000000001, Min: 5.48
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 90071992547409.0
Exceeding current best timeout: 5.623333333333333 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 71
Running with params: {'batchsize': 32, 'learning_rate': 0.2396402678993929, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.2396402678993929_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.606333333333334, Max: 5.69, Min: 5.49
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.23606797749979
Exceeding current best timeout: 5.606333333333334 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 72
Running with params: {'batchsize': 32, 'learning_rate': 0.297329158625802, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.297329158625802_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.5906666666666665, Max: 5.6899999999999995, Min: 5.4399999999999995
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0000000000000222
Exceeding current best timeout: 5.5906666666666665 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 73
Running with params: {'batchsize': 64, 'learning_rate': 0.9917541654205924, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.9917541654205924_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.610333333333331, Max: 5.6899999999999995, Min: 5.49
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0000000000000222
Exceeding current best timeout: 5.610333333333331 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 74
Running with params: {'batchsize': 128, 'learning_rate': 0.47427327933363184, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_0.47427327933363184_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 5.62, Max: 5.82, Min: 5.38
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0932163332202598
Exceeding current best timeout: 5.62 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 75
Running with params: {'batchsize': 32, 'learning_rate': 0.03840889692837111, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.03840889692837111_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 5.612666666666667, Max: 5.72, Min: 5.510000000000001
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.3535533905932581
Evaluating 30 values out of 30
Overall-timings: Avg: 5.612666666666667, Max: 5.72, Min: 5.510000000000001
Choosing distribution: gumbel_l
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.612666666666667
Score: 5.612666666666667
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 76
Running with params: {'batchsize': 64, 'learning_rate': 0.05851228750218187, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.05851228750218187_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 5.623333333333333, Max: 5.74, Min: 5.5200000000000005
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.3535533905932581
Evaluating 30 values out of 30
Overall-timings: Avg: 5.623333333333333, Max: 5.74, Min: 5.5200000000000005
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.623333333333333
Score: 5.623333333333333
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 77
Running with params: {'batchsize': 2, 'learning_rate': 0.09363717012561135, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.09363717012561135_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 5.613666666666666, Max: 5.73, Min: 5.53
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.5355339059327218
Exceeding current best timeout: 5.613666666666666 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 78
Running with params: {'batchsize': 16, 'learning_rate': 0.7048752192313128, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_16_0.7048752192313128_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.602333333333334, Max: 5.72, Min: 5.470000000000001
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.602333333333334, Max: 5.72, Min: 5.470000000000001
Variance (1.1093356479670479e-31) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.602333333333334
Score: 5.602333333333334
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 79
Running with params: {'batchsize': 32, 'learning_rate': 0.1667357839174077, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.1667357839174077_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.609999999999999, Max: 5.73, Min: 5.53
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.6666666666666674
Exceeding current best timeout: 5.609999999999999 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 80
Running with params: {'batchsize': 8, 'learning_rate': 0.31619571061666546, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_8_0.31619571061666546_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.588, Max: 5.6499999999999995, Min: 5.5
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.588 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 81
Running with params: {'batchsize': 64, 'learning_rate': 0.013343090188077474, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.013343090188077474_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.602999999999999, Max: 5.88, Min: 5.42
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.3535533905932581
Evaluating 30 values out of 30
Overall-timings: Avg: 5.602999999999999, Max: 5.88, Min: 5.42
Choosing distribution: gumbel_l
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.602999999999999
Score: 5.602999999999999
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 82
Running with params: {'batchsize': 128, 'learning_rate': 0.023355050639736825, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_0.023355050639736825_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 5.615333333333335, Max: 5.69, Min: 5.44
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.615333333333335, Max: 5.69, Min: 5.44
Variance (1.1093356479670479e-31) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.615333333333335
Score: 5.615333333333335
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 83
Running with params: {'batchsize': 32, 'learning_rate': 0.05691530573260204, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.05691530573260204_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.607, Max: 5.68, Min: 5.43
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.6666666666666297
Exceeding current best timeout: 5.607 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 84
Running with params: {'batchsize': 64, 'learning_rate': 0.12499080442387511, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.12499080442387511_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 5.598999999999999, Max: 5.69, Min: 5.49
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 90071992547409.0
Exceeding current best timeout: 5.598999999999999 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 85
Running with params: {'batchsize': 2, 'learning_rate': 0.0013770529042537165, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.0013770529042537165_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.598666666666667, Max: 5.7, Min: 5.42
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 1.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.598666666666667, Max: 5.7, Min: 5.42
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.598666666666667
Score: 5.598666666666667
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 86
Running with params: {'batchsize': 32, 'learning_rate': 0.009650499859156513, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.009650499859156513_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.606000000000001, Max: 5.72, Min: 5.49
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 1.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.606000000000001, Max: 5.72, Min: 5.49
Choosing distribution: gumbel_l
Probability of fail (non-zero): 1.5197248639149282e-57
All-Passed: True
Probabilty of failure: 1.5197248639149282e-57
Runtime: 5.606000000000001
Score: 5.606000000000001
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 87
Running with params: {'batchsize': 16, 'learning_rate': 2.656624627128037e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_16_2.656624627128037e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.594666666666668, Max: 5.7299999999999995, Min: 5.46
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.8980265101338705
Evaluating 30 values out of 30
Overall-timings: Avg: 5.594666666666668, Max: 5.7299999999999995, Min: 5.46
Choosing distribution: laplace
Probability of fail (non-zero): 1.0384661021935908e-128
All-Passed: True
Probabilty of failure: 1.0384661021935908e-128
Runtime: 5.594666666666668
Score: 5.594666666666668
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 88
Running with params: {'batchsize': 8, 'learning_rate': 0.4188207040463573, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_8_0.4188207040463573_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.585333333333334, Max: 5.78, Min: 5.4
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.064129385141708
Exceeding current best timeout: 5.585333333333334 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 89
Running with params: {'batchsize': 32, 'learning_rate': 0.0049157411324476, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.0049157411324476_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.573666666666668, Max: 5.67, Min: 5.34
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 1.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.573666666666668, Max: 5.67, Min: 5.34
Choosing distribution: expon
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.573666666666668
Score: 5.573666666666668
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 90
Running with params: {'batchsize': 64, 'learning_rate': 0.00010669634541575875, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.00010669634541575875_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.586666666666665, Max: 5.680000000000001, Min: 5.45
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.6666666666666297
Exceeding current best timeout: 5.586666666666665 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 91
Running with params: {'batchsize': 128, 'learning_rate': 0.0005934318095591538, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_0.0005934318095591538_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.594, Max: 5.720000000000001, Min: 5.49
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.5191220960012991
Evaluating 30 values out of 30
Overall-timings: Avg: 5.594, Max: 5.720000000000001, Min: 5.49
Choosing distribution: logistic
Probability of fail (non-zero): 2.8159970036816802e-129
All-Passed: True
Probabilty of failure: 2.8159970036816802e-129
Runtime: 5.594
Score: 5.594
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 92
Running with params: {'batchsize': 32, 'learning_rate': 0.0034913840489210353, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.0034913840489210353_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 21...
Iter 19...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.602, Max: 5.6899999999999995, Min: 5.51
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: inf
Exceeding current best timeout: 5.602 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 93
Running with params: {'batchsize': 64, 'learning_rate': 0.00023294410602008446, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.00023294410602008446_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 15...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Iter 26...
Timings: Avg: 5.602999999999999, Max: 5.66, Min: 5.54
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.3535533905932581
Evaluating 30 values out of 30
Overall-timings: Avg: 5.602999999999999, Max: 5.66, Min: 5.54
Choosing distribution: gamma
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.602999999999999
Score: 5.602999999999999
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 94
Running with params: {'batchsize': 2, 'learning_rate': 0.00468981869019132, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_2_0.00468981869019132_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.588333333333334, Max: 5.73, Min: 5.49
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0000000000000222
Exceeding current best timeout: 5.588333333333334 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 95
Running with params: {'batchsize': 32, 'learning_rate': 0.002570258915809726, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.002570258915809726_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.6226666666666665, Max: 5.74, Min: 5.52
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.3535533905932581
Evaluating 30 values out of 30
Overall-timings: Avg: 5.6226666666666665, Max: 5.74, Min: 5.52
Choosing distribution: gumbel_l
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.6226666666666665
Score: 5.6226666666666665
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 96
Running with params: {'batchsize': 32, 'learning_rate': 0.0004050560451990634, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_32_0.0004050560451990634_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 20...
Iter 18...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.584333333333333, Max: 5.7, Min: 5.4
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.584333333333333, Max: 5.7, Min: 5.4
Variance (1.1093356479670479e-31) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.584333333333333
Score: 5.584333333333333
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 97
Running with params: {'batchsize': 16, 'learning_rate': 1.0995724424338686e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_16_1.0995724424338686e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.604666666666668, Max: 5.699999999999999, Min: 5.4399999999999995
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0000000000000222
Exceeding current best timeout: 5.604666666666668 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 98
Running with params: {'batchsize': 8, 'learning_rate': 4.6081079740012887e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_8_4.6081079740012887e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.6389999999999985, Max: 5.73, Min: 5.55
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 5.6389999999999985, Max: 5.73, Min: 5.55
Variance (1.1093356479670479e-31) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.6389999999999985
Score: 5.6389999999999985
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 99
Running with params: {'batchsize': 64, 'learning_rate': 0.006087300765489904, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_64_0.006087300765489904_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Iter 26...
Timings: Avg: 5.601333333333333, Max: 5.7, Min: 5.51
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.31622776601682034
Evaluating 30 values out of 30
Overall-timings: Avg: 5.601333333333333, Max: 5.7, Min: 5.51
Choosing distribution: gumbel_l
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 5.601333333333333
Score: 5.601333333333333
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Optimization Iteration: 100
Running with params: {'batchsize': 128, 'learning_rate': 0.015893362922399488, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597816938/assert_34176769_128_0.015893362922399488_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.6096666666666675, Max: 5.6899999999999995, Min: 5.44
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0210549404852456
Exceeding current best timeout: 5.6096666666666675 > 4.135555555555555
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 4.426555555555555
Best-param: {'batchsize': 64, 'learning_rate': 0.8436621460762177, 'num_epochs': 4}
Upto iteration 100: {'batchsize': 4, 'learning_rate': 0.8436621460762177, 'num_epochs': 3}
Breaking...
{'batchsize': 4, 'learning_rate': 0.8436621460762177, 'num_epochs': 3}
Best score: 4.426555555555555
Repeated params: 0
Trials: 101
Best param {'batchsize': 4, 'learning_rate': 0.8436621460762177, 'num_epochs': 3}
Reduction: 0.0%
Speedup: 1.0x
Optimizer time: 640.7549576759338
