Repo: parlai
Filename: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/projects/parlai/tests/test_tra.py
ClassName: TestTransformerRanker
Testname: test_train_fixed
Params: learning_rate,35,25,ParamType.LR,0.007
num_epochs,38,23,ParamType.CHAINS,4
batchsize,36,22,ParamType.CHAINS,16
Assertion: self.assertGreaterEqual(valid['hits@1'], threshold)
Original runtime: 9.426
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_0.007_4_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 29...
Iter 26...
Iter 27...
Iter 28...
Timings: Avg: 7.487, Max: 7.63, Min: 7.3500000000000005
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2262046393368884
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7.481833333333333, Max: 7.66, Min: 7.16
Passed tests : 60
Failed tests : 0
Converged: False
Convergence score: 1.0392304845413276
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 7.467999999999999, Max: 7.66, Min: 7.16
Passed tests : 90
Failed tests : 0
Converged: True
Convergence score: 0.685575179983961
Evaluating 90 values out of 90
Overall-timings: Avg: 7.467999999999999, Max: 7.66, Min: 7.16
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.004299814736972754
All-Passed: True
Probabilty of failure: 0.004299814736972754
Runtime: 7.467999999999999
Score: 7.467999999999999
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
>>Setting original runtime to 7.467999999999999
Optimization Iteration: 1
Running with params: {'batchsize': 128, 'learning_rate': 0.017792516684336346, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.017792516684336346_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.292333333333334, Max: 11.95, Min: 5.510000000000001
Passed tests : 9
Failed tests : 21
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 2
Running with params: {'batchsize': 32, 'learning_rate': 0.1227858366701581, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.1227858366701581_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.698333333333332, Max: 9.92, Min: 9.440000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 3
Running with params: {'batchsize': 8, 'learning_rate': 0.0010479183938282251, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_0.0010479183938282251_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.863666666666667, Max: 11.02, Min: 10.67
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 4
Running with params: {'batchsize': 16, 'learning_rate': 0.21885132067617252, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_16_0.21885132067617252_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 14.710666666666667, Max: 15.180000000000001, Min: 14.42
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 5
Running with params: {'batchsize': 32, 'learning_rate': 0.0025806913410669255, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.0025806913410669255_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.809000000000001, Max: 12.790000000000001, Min: 5.8100000000000005
Passed tests : 6
Failed tests : 24
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 6
Running with params: {'batchsize': 2, 'learning_rate': 0.7085405065837178, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.7085405065837178_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 84.23033333333335, Max: 86.41, Min: 83.18
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 7
Running with params: {'batchsize': 8, 'learning_rate': 0.0031525215970683263, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_0.0031525215970683263_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.326666666666666, Max: 3.3600000000000003, Min: 3.28
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 8
Running with params: {'batchsize': 128, 'learning_rate': 1.5341388093135764e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_1.5341388093135764e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.413000000000002, Max: 10.600000000000001, Min: 10.24
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 9
Running with params: {'batchsize': 8, 'learning_rate': 0.0003952740512688033, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_0.0003952740512688033_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.312333333333333, Max: 3.37, Min: 3.24
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 10
Running with params: {'batchsize': 32, 'learning_rate': 0.24407091718727128, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.24407091718727128_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 13...
Iter 11...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 20...
Iter 18...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.282, Max: 11.49, Min: 10.89
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 11
Running with params: {'batchsize': 128, 'learning_rate': 2.2068370220271702e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_2.2068370220271702e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.819333333333331, Max: 12.0, Min: 11.549999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 12
Running with params: {'batchsize': 2, 'learning_rate': 0.06569917865333443, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.06569917865333443_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 79.03, Max: 89.26, Min: 30.72
Passed tests : 10
Failed tests : 20
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 13
Running with params: {'batchsize': 8, 'learning_rate': 0.00028296523109958634, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_0.00028296523109958634_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3099999999999996, Max: 3.3600000000000003, Min: 3.25
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 14
Running with params: {'batchsize': 128, 'learning_rate': 0.6291326711909709, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.6291326711909709_1
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.401999999999997, Max: 10.6, Min: 10.139999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 15
Running with params: {'batchsize': 8, 'learning_rate': 0.005552065600238996, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_0.005552065600238996_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 7.297666666666667, Max: 9.41, Min: 6.99
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5724888975435531
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 7.2985000000000015, Max: 9.450000000000001, Min: 6.97
Passed tests : 60
Failed tests : 0
Converged: True
Convergence score: 0.6240405564828716
Evaluating 60 values out of 60
Overall-timings: Avg: 7.2985000000000015, Max: 9.450000000000001, Min: 6.97
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.12056132869654526
Exceeding max probability of failure: 0.12056132869654526
All-Passed: False
Probabilty of failure: 0.12056132869654526
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 16
Running with params: {'batchsize': 128, 'learning_rate': 0.1923371149175418, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.1923371149175418_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.706666666666669, Max: 12.959999999999999, Min: 12.45
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 17
Running with params: {'batchsize': 128, 'learning_rate': 0.04486565883287997, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.04486565883287997_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 7.404999999999999, Max: 9.540000000000001, Min: 5.8500000000000005
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.7985687492676043
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 7.4018333333333315, Max: 10.74, Min: 5.77
Passed tests : 60
Failed tests : 0
Converged: True
Convergence score: 0.5212957408975372
Evaluating 60 values out of 60
Overall-timings: Avg: 7.4018333333333315, Max: 10.74, Min: 5.77
Choosing distribution: beta
Probability of fail (non-zero): 0.5244796436861103
Exceeding max probability of failure: 0.5244796436861103
All-Passed: False
Probabilty of failure: 0.5244796436861103
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 18
Running with params: {'batchsize': 16, 'learning_rate': 2.083558126885571e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_16_2.083558126885571e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.3160000000000003, Max: 3.37, Min: 3.23
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 19
Running with params: {'batchsize': 64, 'learning_rate': 8.567351602814437e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_64_8.567351602814437e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.494333333333335, Max: 10.74, Min: 10.28
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 20
Running with params: {'batchsize': 32, 'learning_rate': 0.0004188892248180778, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.0004188892248180778_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 9.553333333333333, Max: 9.860000000000001, Min: 9.24
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 21
Running with params: {'batchsize': 16, 'learning_rate': 0.015317818243906411, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_16_0.015317818243906411_None
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.316666666666667, Max: 3.38, Min: 3.2
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 22
Running with params: {'batchsize': 64, 'learning_rate': 7.626374925577721e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_64_7.626374925577721e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 10.485666666666665, Max: 10.64, Min: 10.15
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 23
Running with params: {'batchsize': 32, 'learning_rate': 0.011224397864534571, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.011224397864534571_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 17...
Iter 21...
Iter 23...
Iter 24...
Iter 22...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 5.881333333333334, Max: 8.86, Min: 4.79
Passed tests : 27
Failed tests : 3
Converged: False
Convergence score: 1.478753550814708
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 10...
Iter 11...
Iter 9...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.889833333333333, Max: 8.86, Min: 4.79
Passed tests : 53
Failed tests : 7
Converged: False
Convergence score: 3.2105670222779215
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 9...
Iter 7...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.877111111111112, Max: 8.86, Min: 4.79
Passed tests : 79
Failed tests : 11
Converged: False
Convergence score: 1.7406270018815828
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 25...
Iter 26...
Iter 23...
Iter 22...
Iter 27...
Iter 29...
Iter 28...
Iter 24...
Timings: Avg: 5.881166666666666, Max: 8.86, Min: 4.77
Passed tests : 107
Failed tests : 13
Converged: False
Convergence score: 1.4324020207083101
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.898933333333335, Max: 8.86, Min: 4.77
Passed tests : 134
Failed tests : 16
Converged: False
Convergence score: 1.0889345481378514
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 5.889555555555555, Max: 8.86, Min: 4.720000000000001
Passed tests : 161
Failed tests : 19
Converged: False
Convergence score: 1.3132530120481913
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 27...
Iter 24...
Iter 29...
Iter 26...
Iter 25...
Iter 28...
Timings: Avg: 5.8651904761904765, Max: 8.86, Min: 4.720000000000001
Passed tests : 191
Failed tests : 19
Converged: False
Convergence score: 1.0447326251617746
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.825999999999999, Max: 8.86, Min: 4.720000000000001
Passed tests : 219
Failed tests : 21
Converged: False
Convergence score: 1.0802369021218836
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 5.879555555555555, Max: 9.0, Min: 4.720000000000001
Passed tests : 248
Failed tests : 22
Converged: False
Convergence score: 1.1329223702762783
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 28...
Iter 29...
Iter 26...
Iter 27...
Timings: Avg: 5.890033333333333, Max: 9.0, Min: 4.720000000000001
Passed tests : 273
Failed tests : 27
Converged: True
Convergence score: 0.9465630551849198
Evaluating 300 values out of 300
Overall-timings: Avg: 5.890033333333333, Max: 9.0, Min: 4.720000000000001
Choosing distribution: beta
Choosing distribution: gumbel_l
Choosing distribution: beta
Probability of fail (non-zero): 0.5181220035177008
Exceeding max probability of failure: 0.5181220035177008
All-Passed: False
Probabilty of failure: 0.5181220035177008
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 24
Running with params: {'batchsize': 16, 'learning_rate': 0.021215363516216768, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_16_0.021215363516216768_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.318333333333334, Max: 3.38, Min: 3.18
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 25
Running with params: {'batchsize': 64, 'learning_rate': 5.39931968633744e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_64_5.39931968633744e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 23...
Iter 21...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.48, Max: 10.59, Min: 10.23
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 26
Running with params: {'batchsize': 32, 'learning_rate': 0.013202971915140117, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.013202971915140117_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 5.7653333333333325, Max: 8.38, Min: 4.78
Passed tests : 29
Failed tests : 1
Converged: True
Convergence score: 0.8822552902141674
Evaluating 30 values out of 30
Overall-timings: Avg: 5.7653333333333325, Max: 8.38, Min: 4.78
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.4595397387399558
Exceeding max probability of failure: 0.4595397387399558
All-Passed: False
Probabilty of failure: 0.4595397387399558
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 27
Running with params: {'batchsize': 16, 'learning_rate': 0.0329292610720404, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_16_0.0329292610720404_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.305, Max: 3.36, Min: 3.1799999999999997
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 28
Running with params: {'batchsize': 64, 'learning_rate': 0.001549217097176396, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_64_0.001549217097176396_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.480333333333336, Max: 10.680000000000001, Min: 10.1
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 29
Running with params: {'batchsize': 32, 'learning_rate': 0.006523237821966219, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.006523237821966219_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 8.283999999999999, Max: 9.540000000000001, Min: 4.79
Passed tests : 8
Failed tests : 22
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 30
Running with params: {'batchsize': 16, 'learning_rate': 0.04063403299380319, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_16_0.04063403299380319_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 10...
Iter 11...
Iter 9...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Not found ::: 
Timings: Avg: 3.307333333333333, Max: 3.38, Min: 3.27
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 31
Running with params: {'batchsize': 64, 'learning_rate': 0.0012148618035665252, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_64_0.0012148618035665252_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.466666666666667, Max: 10.71, Min: 10.149999999999999
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 32
Running with params: {'batchsize': 2, 'learning_rate': 0.006850280773193084, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.006850280773193084_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 16.789666666666665, Max: 17.41, Min: 16.41
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9811557810392131
Evaluating 30 values out of 30
Overall-timings: Avg: 16.789666666666665, Max: 17.41, Min: 16.41
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.002560472678758482
All-Passed: True
Probabilty of failure: 0.002560472678758482
Runtime: 16.789666666666665
Score: 16.789666666666665
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 33
Running with params: {'batchsize': 2, 'learning_rate': 0.11173869240462504, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.11173869240462504_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 48.31266666666667, Max: 49.449999999999996, Min: 46.660000000000004
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 34
Running with params: {'batchsize': 2, 'learning_rate': 0.006213277246654548, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.006213277246654548_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.524666666666667, Max: 17.97, Min: 10.01
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.8293182415200935
Exceeding current best timeout: 10.524666666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 35
Running with params: {'batchsize': 2, 'learning_rate': 0.3678876802917924, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.3678876802917924_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.788000000000002, Max: 14.37, Min: 10.09
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 7.273457018814265
Exceeding current best timeout: 10.788000000000002 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 36
Running with params: {'batchsize': 2, 'learning_rate': 0.0006654386373924628, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.0006654386373924628_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.991333333333332, Max: 14.59, Min: 10.11
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.7967078411590511
Exceeding current best timeout: 10.991333333333332 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 37
Running with params: {'batchsize': 128, 'learning_rate': 0.0001591273488633068, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.0001591273488633068_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.429333333333329, Max: 17.47, Min: 10.05
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.620635413647642
Exceeding current best timeout: 11.429333333333329 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 38
Running with params: {'batchsize': 2, 'learning_rate': 0.0034139581934775416, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.0034139581934775416_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.672999999999998, Max: 14.44, Min: 10.01
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0628342113468223
Exceeding current best timeout: 10.672999999999998 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 39
Running with params: {'batchsize': 128, 'learning_rate': 0.08531724404060789, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.08531724404060789_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.35466666666667, Max: 18.25, Min: 10.100000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2588408984973722
Exceeding current best timeout: 11.35466666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 40
Running with params: {'batchsize': 2, 'learning_rate': 0.0021649821479079925, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.0021649821479079925_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Iter 26...
Timings: Avg: 10.419333333333332, Max: 14.05, Min: 10.139999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1495977111893083
Exceeding current best timeout: 10.419333333333332 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 41
Running with params: {'batchsize': 128, 'learning_rate': 0.0008479007401166233, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.0008479007401166233_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.629333333333332, Max: 14.4, Min: 10.1
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3421725355514367
Exceeding current best timeout: 10.629333333333332 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 42
Running with params: {'batchsize': 8, 'learning_rate': 0.17414051174463172, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_0.17414051174463172_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 9...
Iter 10...
Iter 7...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.533999999999999, Max: 20.75, Min: 10.07
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.3871144645942386
Exceeding current best timeout: 11.533999999999999 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 43
Running with params: {'batchsize': 16, 'learning_rate': 0.9877816073793754, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_16_0.9877816073793754_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 11.53, Max: 18.439999999999998, Min: 10.040000000000001
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.259534052531541
Exceeding current best timeout: 11.53 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 44
Running with params: {'batchsize': 16, 'learning_rate': 0.020193672839911796, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_16_0.020193672839911796_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.409, Max: 18.540000000000003, Min: 10.069999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.5350008891905125
Exceeding current best timeout: 11.409 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 45
Running with params: {'batchsize': 128, 'learning_rate': 0.003458187275183579, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.003458187275183579_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 12.003333333333334, Max: 18.67, Min: 10.06
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.6743185236191804
Exceeding current best timeout: 12.003333333333334 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 46
Running with params: {'batchsize': 2, 'learning_rate': 0.4303205696489436, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.4303205696489436_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.758999999999999, Max: 17.96, Min: 10.07
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.955700049577617
Evaluating 30 values out of 30
Overall-timings: Avg: 10.758999999999999, Max: 17.96, Min: 10.07
Choosing distribution: logistic
Probability of fail (non-zero): 0.17556289777990614
Exceeding max probability of failure: 0.17556289777990614
All-Passed: False
Probabilty of failure: 0.17556289777990614
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 47
Running with params: {'batchsize': 128, 'learning_rate': 0.05909458250650276, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.05909458250650276_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.496666666666668, Max: 14.26, Min: 10.02
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.942306497225698
Evaluating 30 values out of 30
Overall-timings: Avg: 10.496666666666668, Max: 14.26, Min: 10.02
Choosing distribution: t
Probability of fail (non-zero): 0.05338578601524696
Exceeding max probability of failure: 0.05338578601524696
All-Passed: False
Probabilty of failure: 0.05338578601524696
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 48
Running with params: {'batchsize': 8, 'learning_rate': 0.008933193224098392, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_0.008933193224098392_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.830666666666666, Max: 18.119999999999997, Min: 9.989999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2525976592377408
Exceeding current best timeout: 10.830666666666666 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 49
Running with params: {'batchsize': 2, 'learning_rate': 0.027888564898300803, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.027888564898300803_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.508333333333333, Max: 14.280000000000001, Min: 10.040000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8954334661074004
Exceeding current best timeout: 10.508333333333333 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 50
Running with params: {'batchsize': 128, 'learning_rate': 0.0002327601365468442, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.0002327601365468442_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 10.642666666666665, Max: 18.0, Min: 10.08
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 6.041403158501516
Exceeding current best timeout: 10.642666666666665 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Upto iteration 50: {'batchsize': 0, 'learning_rate': 0.006850280773193084, 'num_epochs': 1}
Optimization Iteration: 51
Running with params: {'batchsize': 8, 'learning_rate': 1.022392736185619e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_1.022392736185619e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.856000000000002, Max: 21.47, Min: 10.049999999999999
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.4729207641067568
Exceeding current best timeout: 11.856000000000002 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 52
Running with params: {'batchsize': 128, 'learning_rate': 0.002267792799383562, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.002267792799383562_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.93666666666667, Max: 18.349999999999998, Min: 10.020000000000001
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.849206473404464
Exceeding current best timeout: 10.93666666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 53
Running with params: {'batchsize': 2, 'learning_rate': 0.0005329969101399454, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.0005329969101399454_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.58633333333333, Max: 18.439999999999998, Min: 10.09
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.638728363485658
Exceeding current best timeout: 11.58633333333333 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 54
Running with params: {'batchsize': 32, 'learning_rate': 0.0041003234636716075, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.0041003234636716075_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.241666666666665, Max: 18.48, Min: 10.08
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9465539908575176
Evaluating 30 values out of 30
Overall-timings: Avg: 11.241666666666665, Max: 18.48, Min: 10.08
Choosing distribution: beta
Probability of fail (non-zero): 0.25403976445129994
Exceeding max probability of failure: 0.25403976445129994
All-Passed: False
Probabilty of failure: 0.25403976445129994
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 55
Running with params: {'batchsize': 128, 'learning_rate': 0.1308013766268148, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.1308013766268148_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.246000000000004, Max: 14.590000000000002, Min: 9.99
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.4341537754444484
Exceeding current best timeout: 11.246000000000004 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 56
Running with params: {'batchsize': 64, 'learning_rate': 0.009284620403194914, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_64_0.009284620403194914_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.53, Max: 17.85, Min: 9.99
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.184980283793997
Exceeding current best timeout: 10.53 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 57
Running with params: {'batchsize': 2, 'learning_rate': 0.30951739934434264, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.30951739934434264_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.666666666666668, Max: 18.46, Min: 10.0
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.7789361803342478
Evaluating 30 values out of 30
Overall-timings: Avg: 11.666666666666668, Max: 18.46, Min: 10.0
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.2852199273024268
Exceeding max probability of failure: 0.2852199273024268
All-Passed: False
Probabilty of failure: 0.2852199273024268
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 58
Running with params: {'batchsize': 8, 'learning_rate': 0.0017863782780888336, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_0.0017863782780888336_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 11.066999999999998, Max: 18.39, Min: 10.0
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.018857494291036
Exceeding current best timeout: 11.066999999999998 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 59
Running with params: {'batchsize': 32, 'learning_rate': 0.018907275130696857, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.018907275130696857_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.931666666666668, Max: 16.96, Min: 9.99
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 5.909368402852794
Exceeding current best timeout: 10.931666666666668 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 60
Running with params: {'batchsize': 128, 'learning_rate': 0.6376283025588154, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.6376283025588154_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.405666666666667, Max: 18.37, Min: 10.040000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.807306148538555
Exceeding current best timeout: 11.405666666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 61
Running with params: {'batchsize': 64, 'learning_rate': 0.06681141622393229, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_64_0.06681141622393229_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.8, Max: 14.370000000000001, Min: 10.01
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.197039090628638
Exceeding current best timeout: 10.8 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 62
Running with params: {'batchsize': 2, 'learning_rate': 4.192875700743999e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_4.192875700743999e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 27...
Iter 28...
Timings: Avg: 11.026333333333332, Max: 14.65, Min: 10.129999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9995836369268896
Exceeding current best timeout: 11.026333333333332 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 63
Running with params: {'batchsize': 2, 'learning_rate': 0.005730490131221298, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.005730490131221298_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.293000000000003, Max: 20.99, Min: 10.110000000000001
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.765968308831339
Exceeding current best timeout: 12.293000000000003 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 64
Running with params: {'batchsize': 2, 'learning_rate': 0.00015667993976976473, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.00015667993976976473_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.942, Max: 18.09, Min: 9.979999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.873532421532432
Exceeding current best timeout: 10.942 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 65
Running with params: {'batchsize': 2, 'learning_rate': 0.9376637062316444, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.9376637062316444_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 10.81166666666667, Max: 18.05, Min: 10.15
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.636736291387531
Exceeding current best timeout: 10.81166666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 66
Running with params: {'batchsize': 2, 'learning_rate': 0.0007961284964964127, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.0007961284964964127_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.018333333333336, Max: 14.700000000000001, Min: 10.040000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.118727630004968
Exceeding current best timeout: 11.018333333333336 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 67
Running with params: {'batchsize': 2, 'learning_rate': 0.2682105965275073, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.2682105965275073_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.53866666666667, Max: 18.22, Min: 10.05
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.219809032440617
Exceeding current best timeout: 11.53866666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 68
Running with params: {'batchsize': 2, 'learning_rate': 0.001286235452323613, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.001286235452323613_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.568666666666669, Max: 14.19, Min: 10.059999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9404678687362635
Exceeding current best timeout: 10.568666666666669 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 69
Running with params: {'batchsize': 128, 'learning_rate': 0.00012723571049905744, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.00012723571049905744_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 9...
Iter 8...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.109000000000002, Max: 18.22, Min: 10.040000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2094579648209915
Exceeding current best timeout: 11.109000000000002 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 70
Running with params: {'batchsize': 2, 'learning_rate': 0.004221856016871289, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.004221856016871289_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.039666666666669, Max: 16.599999999999998, Min: 10.17
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1476760149613567
Exceeding current best timeout: 11.039666666666669 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 71
Running with params: {'batchsize': 128, 'learning_rate': 0.0002590235710487782, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.0002590235710487782_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 11.09, Max: 18.42, Min: 9.979999999999999
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 2.7084869183270643
Exceeding current best timeout: 11.09 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 72
Running with params: {'batchsize': 8, 'learning_rate': 2.571652863060332e-05, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_2.571652863060332e-05_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.124, Max: 20.69, Min: 9.94
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2019275302527186
Exceeding current best timeout: 12.124 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 73
Running with params: {'batchsize': 8, 'learning_rate': 0.03282622862831541, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_0.03282622862831541_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.105, Max: 18.47, Min: 9.979999999999999
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 3.3156393127551738
Exceeding current best timeout: 11.105 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 74
Running with params: {'batchsize': 128, 'learning_rate': 0.00206078615435764, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.00206078615435764_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.956666666666667, Max: 17.98, Min: 10.0
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.274092035257176
Exceeding current best timeout: 10.956666666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 75
Running with params: {'batchsize': 32, 'learning_rate': 0.00039806368037900285, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.00039806368037900285_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 11.097000000000001, Max: 18.35, Min: 10.08
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.9863665759151907
Exceeding current best timeout: 11.097000000000001 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 76
Running with params: {'batchsize': 32, 'learning_rate': 0.008148316297153922, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.008148316297153922_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.805666666666667, Max: 18.220000000000002, Min: 9.93
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2903676002168236
Exceeding current best timeout: 10.805666666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 77
Running with params: {'batchsize': 32, 'learning_rate': 0.011095598487214899, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.011095598487214899_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.139000000000001, Max: 16.86, Min: 10.02
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4517323726225928
Exceeding current best timeout: 11.139000000000001 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 78
Running with params: {'batchsize': 128, 'learning_rate': 0.10319069887254316, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.10319069887254316_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.795666666666667, Max: 14.42, Min: 10.030000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.876979427254378
Exceeding current best timeout: 10.795666666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 79
Running with params: {'batchsize': 64, 'learning_rate': 0.04975912835261302, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_64_0.04975912835261302_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.110000000000005, Max: 16.790000000000003, Min: 10.100000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.914181793507808
Exceeding current best timeout: 11.110000000000005 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 80
Running with params: {'batchsize': 16, 'learning_rate': 0.3973271004836261, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_16_0.3973271004836261_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.154666666666667, Max: 18.68, Min: 10.05
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1758087336001846
Exceeding current best timeout: 11.154666666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 81
Running with params: {'batchsize': 2, 'learning_rate': 0.016282397282256035, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.016282397282256035_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.097333333333333, Max: 18.34, Min: 10.09
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9795918367346932
Exceeding current best timeout: 11.097333333333333 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 82
Running with params: {'batchsize': 8, 'learning_rate': 0.0018244708915071503, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_0.0018244708915071503_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.566333333333334, Max: 18.310000000000002, Min: 10.1
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.014738592878277
Exceeding current best timeout: 11.566333333333334 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 83
Running with params: {'batchsize': 32, 'learning_rate': 0.023795731036883313, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.023795731036883313_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 10.991000000000001, Max: 14.5, Min: 10.12
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5200447507762045
Exceeding current best timeout: 10.991000000000001 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 84
Running with params: {'batchsize': 128, 'learning_rate': 0.6611764648311413, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.6611764648311413_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.577333333333332, Max: 14.27, Min: 10.08
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.1736771222255036
Exceeding current best timeout: 10.577333333333332 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 85
Running with params: {'batchsize': 32, 'learning_rate': 0.03389413230565794, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_32_0.03389413230565794_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.788999999999998, Max: 18.04, Min: 10.020000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0958342376731334
Exceeding current best timeout: 10.788999999999998 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 86
Running with params: {'batchsize': 64, 'learning_rate': 0.17794396067943669, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_64_0.17794396067943669_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 27...
Iter 25...
Iter 29...
Iter 28...
Iter 26...
Timings: Avg: 10.917666666666667, Max: 16.759999999999998, Min: 10.01
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2999785129294303
Exceeding current best timeout: 10.917666666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 87
Running with params: {'batchsize': 64, 'learning_rate': 0.07338550154138994, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_64_0.07338550154138994_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.686000000000002, Max: 14.44, Min: 10.05
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8205368074920756
Exceeding current best timeout: 10.686000000000002 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 88
Running with params: {'batchsize': 2, 'learning_rate': 3.184601492968284e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_3.184601492968284e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.10933333333333, Max: 18.16, Min: 9.97
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9293468417958797
Evaluating 30 values out of 30
Overall-timings: Avg: 11.10933333333333, Max: 18.16, Min: 9.97
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.21743828211280875
Exceeding max probability of failure: 0.21743828211280875
All-Passed: False
Probabilty of failure: 0.21743828211280875
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 89
Running with params: {'batchsize': 16, 'learning_rate': 0.005145491666385455, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_16_0.005145491666385455_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.51333333333333, Max: 18.540000000000003, Min: 9.95
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.475368857441688
Exceeding current best timeout: 11.51333333333333 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 90
Running with params: {'batchsize': 2, 'learning_rate': 1.3929053664772904e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_1.3929053664772904e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 10.662666666666665, Max: 14.309999999999999, Min: 10.030000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.773964619357641
Exceeding current best timeout: 10.662666666666665 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 91
Running with params: {'batchsize': 2, 'learning_rate': 0.0025017514876403304, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.0025017514876403304_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.693666666666669, Max: 14.35, Min: 10.010000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1374635640892197
Exceeding current best timeout: 10.693666666666669 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 92
Running with params: {'batchsize': 2, 'learning_rate': 0.0006792910496455531, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.0006792910496455531_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.702333333333334, Max: 14.36, Min: 10.03
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6144652969159292
Exceeding current best timeout: 10.702333333333334 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 93
Running with params: {'batchsize': 16, 'learning_rate': 0.00087373853223894, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_16_0.00087373853223894_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.567666666666666, Max: 14.22, Min: 10.049999999999999
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.905275244891016
Evaluating 30 values out of 30
Overall-timings: Avg: 10.567666666666666, Max: 14.22, Min: 10.049999999999999
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.09688350789205065
Exceeding max probability of failure: 0.09688350789205065
All-Passed: False
Probabilty of failure: 0.09688350789205065
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 94
Running with params: {'batchsize': 2, 'learning_rate': 0.24996337659510487, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.24996337659510487_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 10.607000000000001, Max: 14.33, Min: 9.88
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2217656773139385
Exceeding current best timeout: 10.607000000000001 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 95
Running with params: {'batchsize': 128, 'learning_rate': 0.00128524073305285, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.00128524073305285_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.697333333333331, Max: 14.33, Min: 10.02
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.798211899413033
Exceeding current best timeout: 10.697333333333331 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 96
Running with params: {'batchsize': 128, 'learning_rate': 9.661053415184964e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_9.661053415184964e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.40966666666667, Max: 18.29, Min: 10.1
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3489065468669241
Exceeding current best timeout: 11.40966666666667 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 97
Running with params: {'batchsize': 128, 'learning_rate': 0.00013366093910804796, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.00013366093910804796_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.623000000000001, Max: 20.75, Min: 10.08
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5320918344608334
Exceeding current best timeout: 11.623000000000001 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 98
Running with params: {'batchsize': 2, 'learning_rate': 0.013185682510926168, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_2_0.013185682510926168_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.078333333333335, Max: 18.37, Min: 10.09
Passed tests : 29
Failed tests : 1
Converged: False
Convergence score: 1.3396226415094352
Exceeding current best timeout: 11.078333333333335 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 99
Running with params: {'batchsize': 128, 'learning_rate': 0.0003229387372622588, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_128_0.0003229387372622588_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.22733333333333, Max: 18.48, Min: 9.91
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.5399250997214704
Exceeding current best timeout: 11.22733333333333 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 100
Running with params: {'batchsize': 8, 'learning_rate': 0.007577441620568211, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597804702/assert_95558867_8_0.007577441620568211_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 11.115666666666668, Max: 14.67, Min: 10.08
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9183482693748775
Exceeding current best timeout: 11.115666666666668 > 7.467999999999999
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 7.467999999999999
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Upto iteration 100: {'batchsize': 0, 'learning_rate': 0.006850280773193084, 'num_epochs': 1}
Breaking...
{'batchsize': 0, 'learning_rate': 0.006850280773193084, 'num_epochs': 1}
Best score: 7.467999999999999
Repeated params: 0
Trials: 101
Best param {'batchsize': 0, 'learning_rate': 0.006850280773193084, 'num_epochs': 1}
Reduction: 0.0%
Speedup: 1.0x
Optimizer time: 1782.250849723816
