Repo: parlai
Filename: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/projects/parlai/tests/test_tra.py
ClassName: TestTransformerRanker
Testname: test_eval_fixed
Params: learning_rate,35,25,ParamType.LR,0.007
num_epochs,38,23,ParamType.CHAINS,4
batchsize,36,22,ParamType.CHAINS,16
Assertion: self.assertGreaterEqual(valid['hits@100'], 0.1)
Original runtime: 8.482
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_0.007_4_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 8.466333333333333, Max: 8.63, Min: 8.22
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.0
Evaluating 30 values out of 30
Overall-timings: Avg: 8.466333333333333, Max: 8.63, Min: 8.22
Variance (0.0) too small, using delta distribution
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 8.466333333333333
Score: 8.466333333333333
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
>>Setting original runtime to 8.466333333333333
Optimization Iteration: 1
Running with params: {'batchsize': 2, 'learning_rate': 0.7809274052090814, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.7809274052090814_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.277666666666665, Max: 34.44, Min: 23.28
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.475368857441686
Exceeding current best timeout: 24.277666666666665 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 2
Running with params: {'batchsize': 16, 'learning_rate': 0.0025592830477919625, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.0025592830477919625_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.04166666666667, Max: 25.23, Min: 23.44
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2647393139390524
Exceeding current best timeout: 24.04166666666667 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 3
Running with params: {'batchsize': 16, 'learning_rate': 0.07998494695467377, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.07998494695467377_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.014, Max: 24.66, Min: 23.52
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.4367726650542028
Exceeding current best timeout: 24.014 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 4
Running with params: {'batchsize': 2, 'learning_rate': 0.0012359293019503156, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.0012359293019503156_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.181333333333335, Max: 34.87, Min: 23.31
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 12.111092908097577
Exceeding current best timeout: 24.181333333333335 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 5
Running with params: {'batchsize': 16, 'learning_rate': 0.00048755172546000465, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.00048755172546000465_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 25.043, Max: 35.53, Min: 23.49
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2225792554235346
Exceeding current best timeout: 25.043 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 6
Running with params: {'batchsize': 8, 'learning_rate': 0.012069957179634975, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_8_0.012069957179634975_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 23.793333333333333, Max: 24.169999999999998, Min: 23.3
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.1937892346161494
Exceeding current best timeout: 23.793333333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 7
Running with params: {'batchsize': 2, 'learning_rate': 0.0019164108632593675, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.0019164108632593675_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.780000000000005, Max: 35.32, Min: 23.51
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2963144447750565
Exceeding current best timeout: 24.780000000000005 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 8
Running with params: {'batchsize': 64, 'learning_rate': 0.010000179320959136, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.010000179320959136_None
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.177, Max: 34.27, Min: 23.400000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5909902576697335
Exceeding current best timeout: 24.177 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 9
Running with params: {'batchsize': 32, 'learning_rate': 0.20183422886573887, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_0.20183422886573887_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.470000000000002, Max: 45.449999999999996, Min: 23.56
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.047919896776839
Exceeding current best timeout: 25.470000000000002 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 10
Running with params: {'batchsize': 32, 'learning_rate': 8.11220269417627e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_8.11220269417627e-05_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 24.709999999999997, Max: 35.400000000000006, Min: 23.45
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.418125640558682
Exceeding current best timeout: 24.709999999999997 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 11
Running with params: {'batchsize': 16, 'learning_rate': 0.6398794315298421, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.6398794315298421_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 11...
Iter 12...
Iter 10...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 23.942, Max: 24.39, Min: 23.400000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3816724188545706
Exceeding current best timeout: 23.942 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 12
Running with params: {'batchsize': 16, 'learning_rate': 0.05887539821894281, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.05887539821894281_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.365000000000002, Max: 34.480000000000004, Min: 23.55
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 8.646920305474705
Exceeding current best timeout: 24.365000000000002 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 13
Running with params: {'batchsize': 32, 'learning_rate': 0.014931435468645, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_0.014931435468645_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.446333333333335, Max: 46.55, Min: 23.37
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2706091038759466
Exceeding current best timeout: 25.446333333333335 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 14
Running with params: {'batchsize': 2, 'learning_rate': 0.0022098893220354973, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.0022098893220354973_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 23.951666666666668, Max: 24.790000000000003, Min: 23.41
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.635986902005941
Exceeding current best timeout: 23.951666666666668 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 15
Running with params: {'batchsize': 32, 'learning_rate': 8.788695845956239e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_8.788695845956239e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 27...
Iter 25...
Iter 29...
Iter 28...
Timings: Avg: 24.735333333333337, Max: 35.370000000000005, Min: 23.55
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4321305047743034
Exceeding current best timeout: 24.735333333333337 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 16
Running with params: {'batchsize': 32, 'learning_rate': 0.00025006355793163163, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_0.00025006355793163163_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.554333333333332, Max: 34.980000000000004, Min: 23.64
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6479413591484442
Exceeding current best timeout: 24.554333333333332 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 17
Running with params: {'batchsize': 128, 'learning_rate': 1.6586704040545356e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_128_1.6586704040545356e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.309666666666665, Max: 34.38, Min: 23.36
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 6.060360985162447
Exceeding current best timeout: 24.309666666666665 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 18
Running with params: {'batchsize': 16, 'learning_rate': 0.00010934624693934204, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.00010934624693934204_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.72733333333333, Max: 35.06, Min: 23.52
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.0758008131582395
Exceeding current best timeout: 24.72733333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 19
Running with params: {'batchsize': 16, 'learning_rate': 0.006578315722461807, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.006578315722461807_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 25.851666666666667, Max: 46.440000000000005, Min: 23.43
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.9698484809834995
Exceeding current best timeout: 25.851666666666667 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 20
Running with params: {'batchsize': 128, 'learning_rate': 4.1074187021869915e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_128_4.1074187021869915e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 24.936, Max: 35.25, Min: 23.709999999999997
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1162803616860497
Exceeding current best timeout: 24.936 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 21
Running with params: {'batchsize': 64, 'learning_rate': 1.0408532749834632e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_1.0408532749834632e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.723999999999997, Max: 35.14, Min: 23.52
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6713433009863854
Exceeding current best timeout: 24.723999999999997 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 22
Running with params: {'batchsize': 8, 'learning_rate': 0.9840642534880996, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_8_0.9840642534880996_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.68466666666667, Max: 34.59, Min: 23.439999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5151974837773698
Exceeding current best timeout: 24.68466666666667 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 23
Running with params: {'batchsize': 128, 'learning_rate': 3.575331945785919e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_128_3.575331945785919e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.654999999999998, Max: 34.620000000000005, Min: 23.240000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.7012665163046023
Exceeding current best timeout: 24.654999999999998 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 24
Running with params: {'batchsize': 64, 'learning_rate': 1.1483087785375494e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_1.1483087785375494e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 23.893666666666665, Max: 24.62, Min: 23.319999999999997
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.8778135945696293
Exceeding current best timeout: 23.893666666666665 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 25
Running with params: {'batchsize': 8, 'learning_rate': 0.8807780575490565, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_8_0.8807780575490565_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.859666666666666, Max: 35.42, Min: 23.61
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2462633079655545
Exceeding current best timeout: 24.859666666666666 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 26
Running with params: {'batchsize': 128, 'learning_rate': 0.000554548142374129, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_128_0.000554548142374129_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.992666666666665, Max: 35.38, Min: 23.599999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.4328070230061782
Exceeding current best timeout: 24.992666666666665 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 27
Running with params: {'batchsize': 64, 'learning_rate': 0.26062296479294855, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.26062296479294855_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 27...
Iter 28...
Timings: Avg: 24.280333333333328, Max: 34.86, Min: 23.29
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4614601757528087
Exceeding current best timeout: 24.280333333333328 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 28
Running with params: {'batchsize': 8, 'learning_rate': 0.4157006635763228, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_8_0.4157006635763228_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 23.973666666666666, Max: 24.87, Min: 23.47
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.5455844122715714
Exceeding current best timeout: 23.973666666666666 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 29
Running with params: {'batchsize': 128, 'learning_rate': 0.0006386542019640493, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_128_0.0006386542019640493_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.802333333333323, Max: 35.78, Min: 23.53
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2706396576782912
Exceeding current best timeout: 24.802333333333323 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 30
Running with params: {'batchsize': 64, 'learning_rate': 0.04180036907342522, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.04180036907342522_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 16...
Iter 15...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.40333333333333, Max: 34.99, Min: 23.48
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8201041470088386
Exceeding current best timeout: 24.40333333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 31
Running with params: {'batchsize': 8, 'learning_rate': 0.24115054374868702, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_8_0.24115054374868702_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 25.37666666666667, Max: 41.65, Min: 23.490000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 4.379310344827586
Exceeding current best timeout: 25.37666666666667 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 32
Running with params: {'batchsize': 2, 'learning_rate': 0.004514174771785742, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.004514174771785742_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.316, Max: 34.98, Min: 23.22
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 10.7863693016633
Exceeding current best timeout: 24.316 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 33
Running with params: {'batchsize': 2, 'learning_rate': 0.034238031191211674, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.034238031191211674_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.75933333333334, Max: 35.71, Min: 23.28
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6121367099516106
Exceeding current best timeout: 24.75933333333334 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 34
Running with params: {'batchsize': 8, 'learning_rate': 0.14643418732686117, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_8_0.14643418732686117_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.669333333333338, Max: 34.64, Min: 23.48
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.101775040740598
Exceeding current best timeout: 24.669333333333338 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 35
Running with params: {'batchsize': 2, 'learning_rate': 0.0214945820408243, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.0214945820408243_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.399666666666658, Max: 34.86, Min: 23.509999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.956537089650378
Exceeding current best timeout: 24.399666666666658 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 36
Running with params: {'batchsize': 128, 'learning_rate': 3.471939241535519e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_128_3.471939241535519e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 25.10933333333333, Max: 45.62, Min: 23.5
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 5.1880046231096655
Exceeding current best timeout: 25.10933333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 37
Running with params: {'batchsize': 64, 'learning_rate': 0.00024562568096341057, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.00024562568096341057_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.231999999999992, Max: 34.24, Min: 23.32
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9451432054098843
Exceeding current best timeout: 24.231999999999992 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 38
Running with params: {'batchsize': 64, 'learning_rate': 0.0810020881492532, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.0810020881492532_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 25.45233333333334, Max: 35.56, Min: 23.4
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1213856489504654
Exceeding current best timeout: 25.45233333333334 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 39
Running with params: {'batchsize': 8, 'learning_rate': 0.9089031832519558, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_8_0.9089031832519558_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.348333333333336, Max: 34.86, Min: 23.54
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.4269753291404226
Exceeding current best timeout: 24.348333333333336 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 40
Running with params: {'batchsize': 2, 'learning_rate': 0.1174352057645426, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.1174352057645426_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 24.637666666666668, Max: 34.769999999999996, Min: 23.45
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 5.2109002113510305
Exceeding current best timeout: 24.637666666666668 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 41
Running with params: {'batchsize': 128, 'learning_rate': 0.0010473190348426337, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_128_0.0010473190348426337_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.048, Max: 42.54, Min: 23.279999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4698678048165976
Exceeding current best timeout: 25.048 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 42
Running with params: {'batchsize': 2, 'learning_rate': 0.00024386001938822414, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.00024386001938822414_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 25.069999999999997, Max: 35.15, Min: 23.37
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9121356956454185
Exceeding current best timeout: 25.069999999999997 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 43
Running with params: {'batchsize': 64, 'learning_rate': 0.00343484224156537, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.00343484224156537_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.00466666666666, Max: 24.810000000000002, Min: 23.45
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.7723557632081651
Evaluating 30 values out of 30
Overall-timings: Avg: 24.00466666666666, Max: 24.810000000000002, Min: 23.45
Choosing distribution: pareto
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 24.00466666666666
Score: 24.00466666666666
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 44
Running with params: {'batchsize': 64, 'learning_rate': 0.0032693719684991373, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.0032693719684991373_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 24.347333333333335, Max: 34.98, Min: 23.52
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.7595920789836286
Exceeding current best timeout: 24.347333333333335 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 45
Running with params: {'batchsize': 64, 'learning_rate': 0.0015608307993417528, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.0015608307993417528_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 6...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.724666666666664, Max: 35.22, Min: 23.44
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.248373495854129
Exceeding current best timeout: 24.724666666666664 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 46
Running with params: {'batchsize': 2, 'learning_rate': 0.007227998419529375, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.007227998419529375_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.947333333333333, Max: 35.69, Min: 23.47
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.493131933494921
Exceeding current best timeout: 25.947333333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 47
Running with params: {'batchsize': 32, 'learning_rate': 0.45141232485086363, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_0.45141232485086363_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.333666666666673, Max: 34.51, Min: 23.35
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0278732938960249
Exceeding current best timeout: 24.333666666666673 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 48
Running with params: {'batchsize': 2, 'learning_rate': 0.019392928125549887, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.019392928125549887_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 25.548333333333336, Max: 35.800000000000004, Min: 23.49
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.6784948028973266
Evaluating 30 values out of 30
Overall-timings: Avg: 25.548333333333336, Max: 35.800000000000004, Min: 23.49
Choosing distribution: laplace
Probability of fail (non-zero): 0.13457317436459196
Exceeding max probability of failure: 0.13457317436459196
All-Passed: False
Probabilty of failure: 0.13457317436459196
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 49
Running with params: {'batchsize': 16, 'learning_rate': 0.0009263877998316306, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.0009263877998316306_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.291999999999998, Max: 34.55, Min: 23.41
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.7766084043833317
Exceeding current best timeout: 24.291999999999998 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 50
Running with params: {'batchsize': 2, 'learning_rate': 0.010372003730978007, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.010372003730978007_1
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.355999999999995, Max: 34.43, Min: 23.36
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.85043339183146
Exceeding current best timeout: 24.355999999999995 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Upto iteration 50: {'batchsize': 4, 'learning_rate': 0.00343484224156537, 'num_epochs': 0}
Optimization Iteration: 51
Running with params: {'batchsize': 32, 'learning_rate': 0.00013849436200631877, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_0.00013849436200631877_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.662666666666667, Max: 35.28, Min: 23.49
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 7.044705617543694
Exceeding current best timeout: 24.662666666666667 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 52
Running with params: {'batchsize': 16, 'learning_rate': 0.06224357807526254, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.06224357807526254_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 25.073999999999995, Max: 35.7, Min: 23.43
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0603151549330676
Exceeding current best timeout: 25.073999999999995 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 53
Running with params: {'batchsize': 64, 'learning_rate': 0.0029774098989848222, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.0029774098989848222_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.02733333333333, Max: 24.67, Min: 23.61
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.9668585475117113
Exceeding current best timeout: 24.02733333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 54
Running with params: {'batchsize': 2, 'learning_rate': 0.00037510277341398746, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.00037510277341398746_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 23.949666666666666, Max: 25.15, Min: 23.400000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0849697076980938
Exceeding current best timeout: 23.949666666666666 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 55
Running with params: {'batchsize': 64, 'learning_rate': 1.9162097928770443e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_1.9162097928770443e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.19133333333333, Max: 35.76, Min: 23.549999999999997
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.441200413620205
Exceeding current best timeout: 25.19133333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 56
Running with params: {'batchsize': 32, 'learning_rate': 0.41002191489840767, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_0.41002191489840767_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.644000000000002, Max: 34.88, Min: 23.44
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.5613588202770776
Exceeding current best timeout: 24.644000000000002 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 57
Running with params: {'batchsize': 16, 'learning_rate': 0.02298240060118363, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.02298240060118363_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 25.557666666666666, Max: 35.21, Min: 23.49
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.698997611287476
Exceeding current best timeout: 25.557666666666666 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 58
Running with params: {'batchsize': 8, 'learning_rate': 0.03469192597990436, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_8_0.03469192597990436_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.817333333333337, Max: 34.89, Min: 23.54
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.0732210721568234
Exceeding current best timeout: 24.817333333333337 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 59
Running with params: {'batchsize': 64, 'learning_rate': 0.0001622421174105075, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.0001622421174105075_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.502333333333333, Max: 34.65, Min: 23.61
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6465531717806694
Exceeding current best timeout: 24.502333333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 60
Running with params: {'batchsize': 2, 'learning_rate': 0.1638947051118675, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.1638947051118675_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.127000000000002, Max: 45.61, Min: 23.37
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0229091990708705
Exceeding current best timeout: 25.127000000000002 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 61
Running with params: {'batchsize': 64, 'learning_rate': 6.206884860271833e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_6.206884860271833e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.61433333333333, Max: 34.830000000000005, Min: 23.259999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 4.651302547095317
Exceeding current best timeout: 24.61433333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 62
Running with params: {'batchsize': 32, 'learning_rate': 0.6186542218278974, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_0.6186542218278974_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.772333333333332, Max: 34.95, Min: 23.540000000000003
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4759745886001203
Exceeding current best timeout: 24.772333333333332 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 63
Running with params: {'batchsize': 2, 'learning_rate': 0.005537510564717715, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.005537510564717715_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.68766666666667, Max: 35.370000000000005, Min: 23.57
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 6.499122451017137
Exceeding current best timeout: 24.68766666666667 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 64
Running with params: {'batchsize': 16, 'learning_rate': 0.0007421271488390447, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.0007421271488390447_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.754999999999995, Max: 35.29, Min: 23.36
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.8482204181842734
Exceeding current best timeout: 24.754999999999995 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 65
Running with params: {'batchsize': 64, 'learning_rate': 0.0019132073853079276, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.0019132073853079276_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 23.935, Max: 24.52, Min: 23.47
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4990792982914032
Exceeding current best timeout: 23.935 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 66
Running with params: {'batchsize': 2, 'learning_rate': 0.013533288857665693, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.013533288857665693_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.285, Max: 35.39, Min: 23.49
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1711574843706176
Exceeding current best timeout: 24.285 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 67
Running with params: {'batchsize': 128, 'learning_rate': 2.2111902768340103e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_128_2.2111902768340103e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.041999999999998, Max: 24.87, Min: 23.459999999999997
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.975272694226708
Exceeding current best timeout: 24.041999999999998 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 68
Running with params: {'batchsize': 128, 'learning_rate': 3.9361430286939764e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_128_3.9361430286939764e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.026333333333334, Max: 24.66, Min: 23.419999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.099121950178043
Exceeding current best timeout: 24.026333333333334 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 69
Running with params: {'batchsize': 64, 'learning_rate': 0.0004219397037016192, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.0004219397037016192_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 11...
Iter 10...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 23.912333333333333, Max: 24.72, Min: 23.61
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4669737293161473
Exceeding current best timeout: 23.912333333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 70
Running with params: {'batchsize': 64, 'learning_rate': 6.116051681445564e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_6.116051681445564e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.848000000000006, Max: 46.3, Min: 23.4
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.4393043521938148
Evaluating 30 values out of 30
Overall-timings: Avg: 25.848000000000006, Max: 46.3, Min: 23.4
Choosing distribution: laplace
Probability of fail (non-zero): 0.19864735659885563
Exceeding max probability of failure: 0.19864735659885563
All-Passed: False
Probabilty of failure: 0.19864735659885563
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 71
Running with params: {'batchsize': 64, 'learning_rate': 0.12310397069048969, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.12310397069048969_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 24.832333333333334, Max: 35.099999999999994, Min: 23.45
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5125525200965486
Exceeding current best timeout: 24.832333333333334 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 72
Running with params: {'batchsize': 32, 'learning_rate': 0.00011006091403254246, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_0.00011006091403254246_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.219000000000005, Max: 34.900000000000006, Min: 23.400000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8398275294045747
Exceeding current best timeout: 24.219000000000005 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 73
Running with params: {'batchsize': 16, 'learning_rate': 0.06613200724929233, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.06613200724929233_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.847666666666665, Max: 35.45, Min: 23.349999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3587751033419564
Exceeding current best timeout: 24.847666666666665 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 74
Running with params: {'batchsize': 16, 'learning_rate': 0.04703376070899441, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.04703376070899441_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.449, Max: 35.18, Min: 23.62
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.4649440900532826
Exceeding current best timeout: 24.449 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 75
Running with params: {'batchsize': 64, 'learning_rate': 0.0029560875155924013, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.0029560875155924013_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 9...
Iter 7...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.39100000000001, Max: 34.71, Min: 23.41
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3872581323813256
Exceeding current best timeout: 24.39100000000001 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 76
Running with params: {'batchsize': 2, 'learning_rate': 0.00041513798003964356, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.00041513798003964356_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.521999999999995, Max: 35.82, Min: 23.549999999999997
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5939969036112904
Exceeding current best timeout: 25.521999999999995 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 77
Running with params: {'batchsize': 64, 'learning_rate': 2.208129340581933e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_2.208129340581933e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.421000000000003, Max: 34.93, Min: 23.36
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.094885418918537
Exceeding current best timeout: 24.421000000000003 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 78
Running with params: {'batchsize': 64, 'learning_rate': 0.09325102445777082, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.09325102445777082_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.013333333333335, Max: 24.56, Min: 23.42
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5834538222903776
Exceeding current best timeout: 24.013333333333335 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 79
Running with params: {'batchsize': 32, 'learning_rate': 0.3836281015790185, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_0.3836281015790185_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 23.990666666666673, Max: 24.62, Min: 23.38
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9823313937959632
Exceeding current best timeout: 23.990666666666673 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 80
Running with params: {'batchsize': 16, 'learning_rate': 0.01905421218612262, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.01905421218612262_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.154666666666664, Max: 24.869999999999997, Min: 23.55
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5524091256058272
Exceeding current best timeout: 24.154666666666664 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 81
Running with params: {'batchsize': 8, 'learning_rate': 0.030913850723185716, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_8_0.030913850723185716_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 23.94133333333334, Max: 24.64, Min: 23.44
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.1273669220967557
Exceeding current best timeout: 23.94133333333334 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 82
Running with params: {'batchsize': 8, 'learning_rate': 0.007827049866815986, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_8_0.007827049866815986_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.377000000000006, Max: 34.78, Min: 23.41
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1648208067068042
Exceeding current best timeout: 24.377000000000006 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 83
Running with params: {'batchsize': 64, 'learning_rate': 0.0013455450671253782, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.0013455450671253782_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.756333333333327, Max: 35.02, Min: 23.669999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4451582791529278
Exceeding current best timeout: 24.756333333333327 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 84
Running with params: {'batchsize': 64, 'learning_rate': 0.17807304726856193, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.17807304726856193_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.141, Max: 35.31, Min: 23.509999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.353727884591421
Exceeding current best timeout: 25.141 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 85
Running with params: {'batchsize': 2, 'learning_rate': 0.004181790236949392, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.004181790236949392_1
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 23.958000000000006, Max: 24.419999999999998, Min: 23.369999999999997
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5352627692735916
Exceeding current best timeout: 23.958000000000006 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 86
Running with params: {'batchsize': 64, 'learning_rate': 1.3262239742226301e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_1.3262239742226301e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.855000000000008, Max: 34.910000000000004, Min: 23.380000000000003
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.0078585764421066
Exceeding current best timeout: 24.855000000000008 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 87
Running with params: {'batchsize': 32, 'learning_rate': 5.904793821930142e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_5.904793821930142e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.02233333333334, Max: 24.599999999999998, Min: 23.59
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3294660269038325
Exceeding current best timeout: 24.02233333333334 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 88
Running with params: {'batchsize': 32, 'learning_rate': 0.0051461339991370125, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_0.0051461339991370125_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.344999999999995, Max: 34.98, Min: 23.48
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.862745098039216
Exceeding current best timeout: 24.344999999999995 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 89
Running with params: {'batchsize': 16, 'learning_rate': 0.0007244363459661328, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.0007244363459661328_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.267666666666663, Max: 35.1, Min: 23.49
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 6.260475092762272
Exceeding current best timeout: 24.267666666666663 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 90
Running with params: {'batchsize': 16, 'learning_rate': 0.0016013049252377196, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_16_0.0016013049252377196_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 1...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.44733333333333, Max: 34.95, Min: 23.54
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.042875512181755
Exceeding current best timeout: 24.44733333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 91
Running with params: {'batchsize': 64, 'learning_rate': 0.010414592447676096, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.010414592447676096_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.694999999999997, Max: 34.989999999999995, Min: 23.48
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.7750962902735203
Exceeding current best timeout: 24.694999999999997 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 92
Running with params: {'batchsize': 2, 'learning_rate': 0.014300512684135503, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.014300512684135503_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 25.208999999999996, Max: 35.65, Min: 23.47
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.7857873415718897
Evaluating 30 values out of 30
Overall-timings: Avg: 25.208999999999996, Max: 35.65, Min: 23.47
Choosing distribution: invweibull
Probability of fail (non-zero): 0.07711437724414338
Exceeding max probability of failure: 0.07711437724414338
All-Passed: False
Probabilty of failure: 0.07711437724414338
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 93
Running with params: {'batchsize': 2, 'learning_rate': 0.24412445405308963, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_2_0.24412445405308963_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.278333333333332, Max: 35.32, Min: 23.4
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9329321334769753
Exceeding current best timeout: 24.278333333333332 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 94
Running with params: {'batchsize': 128, 'learning_rate': 2.794162938095222e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_128_2.794162938095222e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.44433333333333, Max: 34.98, Min: 23.55
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 5.965587590013046
Exceeding current best timeout: 24.44433333333333 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 95
Running with params: {'batchsize': 128, 'learning_rate': 0.0003039321576709086, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_128_0.0003039321576709086_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.716000000000005, Max: 35.05, Min: 23.48
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1816822995182839
Exceeding current best timeout: 24.716000000000005 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 96
Running with params: {'batchsize': 64, 'learning_rate': 0.00022533247908344543, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.00022533247908344543_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 23.926333333333332, Max: 24.39, Min: 23.5
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.5456406497708555
Exceeding current best timeout: 23.926333333333332 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 97
Running with params: {'batchsize': 64, 'learning_rate': 0.00018918974222281907, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.00018918974222281907_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.650999999999996, Max: 34.9, Min: 23.369999999999997
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3568010505999362
Exceeding current best timeout: 24.650999999999996 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 98
Running with params: {'batchsize': 8, 'learning_rate': 0.000925472608661916, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_8_0.000925472608661916_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 24.389000000000003, Max: 34.93, Min: 23.450000000000003
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.605156243553034
Exceeding current best timeout: 24.389000000000003 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 99
Running with params: {'batchsize': 64, 'learning_rate': 0.7254552375747452, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_64_0.7254552375747452_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 24.291999999999994, Max: 34.38999999999999, Min: 23.5
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.3989325700922275
Exceeding current best timeout: 24.291999999999994 > 8.466333333333333
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Optimization Iteration: 100
Running with params: {'batchsize': 32, 'learning_rate': 0.0001171678015557553, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597809108/assert_68511140_32_0.0001171678015557553_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 25.086666666666662, Max: 35.44, Min: 23.369999999999997
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9582667263936071
Evaluating 30 values out of 30
Overall-timings: Avg: 25.086666666666662, Max: 35.44, Min: 23.369999999999997
Choosing distribution: invweibull
Probability of fail (non-zero): 0.09576752276664229
Exceeding max probability of failure: 0.09576752276664229
All-Passed: False
Probabilty of failure: 0.09576752276664229
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 8.466333333333333
Best-param: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Upto iteration 100: {'batchsize': 4, 'learning_rate': 0.00343484224156537, 'num_epochs': 0}
Breaking...
{'batchsize': 4, 'learning_rate': 0.00343484224156537, 'num_epochs': 0}
Best score: 8.466333333333333
Repeated params: 0
Trials: 101
Best param {'batchsize': 4, 'learning_rate': 0.00343484224156537, 'num_epochs': 0}
Reduction: 0.0%
Speedup: 1.0x
Optimizer time: 3397.873741865158
