Repo: parlai
Filename: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/projects/parlai/tests/test_tra.py
ClassName: TestTransformerRanker
Testname: test_train_inline
Params: learning_rate,35,25,ParamType.LR,0.007
num_epochs,38,23,ParamType.CHAINS,4
batchsize,36,22,ParamType.CHAINS,16
Assertion: self.assertGreaterEqual(valid['hits@1'], threshold)
Original runtime: 8.478
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'learning_rate': 0.007, 'num_epochs': 4, 'batchsize': 16}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_0.007_4_16
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 13...
Iter 28...
Iter 14...
Iter 29...
Iter 15...
Timings: Avg: 6.665000000000001, Max: 8.45, Min: 6.33
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.728886452656357
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 6.6386666666666665, Max: 8.459999999999999, Min: 6.1899999999999995
Passed tests : 60
Failed tests : 0
Converged: True
Convergence score: 0.8819868811314365
Evaluating 60 values out of 60
Overall-timings: Avg: 6.6386666666666665, Max: 8.459999999999999, Min: 6.1899999999999995
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.09769815687072918
Exceeding max probability of failure: 0.09769815687072918
All-Passed: False
Probabilty of failure: 0.09769815687072918
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.4028234663852886e+38
Best-param: None
>>>!!Warning: Allowing update probability!!<<
Updating probability of failure to: 0.09769815687072918
>>Setting original runtime to 6.6386666666666665
Optimization Iteration: 1
Running with params: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.033954971559105956_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 6.770333333333335, Max: 8.84, Min: 6.47
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.89144200931021
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 6.799, Max: 8.85, Min: 6.47
Passed tests : 60
Failed tests : 0
Converged: True
Convergence score: 0.9724369191077834
Evaluating 60 values out of 60
Overall-timings: Avg: 6.799, Max: 8.85, Min: 6.47
Choosing distribution: lognorm
Probability of fail (non-zero): 0.07237715242613657
All-Passed: True
Probabilty of failure: 0.07237715242613657
Runtime: 6.799
Score: 6.799
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 2
Running with params: {'batchsize': 128, 'learning_rate': 0.03177208922276871, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_0.03177208922276871_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 11.755, Max: 12.4, Min: 8.91
Passed tests : 4
Failed tests : 26
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 3
Running with params: {'batchsize': 32, 'learning_rate': 0.00026668987360764686, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.00026668987360764686_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 3...
Iter 2...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 13...
Iter 12...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 10.910333333333334, Max: 11.180000000000001, Min: 10.620000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 4
Running with params: {'batchsize': 16, 'learning_rate': 0.5689872560419543, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.5689872560419543_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 11.925999999999998, Max: 12.319999999999999, Min: 11.680000000000001
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 5
Running with params: {'batchsize': 32, 'learning_rate': 0.22543743655968115, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.22543743655968115_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 12.968999999999998, Max: 13.48, Min: 12.64
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 6
Running with params: {'batchsize': 2, 'learning_rate': 0.006975930090832975, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.006975930090832975_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 12.443333333333332, Max: 17.02, Min: 11.969999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5788020206321027
Exceeding current best timeout: 12.443333333333332 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 7
Running with params: {'batchsize': 8, 'learning_rate': 0.002837611732599916, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_8_0.002837611732599916_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.328666666666665, Max: 12.620000000000001, Min: 11.989999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.420943896479035
Exceeding current best timeout: 12.328666666666665 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 8
Running with params: {'batchsize': 128, 'learning_rate': 0.010765962617502263, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_0.010765962617502263_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.289333333333333, Max: 12.57, Min: 12.04
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4569287935358946
Exceeding current best timeout: 12.289333333333333 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 9
Running with params: {'batchsize': 32, 'learning_rate': 0.0037891141842573244, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.0037891141842573244_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.367666666666668, Max: 12.63, Min: 12.02
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.713602101199868
Exceeding current best timeout: 12.367666666666668 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 10
Running with params: {'batchsize': 32, 'learning_rate': 0.00040314251213672316, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.00040314251213672316_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 12.407000000000002, Max: 12.75, Min: 12.219999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5418261000424993
Exceeding current best timeout: 12.407000000000002 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 11
Running with params: {'batchsize': 64, 'learning_rate': 0.04458794477544162, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.04458794477544162_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 12.267, Max: 12.64, Min: 12.02
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.8144271175498554
Exceeding current best timeout: 12.267 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 12
Running with params: {'batchsize': 64, 'learning_rate': 0.0006964945864807044, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.0006964945864807044_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.369666666666665, Max: 12.780000000000001, Min: 12.1
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9909206940116482
Evaluating 30 values out of 30
Overall-timings: Avg: 12.369666666666665, Max: 12.780000000000001, Min: 12.1
Choosing distribution: beta
Probability of fail (non-zero): 0.0026642554593310475
All-Passed: True
Probabilty of failure: 0.0026642554593310475
Runtime: 12.369666666666665
Score: 12.369666666666665
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 13
Running with params: {'batchsize': 64, 'learning_rate': 0.0003457348612615249, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.0003457348612615249_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 12.275333333333332, Max: 12.58, Min: 12.02
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3181762600207434
Exceeding current best timeout: 12.275333333333332 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 14
Running with params: {'batchsize': 2, 'learning_rate': 2.0047021446857202e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_2.0047021446857202e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.686333333333332, Max: 22.17, Min: 12.010000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5864335751835295
Exceeding current best timeout: 12.686333333333332 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 15
Running with params: {'batchsize': 16, 'learning_rate': 0.18292862304061464, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.18292862304061464_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 7...
Iter 8...
Iter 6...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.362666666666666, Max: 12.84, Min: 12.05
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.3690177073967122
Exceeding current best timeout: 12.362666666666666 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 16
Running with params: {'batchsize': 128, 'learning_rate': 0.08147054126475861, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_0.08147054126475861_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.329333333333333, Max: 12.81, Min: 12.040000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1440320333454035
Exceeding current best timeout: 12.329333333333333 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 17
Running with params: {'batchsize': 64, 'learning_rate': 0.0031878881505786817, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.0031878881505786817_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 21...
Iter 20...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.338333333333335, Max: 12.76, Min: 12.04
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.7867261412354658
Exceeding current best timeout: 12.338333333333335 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 18
Running with params: {'batchsize': 64, 'learning_rate': 0.07848381027205396, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.07848381027205396_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.468999999999998, Max: 16.99, Min: 12.09
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.7160988535869066
Exceeding current best timeout: 12.468999999999998 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 19
Running with params: {'batchsize': 64, 'learning_rate': 0.0016181445366373816, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.0016181445366373816_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.288000000000004, Max: 12.68, Min: 12.04
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9333456062030576
Evaluating 30 values out of 30
Overall-timings: Avg: 12.288000000000004, Max: 12.68, Min: 12.04
Choosing distribution: beta
Probability of fail (non-zero): 0.0016284016172222109
All-Passed: True
Probabilty of failure: 0.0016284016172222109
Runtime: 12.288000000000004
Score: 12.288000000000004
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 20
Running with params: {'batchsize': 64, 'learning_rate': 0.0015674467894648194, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.0015674467894648194_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.51, Max: 17.23, Min: 12.0
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2853503204009087
Exceeding current best timeout: 12.51 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 21
Running with params: {'batchsize': 16, 'learning_rate': 0.00010362322760669953, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.00010362322760669953_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.517666666666667, Max: 17.02, Min: 11.97
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.331251964154402
Exceeding current best timeout: 12.517666666666667 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 22
Running with params: {'batchsize': 8, 'learning_rate': 0.01690270249140228, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_8_0.01690270249140228_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 12.247666666666666, Max: 12.59, Min: 11.96
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 6.429910574805845
Exceeding current best timeout: 12.247666666666666 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 23
Running with params: {'batchsize': 16, 'learning_rate': 4.9625286676903855e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_4.9625286676903855e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.455333333333332, Max: 17.27, Min: 11.99
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3170810100966843
Exceeding current best timeout: 12.455333333333332 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 24
Running with params: {'batchsize': 16, 'learning_rate': 0.7367849783682662, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.7367849783682662_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.420666666666667, Max: 12.79, Min: 12.11
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4547696587320789
Exceeding current best timeout: 12.420666666666667 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 25
Running with params: {'batchsize': 16, 'learning_rate': 0.0013662810175529205, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.0013662810175529205_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.353333333333333, Max: 12.73, Min: 12.09
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.7860658309950288
Exceeding current best timeout: 12.353333333333333 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 26
Running with params: {'batchsize': 2, 'learning_rate': 0.0135609003276254, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.0135609003276254_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.307666666666668, Max: 12.72, Min: 12.059999999999999
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9983381791591432
Evaluating 30 values out of 30
Overall-timings: Avg: 12.307666666666668, Max: 12.72, Min: 12.059999999999999
Choosing distribution: beta
Probability of fail (non-zero): 0.006502185124273524
All-Passed: True
Probabilty of failure: 0.006502185124273524
Runtime: 12.307666666666668
Score: 12.307666666666668
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 27
Running with params: {'batchsize': 8, 'learning_rate': 1.12192350052435e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_8_1.12192350052435e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.328333333333335, Max: 12.790000000000001, Min: 12.06
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1624763874381914
Exceeding current best timeout: 12.328333333333335 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 28
Running with params: {'batchsize': 16, 'learning_rate': 0.00015951406759376766, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.00015951406759376766_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 28...
Iter 27...
Iter 29...
Timings: Avg: 12.487333333333334, Max: 17.06, Min: 12.1
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6603088392513334
Exceeding current best timeout: 12.487333333333334 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 29
Running with params: {'batchsize': 128, 'learning_rate': 0.027240162643258244, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_0.027240162643258244_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 8...
Iter 7...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.328333333333331, Max: 12.76, Min: 12.02
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.7776962271413415
Exceeding current best timeout: 12.328333333333331 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 30
Running with params: {'batchsize': 64, 'learning_rate': 0.0010364464785508388, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.0010364464785508388_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 13.120666666666665, Max: 14.020000000000001, Min: 12.6
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.398928846637828
Exceeding current best timeout: 13.120666666666665 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 31
Running with params: {'batchsize': 2, 'learning_rate': 0.0059049943401531975, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.0059049943401531975_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.91833333333333, Max: 13.43, Min: 12.48
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.043015673820994
Exceeding current best timeout: 12.91833333333333 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 32
Running with params: {'batchsize': 16, 'learning_rate': 0.24343742959086856, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.24343742959086856_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 17...
Iter 16...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 12.527666666666665, Max: 12.97, Min: 12.27
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2156468376279927
Exceeding current best timeout: 12.527666666666665 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 33
Running with params: {'batchsize': 64, 'learning_rate': 0.0361292074752996, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.0361292074752996_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 22...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 12.68633333333333, Max: 17.2, Min: 12.23
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5631111326004803
Exceeding current best timeout: 12.68633333333333 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 34
Running with params: {'batchsize': 32, 'learning_rate': 0.11761999989700121, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.11761999989700121_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 12.784333333333334, Max: 17.62, Min: 12.37
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5765056459255435
Exceeding current best timeout: 12.784333333333334 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 35
Running with params: {'batchsize': 8, 'learning_rate': 0.410411921538099, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_8_0.410411921538099_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.635, Max: 17.41, Min: 12.16
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4145850753250737
Exceeding current best timeout: 12.635 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 36
Running with params: {'batchsize': 128, 'learning_rate': 0.006845843295466519, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_0.006845843295466519_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.429666666666666, Max: 12.72, Min: 12.18
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5138251770487448
Exceeding current best timeout: 12.429666666666666 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 37
Running with params: {'batchsize': 16, 'learning_rate': 0.0006356894489295872, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.0006356894489295872_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.563, Max: 17.45, Min: 12.2
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.743429505463555
Exceeding current best timeout: 12.563 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 38
Running with params: {'batchsize': 32, 'learning_rate': 0.002374331347167768, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.002374331347167768_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 7...
Iter 8...
Iter 6...
Iter 9...
Iter 10...
Iter 12...
Iter 11...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.461333333333332, Max: 12.73, Min: 12.13
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8864844365675941
Exceeding current best timeout: 12.461333333333332 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 39
Running with params: {'batchsize': 2, 'learning_rate': 6.239875091758615e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_6.239875091758615e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 12.475999999999999, Max: 12.71, Min: 12.120000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.37973198823165
Exceeding current best timeout: 12.475999999999999 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 40
Running with params: {'batchsize': 64, 'learning_rate': 0.021578960087894877, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.021578960087894877_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.538, Max: 12.969999999999999, Min: 12.1
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.121080307310666
Exceeding current best timeout: 12.538 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 41
Running with params: {'batchsize': 8, 'learning_rate': 0.008641961325254308, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_8_0.008641961325254308_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.935000000000002, Max: 17.34, Min: 12.31
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.789619141192703
Exceeding current best timeout: 12.935000000000002 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 42
Running with params: {'batchsize': 128, 'learning_rate': 0.0002099327627412915, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_0.0002099327627412915_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.444666666666667, Max: 12.950000000000001, Min: 12.2
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2202915860545267
Exceeding current best timeout: 12.444666666666667 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 43
Running with params: {'batchsize': 32, 'learning_rate': 0.004433818557576717, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.004433818557576717_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.386000000000001, Max: 12.700000000000001, Min: 12.12
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.1540428939983047
Exceeding current best timeout: 12.386000000000001 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 44
Running with params: {'batchsize': 64, 'learning_rate': 0.060371442690771264, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.060371442690771264_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.479999999999999, Max: 12.85, Min: 12.26
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.9333456062030574
Evaluating 30 values out of 30
Overall-timings: Avg: 12.479999999999999, Max: 12.85, Min: 12.26
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.011946403802291625
All-Passed: True
Probabilty of failure: 0.011946403802291625
Runtime: 12.479999999999999
Score: 12.479999999999999
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 45
Running with params: {'batchsize': 16, 'learning_rate': 2.5311952978891135e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_2.5311952978891135e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.437000000000001, Max: 12.81, Min: 12.13
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.035526756303451
Exceeding current best timeout: 12.437000000000001 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 46
Running with params: {'batchsize': 64, 'learning_rate': 0.9906802349421726, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.9906802349421726_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 18...
Iter 17...
Iter 20...
Iter 19...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.778666666666664, Max: 17.6, Min: 12.11
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 4.970935544810229
Exceeding current best timeout: 12.778666666666664 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 47
Running with params: {'batchsize': 2, 'learning_rate': 0.0005476070933417362, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.0005476070933417362_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 22...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.738999999999999, Max: 17.569999999999997, Min: 12.239999999999998
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3242443839434606
Exceeding current best timeout: 12.738999999999999 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 48
Running with params: {'batchsize': 16, 'learning_rate': 0.15203356823346825, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.15203356823346825_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.341666666666667, Max: 12.809999999999999, Min: 12.059999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.308559806475535
Exceeding current best timeout: 12.341666666666667 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 49
Running with params: {'batchsize': 64, 'learning_rate': 0.311014105848328, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.311014105848328_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 29...
Iter 28...
Timings: Avg: 12.546666666666665, Max: 17.34, Min: 12.139999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6269784336399231
Exceeding current best timeout: 12.546666666666665 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 50
Running with params: {'batchsize': 32, 'learning_rate': 0.011250820935272016, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.011250820935272016_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 12.31733333333333, Max: 12.84, Min: 12.01
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9645451766258815
Exceeding current best timeout: 12.31733333333333 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Upto iteration 50: {'batchsize': 2, 'learning_rate': 0.033954971559105956, 'num_epochs': 3}
Optimization Iteration: 51
Running with params: {'batchsize': 128, 'learning_rate': 0.0017920362525380958, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_0.0017920362525380958_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.366999999999997, Max: 12.87, Min: 12.069999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.668550777368822
Exceeding current best timeout: 12.366999999999997 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 52
Running with params: {'batchsize': 8, 'learning_rate': 0.0003629877102481278, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_8_0.0003629877102481278_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.318666666666669, Max: 12.65, Min: 12.11
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2218898672960306
Exceeding current best timeout: 12.318666666666669 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 53
Running with params: {'batchsize': 16, 'learning_rate': 0.0464892717589074, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.0464892717589074_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.635666666666664, Max: 17.53, Min: 12.09
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6367362913875314
Exceeding current best timeout: 12.635666666666664 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 54
Running with params: {'batchsize': 64, 'learning_rate': 0.0009287321281088033, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.0009287321281088033_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 19...
Iter 18...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.396333333333333, Max: 12.93, Min: 12.0
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2630095274240696
Exceeding current best timeout: 12.396333333333333 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 55
Running with params: {'batchsize': 16, 'learning_rate': 0.002843446579884021, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.002843446579884021_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 12.329666666666666, Max: 12.600000000000001, Min: 12.02
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.5587717057091917
Exceeding current best timeout: 12.329666666666666 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 56
Running with params: {'batchsize': 2, 'learning_rate': 0.018535788739379215, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.018535788739379215_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.408333333333333, Max: 12.61, Min: 12.12
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6666666666666685
Exceeding current best timeout: 12.408333333333333 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 57
Running with params: {'batchsize': 64, 'learning_rate': 0.004624125512578494, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.004624125512578494_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.33, Max: 12.8, Min: 12.03
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.7569606411498433
Exceeding current best timeout: 12.33 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 58
Running with params: {'batchsize': 16, 'learning_rate': 9.422991644590547e-05, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_9.422991644590547e-05_None
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.310333333333338, Max: 12.79, Min: 12.01
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.766950246962401
Exceeding current best timeout: 12.310333333333338 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 59
Running with params: {'batchsize': 128, 'learning_rate': 0.09506764133027225, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_0.09506764133027225_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.355666666666666, Max: 12.83, Min: 12.0
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.6853803465494046
Exceeding current best timeout: 12.355666666666666 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 60
Running with params: {'batchsize': 8, 'learning_rate': 0.5114130071968498, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_8_0.5114130071968498_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.238666666666667, Max: 12.48, Min: 12.059999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.4009801919951204
Exceeding current best timeout: 12.238666666666667 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 61
Running with params: {'batchsize': 32, 'learning_rate': 0.00021263809972083176, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.00021263809972083176_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.293666666666665, Max: 12.64, Min: 12.04
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1551804210709502
Exceeding current best timeout: 12.293666666666665 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 62
Running with params: {'batchsize': 64, 'learning_rate': 0.032685788780526304, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.032685788780526304_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 25...
Iter 24...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.836666666666666, Max: 17.560000000000002, Min: 12.17
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.238693032901521
Exceeding current best timeout: 12.836666666666666 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 63
Running with params: {'batchsize': 16, 'learning_rate': 0.00923422512750873, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.00923422512750873_4
Launching 30 jobs, 30 in parallel
Iter 1...
Iter 0...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 27...
Iter 28...
Timings: Avg: 12.384000000000002, Max: 12.67, Min: 12.03
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 5.095238095238097
Exceeding current best timeout: 12.384000000000002 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 64
Running with params: {'batchsize': 2, 'learning_rate': 2.9937066285753817e-05, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_2.9937066285753817e-05_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.305333333333332, Max: 12.76, Min: 12.04
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9605521095344896
Exceeding current best timeout: 12.305333333333332 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 65
Running with params: {'batchsize': 64, 'learning_rate': 0.05331476331113685, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.05331476331113685_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.541, Max: 17.12, Min: 12.11
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9810261197255685
Exceeding current best timeout: 12.541 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 66
Running with params: {'batchsize': 2, 'learning_rate': 0.011648548737697382, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.011648548737697382_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.321666666666665, Max: 12.76, Min: 12.04
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8585652919125746
Exceeding current best timeout: 12.321666666666665 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 67
Running with params: {'batchsize': 2, 'learning_rate': 0.0021302610730604965, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.0021302610730604965_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 28...
Iter 29...
Iter 27...
Timings: Avg: 12.358666666666666, Max: 12.68, Min: 12.04
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.7422619545876457
Exceeding current best timeout: 12.358666666666666 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 68
Running with params: {'batchsize': 2, 'learning_rate': 0.01688748212523721, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.01688748212523721_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.309999999999997, Max: 12.690000000000001, Min: 12.040000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.050611118538947
Exceeding current best timeout: 12.309999999999997 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 69
Running with params: {'batchsize': 2, 'learning_rate': 0.0038990848607704954, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.0038990848607704954_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 12.563333333333334, Max: 17.520000000000003, Min: 12.13
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.811107105653812
Evaluating 30 values out of 30
Overall-timings: Avg: 12.563333333333334, Max: 17.520000000000003, Min: 12.13
Choosing distribution: gumbel_l
Probability of fail (non-zero): 0.031204752856642416
All-Passed: True
Probabilty of failure: 0.031204752856642416
Runtime: 12.563333333333334
Score: 12.563333333333334
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 70
Running with params: {'batchsize': 2, 'learning_rate': 0.0014317854211262806, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.0014317854211262806_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.324999999999998, Max: 12.65, Min: 11.97
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9606142569263376
Exceeding current best timeout: 12.324999999999998 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 71
Running with params: {'batchsize': 2, 'learning_rate': 0.0008950547932740044, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.0008950547932740044_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.515666666666668, Max: 17.71, Min: 12.07
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.416247083955436
Exceeding current best timeout: 12.515666666666668 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 72
Running with params: {'batchsize': 16, 'learning_rate': 0.005471766336286828, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.005471766336286828_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.437999999999999, Max: 17.22, Min: 12.02
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.2412738898265856
Exceeding current best timeout: 12.437999999999999 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 73
Running with params: {'batchsize': 128, 'learning_rate': 0.0004935498458508026, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_0.0004935498458508026_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.477666666666666, Max: 17.11, Min: 12.05
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 4.062019202317977
Exceeding current best timeout: 12.477666666666666 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 74
Running with params: {'batchsize': 8, 'learning_rate': 0.013744137469987571, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_8_0.013744137469987571_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.360333333333335, Max: 12.58, Min: 12.030000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.542062342942897
Exceeding current best timeout: 12.360333333333335 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 75
Running with params: {'batchsize': 32, 'learning_rate': 0.02403574634658367, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.02403574634658367_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.792, Max: 17.7, Min: 12.350000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6188544268007607
Exceeding current best timeout: 12.792 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 76
Running with params: {'batchsize': 64, 'learning_rate': 0.06737597738029433, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.06737597738029433_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 24...
Iter 23...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.641333333333334, Max: 17.349999999999998, Min: 12.23
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.6158742325254636
Exceeding current best timeout: 12.641333333333334 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 77
Running with params: {'batchsize': 2, 'learning_rate': 0.09512061151644659, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.09512061151644659_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.665333333333331, Max: 21.720000000000002, Min: 12.1
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5332716019894341
Exceeding current best timeout: 12.665333333333331 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 78
Running with params: {'batchsize': 16, 'learning_rate': 0.14659039040350694, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.14659039040350694_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.488666666666665, Max: 17.11, Min: 11.969999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4313052827006179
Exceeding current best timeout: 12.488666666666665 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 79
Running with params: {'batchsize': 64, 'learning_rate': 0.007285196324284711, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.007285196324284711_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.46466666666667, Max: 17.05, Min: 12.040000000000001
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8494579475204738
Exceeding current best timeout: 12.46466666666667 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 80
Running with params: {'batchsize': 16, 'learning_rate': 0.2411958819084952, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.2411958819084952_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.476333333333333, Max: 17.0, Min: 12.09
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.9174124721184236
Exceeding current best timeout: 12.476333333333333 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 81
Running with params: {'batchsize': 2, 'learning_rate': 0.03806107774890527, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.03806107774890527_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.561666666666666, Max: 17.16, Min: 12.010000000000002
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.5135734673828884
Exceeding current best timeout: 12.561666666666666 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 82
Running with params: {'batchsize': 128, 'learning_rate': 0.001159853946609997, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_0.001159853946609997_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.316333333333334, Max: 12.57, Min: 11.95
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5523646690046053
Exceeding current best timeout: 12.316333333333334 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 83
Running with params: {'batchsize': 8, 'learning_rate': 0.0031705023693234637, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_8_0.0031705023693234637_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.328666666666665, Max: 12.83, Min: 12.01
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.2544074479065404
Exceeding current best timeout: 12.328666666666665 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 84
Running with params: {'batchsize': 32, 'learning_rate': 0.00027233084164043914, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.00027233084164043914_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Iter 22...
Timings: Avg: 12.322666666666667, Max: 12.59, Min: 12.08
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.544956105607112
Exceeding current best timeout: 12.322666666666667 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 85
Running with params: {'batchsize': 64, 'learning_rate': 0.0022339867176669756, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.0022339867176669756_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.692666666666668, Max: 17.25, Min: 12.059999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.794151081205198
Exceeding current best timeout: 12.692666666666668 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 86
Running with params: {'batchsize': 16, 'learning_rate': 0.7495098839240936, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.7495098839240936_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.757666666666665, Max: 17.31, Min: 12.12
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8257418583505522
Exceeding current best timeout: 12.757666666666665 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 87
Running with params: {'batchsize': 2, 'learning_rate': 0.0077276511363623245, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.0077276511363623245_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 7...
Iter 6...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.515333333333333, Max: 17.31, Min: 12.09
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.3608276348795458
Exceeding current best timeout: 12.515333333333333 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 88
Running with params: {'batchsize': 64, 'learning_rate': 0.026078269944940863, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.026078269944940863_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.305, Max: 12.639999999999999, Min: 12.1
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.8552679320224104
Exceeding current best timeout: 12.305 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 89
Running with params: {'batchsize': 16, 'learning_rate': 0.0007063181599152093, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.0007063181599152093_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 27...
Iter 26...
Iter 28...
Iter 29...
Timings: Avg: 12.453333333333335, Max: 16.98, Min: 11.99
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 6.1472611686649765
Exceeding current best timeout: 12.453333333333335 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 90
Running with params: {'batchsize': 128, 'learning_rate': 0.18349308430559247, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_0.18349308430559247_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.485999999999999, Max: 17.34, Min: 11.98
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.0757692549540332
Exceeding current best timeout: 12.485999999999999 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 91
Running with params: {'batchsize': 8, 'learning_rate': 0.0001281791999697615, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_8_0.0001281791999697615_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.290999999999999, Max: 12.53, Min: 11.94
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.240370349203925
Exceeding current best timeout: 12.290999999999999 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 92
Running with params: {'batchsize': 32, 'learning_rate': 0.01338055650258499, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_32_0.01338055650258499_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.361333333333334, Max: 12.639999999999999, Min: 12.059999999999999
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.7778153825492109
Evaluating 30 values out of 30
Overall-timings: Avg: 12.361333333333334, Max: 12.639999999999999, Min: 12.059999999999999
Choosing distribution: beta
Probability of fail : 0.0
All-Passed: True
Probabilty of failure: 0.0
Runtime: 12.361333333333334
Score: 12.361333333333334
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 93
Running with params: {'batchsize': 64, 'learning_rate': 0.005443604104326989, 'num_epochs': 1}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.005443604104326989_1
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.257333333333332, Max: 12.57, Min: 12.04
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.0000000000000044
Exceeding current best timeout: 12.257333333333332 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 94
Running with params: {'batchsize': 16, 'learning_rate': 1.3481857509819564e-05, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_1.3481857509819564e-05_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 12.259333333333334, Max: 12.56, Min: 12.069999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4347005815691527
Exceeding current best timeout: 12.259333333333334 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 95
Running with params: {'batchsize': 2, 'learning_rate': 0.04016249659900367, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.04016249659900367_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.306000000000001, Max: 12.55, Min: 12.0
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.1253693913143001
Exceeding current best timeout: 12.306000000000001 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 96
Running with params: {'batchsize': 64, 'learning_rate': 0.3296760542717726, 'num_epochs': None}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_64_0.3296760542717726_None
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 15...
Iter 14...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 29...
Iter 28...
Iter 27...
Timings: Avg: 12.412666666666668, Max: 12.860000000000001, Min: 12.06
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 2.506513254633246
Exceeding current best timeout: 12.412666666666668 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 97
Running with params: {'batchsize': 16, 'learning_rate': 0.001630027715455315, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_16_0.001630027715455315_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.278999999999998, Max: 12.52, Min: 12.049999999999999
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 3.192347537870489
Exceeding current best timeout: 12.278999999999998 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 98
Running with params: {'batchsize': 2, 'learning_rate': 0.015394368996229545, 'num_epochs': 3}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_2_0.015394368996229545_3
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.555333333333333, Max: 17.28, Min: 12.079999999999998
Passed tests : 30
Failed tests : 0
Converged: True
Convergence score: 0.978145723164584
Evaluating 30 values out of 30
Overall-timings: Avg: 12.555333333333333, Max: 17.28, Min: 12.079999999999998
Choosing distribution: beta
Probability of fail (non-zero): 0.08382393102082031
All-Passed: True
Probabilty of failure: 0.08382393102082031
Runtime: 12.555333333333333
Score: 12.555333333333333
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 99
Running with params: {'batchsize': 128, 'learning_rate': 6.403495948443738e-05, 'num_epochs': 4}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_128_6.403495948443738e-05_4
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 26...
Iter 25...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.323666666666668, Max: 12.5, Min: 12.12
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.4126070486631424
Exceeding current best timeout: 12.323666666666668 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Optimization Iteration: 100
Running with params: {'batchsize': 8, 'learning_rate': 0.009763030550162822, 'num_epochs': 2}
Logdir: /mnt/batch/tasks/workitems/opt1parlai/job-1/Task_parlai/wd/borntobeflaky/tool/logs/optim_1597802798_parlai/run_1597802798/assert_14446807_8_0.009763030550162822_2
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 12.291333333333332, Max: 12.540000000000001, Min: 11.93
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 1.5579616754090393
Exceeding current best timeout: 12.291333333333332 > 6.6386666666666665
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 6.799
Best-param: {'batchsize': 16, 'learning_rate': 0.033954971559105956, 'num_epochs': 4}
Upto iteration 100: {'batchsize': 2, 'learning_rate': 0.033954971559105956, 'num_epochs': 3}
Breaking...
{'batchsize': 2, 'learning_rate': 0.033954971559105956, 'num_epochs': 3}
Best score: 6.799
Repeated params: 0
Trials: 101
Best param {'batchsize': 2, 'learning_rate': 0.033954971559105956, 'num_epochs': 3}
Reduction: 0.0%
Speedup: 1.0x
Optimizer time: 1485.3534443378448
