Repo: cleverhans
Filename: /mnt/batch/tasks/workitems/opt1/job-1/Task_cleverhans/wd/borntobeflaky/projects/cleverhans/cleverhans/future/torch/tests/test_attacks.py
ClassName: TestSPSA
Testname: test_attack_strength
Params: nb_iter,422,42,ParamType.ITER,20
Assertion: self.assertLess(adv_acc, .1)
Original runtime: 3.08
>>Getting original runtime
Optimization Iteration: 1
Running with params: {'nb_iter': 20}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_cleverhans/wd/borntobeflaky/tool/logs/optim_1597614539_cleverhans/run_1597614763/assert_80172875_20
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 3.287666666666666, Max: 3.57, Min: 3.17
Passed tests : 30
Failed tests : 0
Converged: False
Convergence score: 4.225771273642583
Continuing to next batch...
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 3.2836666666666665, Max: 3.57, Min: 3.17
Passed tests : 60
Failed tests : 0
Converged: True
Convergence score: 0.7809367573621276
Evaluating 60 values out of 60
Overall-timings: Avg: 3.2836666666666665, Max: 3.57, Min: 3.17
Choosing distribution: laplace
Probability of fail (non-zero): 0.0004541192641045466
All-Passed: True
Probabilty of failure: 0.0004541192641045466
Runtime: 3.2836666666666665
Score: 3.2836666666666665
Best-score: 3.2836666666666665
Best-param: {'nb_iter': 20}
>>Setting original runtime to 3.2836666666666665
Optimization Iteration: 1
Running with params: {'nb_iter': 10}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_cleverhans/wd/borntobeflaky/tool/logs/optim_1597614539_cleverhans/run_1597614763/assert_80172875_10
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 29...
Iter 28...
Timings: Avg: 2.614, Max: 2.6700000000000004, Min: 2.49
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.2836666666666665
Best-param: {'nb_iter': 20}
Optimization Iteration: 2
Running with params: {'nb_iter': 10}
Optimization Iteration: 3
Running with params: {'nb_iter': 0}
Logdir: /mnt/batch/tasks/workitems/opt1/job-1/Task_cleverhans/wd/borntobeflaky/tool/logs/optim_1597614539_cleverhans/run_1597614763/assert_80172875_0
Launching 30 jobs, 30 in parallel
Iter 0...
Iter 1...
Iter 2...
Iter 3...
Iter 4...
Iter 5...
Iter 6...
Iter 7...
Iter 8...
Iter 9...
Iter 10...
Iter 11...
Iter 12...
Iter 13...
Iter 14...
Iter 15...
Iter 16...
Iter 17...
Iter 18...
Iter 19...
Iter 20...
Iter 21...
Iter 22...
Iter 23...
Iter 24...
Iter 25...
Iter 26...
Iter 27...
Iter 28...
Iter 29...
Timings: Avg: 1.8189999999999997, Max: 1.85, Min: 1.74
Passed tests : 0
Failed tests : 30
Half of samples failed, exiting...
All-Passed: False
Probabilty of failure: 1.0
Runtime: 10000.0
Score: 3.4028234663852886e+38
Best-score: 3.2836666666666665
Best-param: {'nb_iter': 20}
Optimization Iteration: 4
Running with params: {'nb_iter': 0}
Optimization Iteration: 5
Running with params: {'nb_iter': 10}
Optimization Iteration: 6
Running with params: {'nb_iter': 0}
Optimization Iteration: 7
Running with params: {'nb_iter': 0}
Optimization Iteration: 8
Running with params: {'nb_iter': 10}
Optimization Iteration: 9
Running with params: {'nb_iter': 0}
Optimization Iteration: 10
Running with params: {'nb_iter': 10}
Optimization Iteration: 11
Running with params: {'nb_iter': 0}
Optimization Iteration: 12
Running with params: {'nb_iter': 10}
Optimization Iteration: 13
Running with params: {'nb_iter': 0}
Optimization Iteration: 14
Running with params: {'nb_iter': 10}
Optimization Iteration: 15
Running with params: {'nb_iter': 10}
Optimization Iteration: 16
Running with params: {'nb_iter': 0}
Optimization Iteration: 17
Running with params: {'nb_iter': 0}
Optimization Iteration: 18
Running with params: {'nb_iter': 20}
Optimization Iteration: 19
Running with params: {'nb_iter': 10}
Optimization Iteration: 20
Running with params: {'nb_iter': 0}
Optimization Iteration: 21
Running with params: {'nb_iter': 10}
Optimization Iteration: 22
Running with params: {'nb_iter': 20}
Optimization Iteration: 23
Running with params: {'nb_iter': 20}
Optimization Iteration: 24
Running with params: {'nb_iter': 20}
Optimization Iteration: 25
Running with params: {'nb_iter': 20}
Optimization Iteration: 26
Running with params: {'nb_iter': 20}
Optimization Iteration: 27
Running with params: {'nb_iter': 20}
Optimization Iteration: 28
Running with params: {'nb_iter': 20}
Optimization Iteration: 29
Running with params: {'nb_iter': 20}
Optimization Iteration: 30
Running with params: {'nb_iter': 20}
Optimization Iteration: 31
Running with params: {'nb_iter': 10}
Optimization Iteration: 32
Running with params: {'nb_iter': 0}
Optimization Iteration: 33
Running with params: {'nb_iter': 10}
Optimization Iteration: 34
Running with params: {'nb_iter': 10}
Optimization Iteration: 35
Running with params: {'nb_iter': 0}
Optimization Iteration: 36
Running with params: {'nb_iter': 0}
Optimization Iteration: 37
Running with params: {'nb_iter': 10}
Optimization Iteration: 38
Running with params: {'nb_iter': 0}
Optimization Iteration: 39
Running with params: {'nb_iter': 20}
Optimization Iteration: 40
Running with params: {'nb_iter': 10}
Optimization Iteration: 41
Running with params: {'nb_iter': 0}
Optimization Iteration: 42
Running with params: {'nb_iter': 0}
Optimization Iteration: 43
Running with params: {'nb_iter': 10}
Optimization Iteration: 44
Running with params: {'nb_iter': 10}
Optimization Iteration: 45
Running with params: {'nb_iter': 0}
Optimization Iteration: 46
Running with params: {'nb_iter': 20}
Optimization Iteration: 47
Running with params: {'nb_iter': 0}
Optimization Iteration: 48
Running with params: {'nb_iter': 10}
Optimization Iteration: 49
Running with params: {'nb_iter': 0}
Optimization Iteration: 50
Running with params: {'nb_iter': 10}
Upto iteration 50: {'nb_iter': 20.0}
Optimization Iteration: 51
Running with params: {'nb_iter': 0}
Optimization Iteration: 52
Running with params: {'nb_iter': 20}
Optimization Iteration: 53
Running with params: {'nb_iter': 10}
Optimization Iteration: 54
Running with params: {'nb_iter': 0}
Optimization Iteration: 55
Running with params: {'nb_iter': 20}
Optimization Iteration: 56
Running with params: {'nb_iter': 10}
Optimization Iteration: 57
Running with params: {'nb_iter': 0}
Optimization Iteration: 58
Running with params: {'nb_iter': 20}
Optimization Iteration: 59
Running with params: {'nb_iter': 0}
Optimization Iteration: 60
Running with params: {'nb_iter': 10}
Optimization Iteration: 61
Running with params: {'nb_iter': 10}
Optimization Iteration: 62
Running with params: {'nb_iter': 20}
Optimization Iteration: 63
Running with params: {'nb_iter': 0}
Optimization Iteration: 64
Running with params: {'nb_iter': 10}
Optimization Iteration: 65
Running with params: {'nb_iter': 20}
Optimization Iteration: 66
Running with params: {'nb_iter': 20}
Optimization Iteration: 67
Running with params: {'nb_iter': 20}
Optimization Iteration: 68
Running with params: {'nb_iter': 20}
Optimization Iteration: 69
Running with params: {'nb_iter': 20}
Optimization Iteration: 70
Running with params: {'nb_iter': 20}
Optimization Iteration: 71
Running with params: {'nb_iter': 10}
Optimization Iteration: 72
Running with params: {'nb_iter': 20}
Optimization Iteration: 73
Running with params: {'nb_iter': 10}
Optimization Iteration: 74
Running with params: {'nb_iter': 20}
Optimization Iteration: 75
Running with params: {'nb_iter': 10}
Optimization Iteration: 76
Running with params: {'nb_iter': 10}
Optimization Iteration: 77
Running with params: {'nb_iter': 20}
Optimization Iteration: 78
Running with params: {'nb_iter': 10}
Optimization Iteration: 79
Running with params: {'nb_iter': 20}
Optimization Iteration: 80
Running with params: {'nb_iter': 10}
Optimization Iteration: 81
Running with params: {'nb_iter': 20}
Optimization Iteration: 82
Running with params: {'nb_iter': 0}
Optimization Iteration: 83
Running with params: {'nb_iter': 20}
Optimization Iteration: 84
Running with params: {'nb_iter': 10}
Optimization Iteration: 85
Running with params: {'nb_iter': 0}
Optimization Iteration: 86
Running with params: {'nb_iter': 10}
Optimization Iteration: 87
Running with params: {'nb_iter': 10}
Optimization Iteration: 88
Running with params: {'nb_iter': 0}
Optimization Iteration: 89
Running with params: {'nb_iter': 20}
Optimization Iteration: 90
Running with params: {'nb_iter': 0}
Optimization Iteration: 91
Running with params: {'nb_iter': 10}
Optimization Iteration: 92
Running with params: {'nb_iter': 20}
Optimization Iteration: 93
Running with params: {'nb_iter': 0}
Optimization Iteration: 94
Running with params: {'nb_iter': 10}
Optimization Iteration: 95
Running with params: {'nb_iter': 20}
Optimization Iteration: 96
Running with params: {'nb_iter': 0}
Optimization Iteration: 97
Running with params: {'nb_iter': 10}
Optimization Iteration: 98
Running with params: {'nb_iter': 10}
Optimization Iteration: 99
Running with params: {'nb_iter': 20}
Optimization Iteration: 100
Running with params: {'nb_iter': 20}
Upto iteration 100: {'nb_iter': 20.0}
Breaking...
{'nb_iter': 20.0}
Best score: 3.2836666666666665
Repeated params: 98
Trials: 101
Best param {'nb_iter': 20.0}
Reduction: 0.0%
Speedup: 1.0x
Optimizer time: 13.179032325744629
