One Step Further: Evaluating Interpreters Using Metamorphic Testing
Authors/Creators
Description
This holds the codes and experiment results for the paper "One Step Further: Evaluating Interpreters Using Metamorphic Testing" submitted to ISSTA 2022.
The related codes and models are also released on GitHub https://github.com/BLINKSK/Metamorphic-Testing-for-Interpretation-Methods. Users can generate metamorphic images in the custom dataset and test the interpreters.
Due to upload speed limitations, we only uploaded some metamorphic images in the package "delete_object" and info of ground_truth_bounding_box in the package "ground_truth_bounding_box".
For the same reason, the upload of interpretation results is very slow and often arise error. We only uploaded a part of Grad-CAM in the package "Grad-CAM". We have uploaded more results in Google Drive https://drive.google.com/drive/folders/1e1A1wNxLuzhEf7bczSiqveV1oeWJL-j2?usp=sharing.
We will collate and upload more results soon, and please pay attention to the new version. Note that our experimental results and statistics are performed on all data, but the data here is only a part of the display.