Software Open Access

Replication Artifact for TOGA: A Neural Method for Test Oracle Generation

Elizabeth Dinella; Gabriel Ryan; Shuvendu K. Lahiri; Todd Mytkowicz

This repository contains the replication artifact for TOGA: A Neural Method for Test Oracle Generation to appear in ICSE 2022.

Testing is widely recognized as an important stage of the softwaredevelopment lifecycle. Effective software testing can provide benefits such as documentation, bug finding, and preventing regressions. In particular, unit tests document a unit’s intended functionality. A test oracle, typically expressed as an condition, documents the intended behavior of the unit under a given test prefix. Synthesizing a functional test oracle is a challenging problem, as it has to capture the intended functionality and not the implemented functionality. In our paper, we propose TOGA (Test Oracle GenerAtion), a unified transformer-based neural approach to infer both exceptional and assertion test oracles based on the context of the focal method.

Our artifact reproduces the results for all RQs in the paper's evaluation. The artifact includes source code and download links for datasets and models produced in the paper, fulfilling the requirements for reproduced, resuable, and available badges. We assume basic unix familiarity and ability to run python. Our artifact is given as a docker image for linux.

Note: For convenience, we provide a self-contained docker image to reproduce all results without any setup. We recommend using this to reproduce the results in the paper. See directions for using the docker image in the README.

Files (13.4 GB)
Name Size
artifact_documents.zip
md5:662705b2505d6640cbeba4021240848c
6.2 kB Download
assertion_model.bin.gz
md5:e2779e7350964162ba8f6767ddd0bdc5
462.8 MB Download
exception_model.bin.gz
md5:5c604e2ff849dc06675adb8964c0f0e2
462.8 MB Download
README.md
md5:ce39542b38a5f2c330e712c54e227df3
12.1 kB Download
toga.tar.gz
md5:f8aceb9404871f59b3d3fdc86d73fd5d
576.4 MB Download
toga_docker.tar.gz.part-aa
md5:4fe9a5cc7fe0c88c58227d1e01ab83ea
2.1 GB Download
toga_docker.tar.gz.part-ab
md5:cade55247b79cdab97d7a325e81af6c5
2.1 GB Download
toga_docker.tar.gz.part-ac
md5:de0c4be265f4b74e366c2868af91c7a9
2.1 GB Download
toga_docker.tar.gz.part-ad
md5:942d79171209f7ee14ab8fea748cd990
2.1 GB Download
toga_docker.tar.gz.part-ae
md5:0ab9dd6b8f1536d7c03a67dbd31e7be8
2.1 GB Download
toga_docker.tar.gz.part-af
md5:52c364a250b453860b2d639079ac29e7
1.2 GB Download
170
36
views
downloads
All versions This version
Views 17023
Downloads 364
Data volume 23.3 GB1.4 GB
Unique views 12521
Unique downloads 204

Share

Cite as