The Artifact of the ICSE2023 Submission #582

In this online repository, we release the source code of each of the selected techniques as well as the experiment results from each technique (which are stored in the Results.zip file).

The code to calculate the evaluation metrics are reused from CodeBLEU.

Below is a piece of code generated by CodeT5. In this case, CodeT5 generates a statement recurrently, which leads to the syntactic error. Despite that, the code itself fulfills certain functionalities, and that is why it can achieve a CodeBLEU of 24.9%.

def makeMimiLocal(filename):
    try:
        with open(filename, 'rb') as f:
            data = f.read()
    except IOError:
        data = b''
    data = data.decode('utf-8')
    data = data.replace(b'\x00', b'\x00')
    data = data.replace(b'\x00', b'\x00')
    data = data.replace(b'\x00', b'\x00')
    data = data.replace(b'\x00', b'\x00')
    data = data.replace(b'\x00', b'\x00')
    data = data.replace(b'\x00', b'\x00')
    data = data.replace(b'\x00', b'\x00')
    data = data.replace(b'\x00', b'\x00')
    data = data.replace(b'\x00', b'\x00')
    data = data.replace(b'\x00', b'\x00')
    data = data.replace(b'\