Published March 17, 2025 | Version https://github.com/2ral/Modelizer

Revised evaluation artifact for the Modelizer framework described in "Learning Program Behavioral Models from Synthesized Input-Output Pairs"

  • 1. ROR icon Helmholtz Center for Information Security

Contributors

Contact person:

  • 1. ROR icon Helmholtz Center for Information Security

Description

This package contains the revised evaluation artifact for Modelizer - a framework for learning models from BlackBox systems using Input-Output examples.

It consists of the following zip archives:

  1. train.zip: synthetic data used for the model training
  2. test.zip: synthetic and extracted real data used for the model evaluation 
  3. eval.zip: evaluation results (experiment results and notebooks with the analysis of the results)
  4. eval_llm.zip: evaluation results for experiments with LLMs
  5. models.zip: all the models that were trained during the experiments
  6. llm_fine_tuned_models.zip: weights of fine-tuned the LLMs
  7. llm.zip: subset of training data for experiments with LLMs
  8. plots.zip: plots of the evaluation results and code to generate them

You can find the framework implementation and usage instructions at https://github.com/2ral/Modelizer

Files

eval.zip

Files (43.3 GB)

Name Size
md5:64a22a0292161fcafd45396ec14f7dff
287.1 MB Preview Download
md5:9b2d51d14bcee1ff7599dbf334e94a52
47.3 MB Preview Download
md5:5a3db431b9fdd0c3c3bf501f90ab9b49
94.8 MB Preview Download
md5:cc2b4840f8fea1b6579269d312962c84
16.1 GB Preview Download
md5:ab5ca39daddc1b3ca021ec1cab34bcb7
19.5 GB Preview Download
md5:8c02b802b63f12652adbed22596d1bda
22.0 MB Preview Download
md5:cd83ffcc5f3c6033a2e2cda35f1549be
127.7 MB Preview Download
md5:63fde54d93f0f6c6199188ce8c44e868
7.1 GB Preview Download

Additional details

Related works

Is supplement to
Software: 10.1145/3748720 (DOI)

Funding

European Commission
S3 - Semantics of Software Systems 101093186

Dates

Available
2025-03-17

Software

Repository URL
https://github.com/2ral/Modelizer/
Programming language
Python
Development Status
Active

References

  • Modelizer