Published August 18, 2023 | Version 1.1
Dataset Open

Simulated datasets for detector and particle flow reconstruction: CLIC detector

Description

Data description

Datasets generated using Key4HEP and the CLIC detector model suitable for particle flow reconstruction studies.

The datasets contain generator particles, reconstructed tracks and calorimeter hits, reconstructed Pandora PF particles and their respective links in the EDM4HEP format.

The following processes have been simulated with Pythia 8:

  • p8_ee_tt_ecm380: ee -> ttbar, center of mass energy at 380 GeV
  • p8_ee_qq_ecm380: ee -> Z* -> qqbar, center of mass energy at 380 GeV
  • p8_ee_ZH_Htautau: ee -> ZH -> Higgs decaying to tau leptons, center of mass energy at 380 GeV
  • p8_ee_WW_fullhad: ee -> WW -> W decaying hadronically, center of mass energy at 380 GeV
  • p8_ee_tt_ecm380_PU10: ee -> ttbar with on average 10 Poisson-distributed events from ee->gg overlayed, center of mass energy at 380 GeV

The following single particle gun samples have been generated with ddsim:

  • e+/e-: single electron with energy between 1 and 100 GeV
  • mu+/mu-: single muon with energy between 1 and 100 GeV
  • kaon0L: single K0L with energy between 1 and 100 GeV
  • neutron: single neutron with energy between 1 and 100 GeV
  • pi+/pi-: single charged pion with energy between 1 and 100 GeV
  • pi0: single neutral pion with energy between 1 and 100 GeV
  • gamma: single photon with energy between 1 and 100 GeV

The detector simulation has been done with Geant4, the reconstruction with Marlin interfaced via Key4HEP which includes PF reconstruction with Pandora, all using publicly available models and code.

 

Contents

This record includes the following files:

  • *_10files.tar: small archives of 10 files for each data sample, suitable for testing
  • dataset_full.txt: the full list of files, hosted at the Julich HPC courtesy of the Raise CoE project, ~2.5TB total
  • *.cmd: the Pythia8 cards
  • pythia.py: the pythia steering code for Key4HEP
  • run_sim.sh: the steering script for generating, simulating and reconstructing a single file of 100 events from the p8_ee_tt_ecm380, p8_ee_qq_ecm380, p8_ee_ZH_Htautau, p8_ee_WW_fullhad datasets
  • run_sim_pu.sh: the steering script for generating, simulating and reconstructing a single file of 100 events from the p8_ee_tt_ecm380_PU10 dataset
  • run_sim_gun.sh: the steering script for generating the single-particle gun samples
  • run_sim_gun_np.sh: the steering script for generating multi-particle gun samples (extensive datasets have not yet been generated)
  • check_files.py: the main driver script that configures the full statistics and creates submission scripts for all the simulations
  • PandoraSettings.zip: the settings used for Pandora PF reconstruction
  • main19.cc: the Pythia8+HepMC driver code for generating the events with PU overlay
  • clicRec_e4h_input.py: the steering configuration of the reconstruction modules in Key4HEP
  • clic_steer.py: the steering configuration of the Geant4 simulation modules in Key4HEP
  • clic-visualize.ipynb: an example notebook demonstrating how the dataset can be loaded and events visualized in Python
  • visualization.mp4: an example visualization of the hits and generator particles of a single ttbar event from the dataset

 

Dataset semantics

Each file consists of event records. Each event contains structured branches of the relevant physics data. The branches relevant to particle flow reconstruction include:

  • MCParticles: the ground truth generator particles
  • ECALBarrel, ECALEndcap, ECALOther, HCALBarrel, HCALEndcap, HCALOther, MUON: reconstructed hits in the various calorimeter subsystems
  • SiTracks_Refitted: the reconstructed tracks
  • PandoraClusters: the calorimeter hits, clustered by Pandora to calorimeter clusters
  • MergedRecoParticles: the reconstructed particles from the Pandora particle flow algorithm
  • CalohitMCTruthLink: the links between MC particles and reconstructed calorimeter hits
  • SiTracksMCTruthLink: the links between MC particles and reconstructed tracks

The full details of the EDM4HEP format are available here.

 

Dataset characteristics

The full dataset in dataset_full.txt consists of 43 tar files of up to 100GB each. The tar files contain in total 58068 files, 2.5TB in the ROOT EDM4HEP format.

The subset in *_10files.tar for consists of 150 files, 26GB in the ROOT EDM4HEP format.

 

How can you use these data?

The ROOT files can be directly loaded with the uproot Python library.

 

Disclaimer

These are simulated samples suitable for conceptual machine learning R&D and software performance studies. They have not been calibrated with respect to real data, and should not be used to derive physics projections about the detectors.

Neither CLIC nor CERN endorse any works, scientific or otherwise, produced using these data. All releases will have a unique DOI that you are requested to cite in any applications or publications.

Notes

Funding support for the development and generation of this dataset by Estonian Research Council (ETAG) grant PSG864. The full dataset is hosted at the Julich HPC, supported by the CoE RAISE project. CoE RAISE project has received funding from the European Union's Horizon 2020 – Research and Innovation Framework Programme H2020-INFRAEDI-2019-1 under grant agreement no. 951733.

Files

clic-visualize.ipynb

Files (28.2 GB)

Name Size Download all
md5:01748f2b20e9f152832460bdd6637424
1.7 kB Download
md5:059146092a7166ce94176b1a2c499c46
8.9 kB Preview Download
md5:ce5e07d8afd67cac458320cc60d723a4
9.0 kB Download
md5:d6d6cefa630e327e66a9b480a79fff62
81.8 kB Download
md5:c79c16ce192bb638a719710a915fc79d
5.1 kB Preview Download
md5:f5c0d3aa743d7a9834f0fdfd4f477a90
3.8 GB Download
md5:f704a4155c7b203d439a26c03508f2fd
3.8 GB Download
md5:7d3bff3c204a4c8795639771adbb4910
3.4 GB Download
md5:7d5175aa100d572fd6feccbb717fdf33
2.3 GB Download
md5:1b5816966fdcdd7c1c4c00d95d0131d9
3.7 kB Download
md5:f52247bf6729b6f063ef2d86b69b380b
490.1 MB Download
md5:bb6244aad8664853a0e67d0cf264a5c9
489.5 MB Download
md5:9320461cd99fd785c6a3a28e26942b22
2.2 GB Download
md5:5f5f2ffe47d7da84a6896d44911c66d6
968 Bytes Download
md5:faf0dc523accbe6f89863a67c5296c56
967 Bytes Download
md5:ba08d088b1441935cbe5cdd544ab74b9
282.4 MB Download
md5:0f6634c89475476486d3d5097b7f7d15
855 Bytes Download
md5:6437437ace82f58a7b2ed9f52d92448a
386.4 MB Download
md5:98049eb2df622a04070a4fb1b98c6f56
674.0 MB Download
md5:7ca02240786e34843cc6a39eb34b4f34
900 Bytes Download
md5:3b47fb845714f717374bf7c1fe4ed4d4
376.2 MB Download
md5:70427d27569e4f00d9334fe44270b62c
1.1 kB Download
md5:29c32bfdc66d76a4c7523765b9c3677e
209.5 MB Download
md5:12d112cc1d93418f360fdd05f6170216
64.2 kB Preview Download
md5:3e9279c66dacdbda35dfd95167938f63
2.4 GB Download
md5:255a388160b754a33b5e07f83d681ce6
2.4 GB Download
md5:ae4d7a696ce5ab10d7fc0c037631f86c
3.9 GB Download
md5:bbd6b273821d083e06ead5cdb717326d
2.3 kB Download
md5:1d7bdc8fd06283a16b1e1523047f2165
236.0 MB Download
md5:1fd5fc902dadd734aef4fe77c134ee26
235.9 MB Download
md5:c71d3226d6d7adbbd9e62fcc52a10a45
235.0 MB Download
md5:a04fadc2bb29e33a3eeef89679c845f6
235.1 MB Download
md5:576ced74cd9ad711dfc1def4c0f7f4bf
237.3 MB Download
md5:52616ddc6135b6c12d7845d6a5c35a5c
1.4 kB Download
md5:dc8295596e427b10c0cc3a8171cdc994
1.4 kB Download
md5:393368231bad371ee8a660c92e79e658
1.3 kB Download
md5:4169c2a147f3584e21b147148619a3eb
1.5 kB Download
md5:ca30cf57318dda86aa7741faeeb2d905
18.0 MB Preview Download