Simulated datasets for detector and particle flow reconstruction: CLIC detector
Creators
- 1. KBFI
- 2. CERN
- 3. UCSD
Description
Data description
Datasets generated using Key4HEP and the CLIC detector model suitable for particle flow reconstruction studies.
The datasets contain generator particles, reconstructed tracks and calorimeter hits, reconstructed Pandora PF particles and their respective links in the EDM4HEP format.
The following processes have been simulated with Pythia 8:
- p8_ee_tt_ecm380: ee -> ttbar, center of mass energy at 380 GeV
- p8_ee_qq_ecm380: ee -> Z* -> qqbar, center of mass energy at 380 GeV
- p8_ee_ZH_Htautau: ee -> ZH -> Higgs decaying to tau leptons, center of mass energy at 380 GeV
- p8_ee_WW_fullhad: ee -> WW -> W decaying hadronically, center of mass energy at 380 GeV
- p8_ee_tt_ecm380_PU10: ee -> ttbar with on average 10 Poisson-distributed events from ee->gg overlayed, center of mass energy at 380 GeV
The following single particle gun samples have been generated with ddsim:
- e+/e-: single electron with energy between 1 and 100 GeV
- mu+/mu-: single muon with energy between 1 and 100 GeV
- kaon0L: single K0L with energy between 1 and 100 GeV
- neutron: single neutron with energy between 1 and 100 GeV
- pi+/pi-: single charged pion with energy between 1 and 100 GeV
- pi0: single neutral pion with energy between 1 and 100 GeV
- gamma: single photon with energy between 1 and 100 GeV
The detector simulation has been done with Geant4, the reconstruction with Marlin interfaced via Key4HEP which includes PF reconstruction with Pandora, all using publicly available models and code.
Contents
This record includes the following files:
- *_10files.tar: small archives of 10 files for each data sample, suitable for testing
- dataset_full.txt: the full list of files, hosted at the Julich HPC courtesy of the Raise CoE project, ~2.5TB total
- *.cmd: the Pythia8 cards
- pythia.py: the pythia steering code for Key4HEP
- run_sim.sh: the steering script for generating, simulating and reconstructing a single file of 100 events from the p8_ee_tt_ecm380, p8_ee_qq_ecm380, p8_ee_ZH_Htautau, p8_ee_WW_fullhad datasets
- run_sim_pu.sh: the steering script for generating, simulating and reconstructing a single file of 100 events from the p8_ee_tt_ecm380_PU10 dataset
- run_sim_gun.sh: the steering script for generating the single-particle gun samples
- run_sim_gun_np.sh: the steering script for generating multi-particle gun samples (extensive datasets have not yet been generated)
- check_files.py: the main driver script that configures the full statistics and creates submission scripts for all the simulations
- PandoraSettings.zip: the settings used for Pandora PF reconstruction
- main19.cc: the Pythia8+HepMC driver code for generating the events with PU overlay
- clicRec_e4h_input.py: the steering configuration of the reconstruction modules in Key4HEP
- clic_steer.py: the steering configuration of the Geant4 simulation modules in Key4HEP
- clic-visualize.ipynb: an example notebook demonstrating how the dataset can be loaded and events visualized in Python
- visualization.mp4: an example visualization of the hits and generator particles of a single ttbar event from the dataset
Dataset semantics
Each file consists of event records. Each event contains structured branches of the relevant physics data. The branches relevant to particle flow reconstruction include:
- MCParticles: the ground truth generator particles
- ECALBarrel, ECALEndcap, ECALOther, HCALBarrel, HCALEndcap, HCALOther, MUON: reconstructed hits in the various calorimeter subsystems
- SiTracks_Refitted: the reconstructed tracks
- PandoraClusters: the calorimeter hits, clustered by Pandora to calorimeter clusters
- MergedRecoParticles: the reconstructed particles from the Pandora particle flow algorithm
- CalohitMCTruthLink: the links between MC particles and reconstructed calorimeter hits
- SiTracksMCTruthLink: the links between MC particles and reconstructed tracks
The full details of the EDM4HEP format are available here.
Dataset characteristics
The full dataset in dataset_full.txt consists of 43 tar files of up to 100GB each. The tar files contain in total 58068 files, 2.5TB in the ROOT EDM4HEP format.
The subset in *_10files.tar for consists of 150 files, 26GB in the ROOT EDM4HEP format.
How can you use these data?
The ROOT files can be directly loaded with the uproot Python library.
Disclaimer
These are simulated samples suitable for conceptual machine learning R&D and software performance studies. They have not been calibrated with respect to real data, and should not be used to derive physics projections about the detectors.
Neither CLIC nor CERN endorse any works, scientific or otherwise, produced using these data. All releases will have a unique DOI that you are requested to cite in any applications or publications.
Notes
Files
clic-visualize.ipynb
Files
(28.2 GB)
| Name | Size | Download all |
|---|---|---|
|
md5:01748f2b20e9f152832460bdd6637424
|
1.7 kB | Download |
|
md5:059146092a7166ce94176b1a2c499c46
|
8.9 kB | Preview Download |
|
md5:ce5e07d8afd67cac458320cc60d723a4
|
9.0 kB | Download |
|
md5:d6d6cefa630e327e66a9b480a79fff62
|
81.8 kB | Download |
|
md5:c79c16ce192bb638a719710a915fc79d
|
5.1 kB | Preview Download |
|
md5:f5c0d3aa743d7a9834f0fdfd4f477a90
|
3.8 GB | Download |
|
md5:f704a4155c7b203d439a26c03508f2fd
|
3.8 GB | Download |
|
md5:7d3bff3c204a4c8795639771adbb4910
|
3.4 GB | Download |
|
md5:7d5175aa100d572fd6feccbb717fdf33
|
2.3 GB | Download |
|
md5:1b5816966fdcdd7c1c4c00d95d0131d9
|
3.7 kB | Download |
|
md5:f52247bf6729b6f063ef2d86b69b380b
|
490.1 MB | Download |
|
md5:bb6244aad8664853a0e67d0cf264a5c9
|
489.5 MB | Download |
|
md5:9320461cd99fd785c6a3a28e26942b22
|
2.2 GB | Download |
|
md5:5f5f2ffe47d7da84a6896d44911c66d6
|
968 Bytes | Download |
|
md5:faf0dc523accbe6f89863a67c5296c56
|
967 Bytes | Download |
|
md5:ba08d088b1441935cbe5cdd544ab74b9
|
282.4 MB | Download |
|
md5:0f6634c89475476486d3d5097b7f7d15
|
855 Bytes | Download |
|
md5:6437437ace82f58a7b2ed9f52d92448a
|
386.4 MB | Download |
|
md5:98049eb2df622a04070a4fb1b98c6f56
|
674.0 MB | Download |
|
md5:7ca02240786e34843cc6a39eb34b4f34
|
900 Bytes | Download |
|
md5:3b47fb845714f717374bf7c1fe4ed4d4
|
376.2 MB | Download |
|
md5:70427d27569e4f00d9334fe44270b62c
|
1.1 kB | Download |
|
md5:29c32bfdc66d76a4c7523765b9c3677e
|
209.5 MB | Download |
|
md5:12d112cc1d93418f360fdd05f6170216
|
64.2 kB | Preview Download |
|
md5:3e9279c66dacdbda35dfd95167938f63
|
2.4 GB | Download |
|
md5:255a388160b754a33b5e07f83d681ce6
|
2.4 GB | Download |
|
md5:ae4d7a696ce5ab10d7fc0c037631f86c
|
3.9 GB | Download |
|
md5:bbd6b273821d083e06ead5cdb717326d
|
2.3 kB | Download |
|
md5:1d7bdc8fd06283a16b1e1523047f2165
|
236.0 MB | Download |
|
md5:1fd5fc902dadd734aef4fe77c134ee26
|
235.9 MB | Download |
|
md5:c71d3226d6d7adbbd9e62fcc52a10a45
|
235.0 MB | Download |
|
md5:a04fadc2bb29e33a3eeef89679c845f6
|
235.1 MB | Download |
|
md5:576ced74cd9ad711dfc1def4c0f7f4bf
|
237.3 MB | Download |
|
md5:52616ddc6135b6c12d7845d6a5c35a5c
|
1.4 kB | Download |
|
md5:dc8295596e427b10c0cc3a8171cdc994
|
1.4 kB | Download |
|
md5:393368231bad371ee8a660c92e79e658
|
1.3 kB | Download |
|
md5:4169c2a147f3584e21b147148619a3eb
|
1.5 kB | Download |
|
md5:ca30cf57318dda86aa7741faeeb2d905
|
18.0 MB | Preview Download |