Cross-platform cytometry benchmark data
Authors/Creators
Description
This repository contains the data presented in our original article, "Superior Precision of Clinical Predictions after CD3-relativisation to Align Flow Cytometry Data," including raw and processed FCS files from 482 samples. This dataset captures information about T cell distributions in human healthy donors through standardised flow cytometry measurements made in four internationally collaborating laboratories over 17 months using 6 different cytometers. A subset of 329 samples split for parallel measurements on at least 2 instruments. This repository also reports donor-level clinical and demographic information, as well as QC files.
If you want to start analysing the data, we propose you download CORE.06-1_rel.asinhCD3 which are CD3-relativised and properly arcsinh transformed data of the CORE studies R1, R2 and SAN. In addition, download patientdata.zip, where all anonymized patient information necessary is reported.
See technical note below if you want to use CORE.02-COMPENSATED.7z!
Cohort overview
CORE:
Our core dataset comprises 459 samples from 358 unique donors, which are organized into three main cohorts (R1, R2 and SAN). R1 includes 254 samples from 153 unique donors, which were analysed in Regensburg. Clinical and demographic variables are recorded. Within R1, 101 repeated samples were collected from 60 donors to test the biological stability of T cell subset distributions over time. The first samples taken from each R1 donor were randomised into training (50), validation (50) and test (53) sets. R2 is a prospective dataset collected 4 months after R1 that includes 52 samples from unique donors, who are not represented in R1. R1 and R2 samples were split after staining and measured in parallel with a Navios™ (Navios) and CytoFLEX LX™ (LX) cytometer. SAN comprises 153 samples from unique donors that were measured with a DxFlex™ (DxFLEX) cytometer in Santander. As with R1, SAN samples were randomised into training (50), validation (50) and test (53) sets.
EXTENDED:
Our extended dataset incorporates two cohorts, FORT and BAD. FORT comprises 14 samples from unique donors that were split into equal parts, then measured in parallel using 3 cytometers – namely, a Navios™ and CytoFLEX LX™ from Beckman Coulter, and an LSRFortessa™ (LSR) from Becton Dickenson. The BAD cohort incorporates samples from 9 unique donors that were split after staining and measured in parallel using an LSRFortessa™ and a Cytek Aurora™ (CA) spectral cytometer.
Processing overview
For each cohort, we report (a subset of) the data in the following processing stages, denoted as e.g. CORE.01_RAW. The subsets -1 and -2 include different staining panels after gating them to "useful" cells, where -1 is the thing you probably want for analysis as these are the samples stained with all colors together gated to T cells based on CD3+.
- 01_RAW: Raw, untransformed data for full and single stained samples. Only marker renaming was performed to harmonize measurements from all cytometers.
- 02_COMPENSATED: Compensated FCS files, using by-sample manually curated spillover matrices. Only BAD cohort used untouched device-compensations.
- 03-1_gatedCD3: Singlets/CD45+ Leukocytes/CD3+ T cell gated samples. Only `...12-panel.fcs` are included.
- 03-2_gatedLympho: Lymphocyte gated samples based on forward and side scatter. All single stained and unstained samples (...01-CD3-FITC.fcs, until ...11-none.fcs)
- 04-1_asinhCD3 and 04-2_asinhLympho: Data from 03-1_gatedCD3 or 03-2_gatedLympho after arcsinh transformation, with different manually optimized arcsinh-cofactors per cytometer.
- 05-1_relativizedCD3 and 05-2_relativizedLympho: Data from 03-1_gatedCD3 or 03-2_gatedLympho after applying sample-wise relativisation.
- 06-1_rel.asinhCD3 and 06-2_rel.asinhLympho: Data from 05-1_relativizedCD3 and 05-2_relativizedLympho after applying one global arcsinh transformation
Patient information
Can be found in patientdata.zip.
Content is the patient information of
- BAD_pheno_processed.csv: BAD cohort
- FORT_pheno_processed.csv: FORT cohort
- pheno_full_processed.csv: Complete CORE cohort
- R1_pheno_first_processed.csv: R1 samples from a donor's first presentation
- R1_pheno_processed.csv: All R1 samples+patients
- R2_pheno_processed.csv: R2 cohort
- SAN_pheno_processed.csv: SAN cohort
Gatings
For CORE and FORT cohort samples the gating strategies are manually curated for each sample on compensated, untransformed files - for full, single and unstained samples. They are supplied as flowWorkspace GatingSets and we have applied them sample by sample. The gating strategy is always the same, just the gate positions have been curated.
For BAD samples, we have one gating strategy for all samples per cytometer.
Abstract (English)
Flow cytometry captures subtle changes in immune cell distributions that reflect human disease, but its full potential in clinical decision-making is presently limited by technical variability across instruments, sites, and time. To accelerate research into generalizable predictions of disease, we created a large benchmark dataset of 482 clinical flow cytometry samples from 381 healthy donors, collected over 17 months using six cytometers at four international laboratories. Of special value, a subset of 329 samples from 228 donors were measured in parallel on at least 2 instruments. This resource captures real-world methodological, temporal, and instrument-dependent variability. We propose an alignment strategy, so-called relativisation, which normalizes fluorescence intensities to median CD3 expression per channel as an internal reference, enabling consistent clustering and classification across platforms. Using this approach, we predict donor age, sex, and CMV-IgG serostatus with superior precision. We validate our method with conventional and spectral flow cytometers, and show that relativisation minimises systematic measurement errors. Annotated datasets at each pre-processing step are publicly available in ImmPort. This resource provides a carefully structured dataset and alignment strategy to support reproducible, generalizable and automated analysis of flow cytometry in multi-centre clinical diagnostics.
Methods (English)
Overall methods
Patients and Ethics
Blood samples were collected from healthy donors at the University Hospital Regensburg, Germany, the University Hospital Marqués de Valdecilla, Santander, Spain, and Germans Trias I Pujol Research Institute (IGTP), Badalona, Spain. The study was conducted in multiple phases: R1 and R2 in Regensburg (July 18, 2023-January 23, 2024, and May 15, 2024-July 16, 2024), SAN in Santander (April 29, 2024-May 28, 2024), FORT in Regensburg (January 14, 2025 - January 24, 2025) and BAD in Badalona (March 18, 2025 - March 19, 2025). The study was approved by the Ethics Committees of the University of Regensburg (22-2780-101), Hospital Universitario Marqués de Valdecilla (CS24-116; 2024_6) and IGTP (PI-23-272). The study was conducted in accordance with the principles of the Declaration of Helsinki and all other relevant national and international laws and guidelines. All donors provided written, fully informed consent to sample collection and publication of anonymized results. Complete descriptions of each cohort (Supplementary Note 1) and clinical investigations (Supplementary Note 2) are provided as Supplementary Material.
Flow cytometry measurements
Step-by-step protocols can be accessed at Protocol Exchange. Briefly, blood was collected into EDTA-vacutainers by peripheral venepuncture and then delivered to the responsible lab at ambient temperature. Samples were stored at 4°C for up to 4h before processing. Whole blood samples were stained as previously described using the DURAClone IM T Cell Subsets Tube (Beckman Coulter, B53328) and single-staining controls. DURAClone IM T cell subsets compensation tubes were run every two weeks. Daily quality control (QC) checks were run on all cytometers using Flow-Check Pro Fluorospheres (Beckman Coulter, A63493) to ensure proper function.
Data were collected in Regensburg using a Navios™ cytometer running Navios™ Cytometry List Mode Acquisiton Analysis Software, Version 1.3 (Beckman Coulter) or a CytoFLEX LX™ cytometer running CytExpert, Version 2.4.0.28 (Beckman Coulter) or a BD LSRFortessa X-20' running BD FACSDiva software v9.0. In Santander, data were collected using a DxFLEX cytometer running CytExpert for DxFLEX, Version 2.2.0.7. In Badalona, data were collected using both a Cytek Aurora™ 5L spectral flow cytometer running SpectroFlo® software (Cytek Biosciences), Version 3.1.0, or a BD LSRFortessa 4L flow cytometer running BD FACSDiva™Software (BD Biosciences), Version 6.2. Settings for each cytometer were established by independent experienced operators without exchange of reference samples, calibration materials or example data.
Data were pre-processed by a single experienced, blinded operator who performed: (1) sample-wise manual recompensation; (2) manual gating; and (3) rescaling with a suitable arcsinh cofactor. Data were then exported as FCS files for upload to the ImmPort repository (Accession_ID). These FCS files contain the uncompensated data and three compensations: 1) single-stain compensation for each sample, 2) compensation from DURAClone IM T Cell Subsets compensation tubes, 3) manually recompensated single-stain compensation for each sample. The manual gatings per sample are provided as FlowWorkspace gating sets in h5 format and should be applied to the manually recompensated data. An example gating strategy is provided. In addition, we provide manually recompensated, pre-gated T cell FCS files for all fully stained samples.
Flow cytometry analyses
All computations were performed in R using the Bioconductor packages flowCore and flowWorkspace, alongside our own convenience tools, cytobench , cycompare and otcyto. We gathered FCS files from all instruments, and carried out pre-processing, clustering, classification, and optimal transport analyses.
Pre-processing included applying compensation (or unmixing in the case of spectral cytometry), manual gating to identify CD45+ CD3+ singlet T cells in panel samples and lymphocytes in single-stained controls, arcsinh transformation of fluorescence intensities using manually selected cofactors, random cell subsampling to standardise sample sizes and optionally CytoNorm for normalisation. Alternatively, we applied data relativisation as an alignment strategy before arcsinh transformation.
For reproducibility, R1 and SAN donors were randomly assigned to training, validation, and test sets only once. This donor-level split was preserved for all downstream analyses and serves as the foundation for model development and evaluation. Ideally, future benchmarking efforts using our data should report on those splits for direct comparability of results.
Methods (English)
Methods CORE cohort
Step-by-step protocols can be accessed at Protocol Exchange [Kronenberg et.al. (2021) DOI:10.21203/rs.3.pex-757/v1], except we here generally used 30 minutes of incubation time. Briefly, blood was collected into EDTA-vacutainers by peripheral venepuncture and then delivered to the responsible lab at ambient temperature. Samples were stored at 4°C for up to 4h before processing. Whole blood samples were stained according to manufacturer's instructions (but with 30 min incubation time) using the DURAClone IM T Cell Subsets Tube (Beckman Coulter, B53328, https://www.mybeckman.de/reagents/coulter-flow-cytometry/antibodies-and-kits/duraclone-panels/duraclone-im-t-cell-subsets/B53328), single-staining controls and an unstained control. DURAClone IM T cell subsets compensation tubes were run on all three cytometers every two weeks.
Data were collected in Regensburg using both a Navios cytometer running Navios Cytometry List Mode Acquisiton & Analysis Software, Version 1.3 (Beckman Coulter) or CytoFlex LX cytometer running CytExpert, Version 2.4.0.28 (Beckman Coulter). In Santander, data were collected using a DxFLEX cytometer running CytExpert for DxFLEX, Version 2.2.0.7.
QC-control beads were used to monitor instrument performance.
Within the .fcs files, we supply multiple compensations following the Kaluza Analysis Software workflow:
1. singlestain_auto: For each sample, single-stain controls were used to calculate the compensation matrix.
2. singlestain_manual: For each sample, single-stain controls were used to calculate the compensation matrix. An experienced operator performed blinded analyses for sample-wise recompensation.
3. DCtubes_auto: DURAClone IM T Cell Subsets Tube compensation kits were used every two weeks to calculate the compensation matrix. All samples from that day until the "next" compensation kit were compensated with the same matrix.
From Kaluza, we exported the autofluorescence vector and the spillover matrix. To ensure the same results as in our publication, please follow the Kaluza workflow:
1. Subtract autofluorescence from the data multiplied with the maximum value of the channel.
2. Apply compensation as usual.
3. Add the removed autofluorescence back to the data.
Notably, the DxFLEX flow cytometer used in Santander was set up independently from the cytometers in Regensburg by an independent application specialist from Beckman Coulter who did not have any knowledge about the study design or objectives.
All files are named according to the following scheme, split by underscores ("_"). Logically connected parts are separated by hyphens ("-").
Structure: <cohort>_<donor>_<sample>_<processing>_<appliedGating>_<subsample method>_<subsample size>_<device>_<sample-number>-<antigen>-<fluorochrome>.fcs
Example: R2_d052_s054_raw_ungated_none_Inf_navios_01-CD3-FITC.fcs
R2: Regensburg cohort 2
d052: donor 52
s054: sample 54
raw: raw data
ungated: no gating applied
none: No subsampling applied
Inf: How many cells were subsampled (Inf = Infinity, so all measured cells)
navios: Navios cytometer
01-CD3-FITC: First cytometry-sample of this biosample. Here CD3 was stained with FITC.
Specials:
- 01-CD3-FITC: Single-stained CD3 with FITC
- 02-CD3-PE: Single-stained CD3 with PE
- 03-CD3-ECD: Single-stained CD3 with ECD
- 04-CD3-PC5.5: Single-stained CD3 with PC5.5
- 05-CD3-PC7: Single-stained CD3 with PC7
- 06-CD3-APC: Single-stained CD3 with APC
- 07-CD3-AF700: Single-stained CD3 with AF700
- 08-CD3-AF750: Single-stained CD3 with AF750
- 09-CD3-PB: Single-stained CD3 with PB
- 10-CD3-KrO: Single-stained CD3 with KrO
- 11-none: No staining
- 12-panel: DURAClone IM T Cell Subsets Tube
- 13-01..11-SingleNone: All single-stain controls and unstained control concatenated in one file
Kronenberg, Katharina, Paloma Riquelme, and James A. Hutchinson. "Standard protocols for immune profiling of peripheral blood leucocyte subsets by flow cytometry using DuraClone IM reagents." (2021). (https://doi.org/10.21203/rs.3.pex-757/v1)
Methods
Methods BAD + FORT cohort
All files are named according to the following scheme, split by underscores ("_"). Logically connected parts are separated by hyphens ("-").
Structure: <cohort>_<donor>_<sample>_<processing>_<appliedGating>_<subsample method>_<subsample size>_<device>_<sample-number>-<antigen>-<fluorochrome>.fcs
Example: BAD_d01_s01_raw_ungated_none_Inf_fortessa_01-CD3-FITC.fcs
BAD: Badalona cohort
d01: donor 01
s01: sample 01
raw: raw data
ungated: no gating applied
none: No subsampling applied
Inf: How many cells were subsampled (Inf = Infinity, so all measured cells)
fortessa: Fortessa (flow cytometer), alternative; Aurora (spectral cytometer
01-CD3-FITC: First cytometry-sample of this biosample. Here CD3 was stained with FITC.
Specials:
- 01-CD3-FITC: Single-stained CD3 with FITC
- 02-CD3-PE: Single-stained CD3 with PE
- 03-CD3-ECD: Single-stained CD3 with ECD
- 04-CD3-PC5.5: Single-stained CD3 with PC5.5
- 05-CD3-PC7: Single-stained CD3 with PC7
- 06-CD3-APC: Single-stained CD3 with APC
- 07-CD3-AF700: Single-stained CD3 with AF700
- 08-CD3-AF750: Single-stained CD3 with AF750
- 09-CD3-PB: Single-stained CD3 with PB
- 10-CD3-KrO: Single-stained CD3 with KrO
- 11-none: No staining
- 12-panel: DURAClone IM T Cell Subsets Tube
Technical info (English)
NOTE for CORE.02-COMPENSATED.7z:
Unfortunately, as of now we were unable to upload the complete compensated CORE dataset to zenodo as one. Instead, we split it and leave it up to you to merge it together. For this, please download:
CORE.02-COMPENSATED.7z.aa
CORE.02-COMPENSATED.7z.ab
CORE.02-COMPENSATED.7z.ac
CORE.02-COMPENSATED.7z.ad
into one directory, then use
cat CORE.02-COMPENSATED.7z.a* > CORE.02-COMPENSATED.7z
to create the full 7-zip file. Check the md5sum to ensure that it worked correctly with
md5sum CORE.02-COMPENSATED.7z # (93933ee1c29723242d2acac598bfd65a)
| md5sum | File |
| bf1ff81fdda86da7e935bdf6643359fd | BAD.01-RAW.7z |
| 4b99243487693771ea97ce1b59d3c815 | BAD.02-COMPENSATED.7z |
| 59df803ed05d9fcdbd8f5e3d34eee0de | BAD.03-1-gatedCD3.7z |
| 72c8de5446812cfcf526ef0f6ccc20cc | BAD.03-2-gatedLympho.7z |
| 93e9ca5f20356c6d10ea1e78cf3d481e | BAD.04-1-asinhCD3.7z |
| a668071e9f0cb6e3ee1f3665a372c5d3 | BAD.04-2-asinhLympho.7z |
| fd28317a845b905dcba70ce18204e1c4 | BAD.05-1-relativizedCD3.7z |
| b9d5fa63184222232f5b94573020bab6 | BAD.05-2-relativizedLympho.7z |
| bff81435828d8d7a1669ef8cf9a5b93d | BAD.06-1-rel.asinhCD3.7z |
| fc22404af92c5f9b8e58120540717a73 | BAD.06-2-rel.asinhLympho.7z |
| 4e6c58bb32aec5e5507da68a36df8fea | CORE.01-RAW.7z |
| 93933ee1c29723242d2acac598bfd65a | CORE.02-COMPENSATED.7z |
| 9d899d8dfcfa71989c77ead402ae61ba | CORE.03-1-gatedCD3.7z |
| 080b626d13cc6783aa6a4debfdef59f2 | CORE.03-2-gatedLympho.7z |
| 47c6a807f22dc1da108fe5ffc5f2cbbb | CORE.04-1-asinhCD3.7z |
| 1043844f554dadc6cfaf8cff7f7600ac | CORE.04-2-asinhLympho.7z |
| e9bd70f4087833526650f4ff5cafb97e | CORE.05-1-relativizedCD3.7z |
| bb6edd942ee7ccd42f97d7d9c19dbf20 | CORE.05-2-relativizedLympho.7z |
| 975b51af917feec94640c75572ebfa32 | CORE.06-1-rel.asinhCD3.7z |
| 1b9cc7b3f3398974950348f27c6558c3 | CORE.06-2-rel.asinhLympho.7z |
| 9130354b99e66cd4ceb50f9afbc0b603 | CORE.QualityControl.7z |
| 2ed8dece3f19cbde8db4ef5a2882f09a | FORT.01-RAW.7z |
| 7b1128e18b1a44dd49dc5b49007f674c | FORT.02-COMPENSATED.7z |
| 92ebcb314864d28e5db6a71e5a8308ec | FORT.03-1-gatedCD3.7z |
| 927afd2da642038ae0368e942ee7d2d1 | FORT.03-2-gatedLympho.7z |
| beffe5f6d6a5e66de2d590af4b345dae | FORT.04-1-asinhCD3.7z |
| b477f80375ff651de923a42fb3286d15 | FORT.04-2-asinhLympho.7z |
| d7689ce1777ad56419c552dfd99f81ac | FORT.05-1-relativizedCD3.7z |
| 73d84c4e04de75d26100b04f66b9d1a8 | FORT.05-2-relativizedLympho.7z |
| cae6c13b68f9fc952b790fdc562d4db7 | FORT.06-1-rel.asinhCD3.7z |
| 22632c3570c51b4577b9e1871b2af8d7 | FORT.06-2-rel.asinhLympho.7z |
| 5ea160857197289dc5a49bae18333e73 | GATINGSETS.7z |
| f8226f6b12c34e45de8a86283c7709a4 | patientdata.7z |
Files
Overview_Zenodo.png
Files
(193.9 GB)
| Name | Size | |
|---|---|---|
|
md5:bf1ff81fdda86da7e935bdf6643359fd
|
1.5 GB | Download |
|
md5:4b99243487693771ea97ce1b59d3c815
|
2.2 GB | Download |
|
md5:59df803ed05d9fcdbd8f5e3d34eee0de
|
25.5 MB | Download |
|
md5:72c8de5446812cfcf526ef0f6ccc20cc
|
189.8 MB | Download |
|
md5:93e9ca5f20356c6d10ea1e78cf3d481e
|
24.6 MB | Download |
|
md5:a668071e9f0cb6e3ee1f3665a372c5d3
|
189.5 MB | Download |
|
md5:fd28317a845b905dcba70ce18204e1c4
|
24.1 MB | Download |
|
md5:b9d5fa63184222232f5b94573020bab6
|
191.3 MB | Download |
|
md5:bff81435828d8d7a1669ef8cf9a5b93d
|
23.7 MB | Download |
|
md5:fc22404af92c5f9b8e58120540717a73
|
191.2 MB | Download |
|
md5:4e6c58bb32aec5e5507da68a36df8fea
|
62.8 GB | Download |
|
md5:5dc123cab2cce00a5853164af56691ab
|
26.8 GB | Download |
|
md5:7acead1d72053fee718ef14e4bb37d61
|
26.8 GB | Download |
|
md5:cfe055e51524752873e57acdacca2e96
|
26.8 GB | Download |
|
md5:acf6bc0bf97f0c74b27fd97e83760e82
|
9.2 GB | Download |
|
md5:9d899d8dfcfa71989c77ead402ae61ba
|
795.6 MB | Download |
|
md5:080b626d13cc6783aa6a4debfdef59f2
|
8.8 GB | Download |
|
md5:47c6a807f22dc1da108fe5ffc5f2cbbb
|
780.6 MB | Download |
|
md5:1043844f554dadc6cfaf8cff7f7600ac
|
8.7 GB | Download |
|
md5:e9bd70f4087833526650f4ff5cafb97e
|
803.4 MB | Download |
|
md5:bb6edd942ee7ccd42f97d7d9c19dbf20
|
5.5 GB | Download |
|
md5:975b51af917feec94640c75572ebfa32
|
784.6 MB | Download |
|
md5:1b9cc7b3f3398974950348f27c6558c3
|
5.5 GB | Download |
|
md5:9130354b99e66cd4ceb50f9afbc0b603
|
76.3 MB | Download |
|
md5:2ed8dece3f19cbde8db4ef5a2882f09a
|
1.5 GB | Download |
|
md5:7b1128e18b1a44dd49dc5b49007f674c
|
2.5 GB | Download |
|
md5:92ebcb314864d28e5db6a71e5a8308ec
|
37.5 MB | Download |
|
md5:927afd2da642038ae0368e942ee7d2d1
|
197.5 MB | Download |
|
md5:beffe5f6d6a5e66de2d590af4b345dae
|
36.6 MB | Download |
|
md5:b477f80375ff651de923a42fb3286d15
|
195.4 MB | Download |
|
md5:d7689ce1777ad56419c552dfd99f81ac
|
37.3 MB | Download |
|
md5:73d84c4e04de75d26100b04f66b9d1a8
|
203.1 MB | Download |
|
md5:cae6c13b68f9fc952b790fdc562d4db7
|
36.5 MB | Download |
|
md5:22632c3570c51b4577b9e1871b2af8d7
|
202.6 MB | Download |
|
md5:5ea160857197289dc5a49bae18333e73
|
661.5 kB | Download |
|
md5:a8440f1c0bf05ed0095d01aa5d05169f
|
374.4 kB | Preview Download |
|
md5:f8226f6b12c34e45de8a86283c7709a4
|
23.1 kB | Download |
Additional details
Funding
- European Commission
- exTra - Innovative Applications of Extracorporeal Photopheresis in Solid Organ Transplantation 101119855
- European Commission
- IMMUTOL - ADVANCED ANTIGEN-SPECIFIC DENDRITIC CELL-BASED THERAPY TO RE-ESTABLISH TOLERANCE IN IMMUNE-MEDIATED DISEASES 101080562
- Bristol-Myers Squibb (Germany)
- Virus-specific memory T cell responses unmasked by immune checkpoint blockade cause hepatitis FA-19-009
- Bavarian State Ministry for Science and Art
- Begleitforschung BF/04/R/Hutch
Dates
- Created
-
2025-09-10
Software
- Repository URL
- https://github.com/ggrlab/2025-Relativisation
- Programming language
- R , Python , Shell
- Development Status
- Active