Model selection on validation cohorts and risk-direction refitting inflate reported concordance in multi-algorithm transcriptomic survival pipelines: evidence from three cancers and a selection-aware benchmark
Description
Companion archive for the manuscript "Model selection on validation cohorts and risk-direction refitting inflate reported concordance in multi-algorithm transcriptomic survival pipelines: evidence from three cancers and a selection-aware benchmark" (Zhihui Li, Wenjin Ye; Zhongshan School of Medicine, Sun Yat-sen University).
The study shows that two evaluation choices used in multi-algorithm prognostic-modelling pipelines (re-estimating the risk-score direction in each evaluation cohort, and selecting the best model on the cohorts used to report its performance) inflate the reported concordance index (C-index). It uses simulations, Mime analyses of 239 random gene sets in hepatocellular carcinoma, lung adenocarcinoma and gastric adenocarcinoma, a selection-aware permutation benchmark and an audit of 18 public implementations.
Contents
- selection_direction_cindex_v4_part01.zip: analysis scripts, summary-level results, run manifest, frozen analysis plans, implementation-audit records (including the frozen commit of each audited repository), the fixedC R functions for fixed-direction C-indices, the number tables used in the manuscript and renv.lock. Start with README.md inside this file.
- selection_direction_cindex_v2_part02.zip to part08.zip: further summary-level results (unchanged from the previous version).
- selection_direction_cindex_v4_reproduce_part001.zip to part090.zip: frozen patient-level predictions and outcomes of every gene set in the three cancers, the explicit split indices and scripts/reproduce_main.R, which recomputes procedures D1 to D4 and all contrasts and checks every value against the reported results. Unzip all 90 parts into one folder.
Raw expression and clinical data are not redistributed; they are publicly available from TCGA/GDC (with TCGA-CDR survival endpoints), ICGC LIRI-JP via HCCDB and the GEO series listed in the manuscript. Third-party repositories are identified by their frozen commits.
Files
selection_direction_cindex_v2_part02.zip
Files
(930.5 MB)
| Name | Size | |
|---|---|---|
|
md5:7ebc1532fa47e8173226ae13aaeefa5f
|
21.3 MB | Preview Download |
|
md5:f409e510dc7917a22e6c8a6da24c1c44
|
21.0 MB | Preview Download |
|
md5:4f4b45d97ef782edfea023e6be6bc1f5
|
21.3 MB | Preview Download |
|
md5:06b532588528541255c09787b98815c2
|
13.9 MB | Preview Download |
|
md5:1c22e0973b9579363bdcf8090411c6d4
|
29.9 MB | Preview Download |
|
md5:9e2789aadf6c27ef2d1f828e1b4a105a
|
16.7 MB | Preview Download |
|
md5:4d7b963a50209536ca2cf04ac5af4d2b
|
10.9 MB | Preview Download |
|
md5:2da0f36a262de1a5780aeb261903205f
|
2.9 MB | Preview Download |
|
md5:e68865657141524b1204e895b0afb7b9
|
6.8 MB | Preview Download |
|
md5:faeecd0f6ecc6813f9fb8150b625423b
|
9.7 MB | Preview Download |
|
md5:b54c492fa3d74719ca7dfe5ab414085c
|
9.3 MB | Preview Download |
|
md5:77bd0d54539d5b0700b870e2d23ab11a
|
9.8 MB | Preview Download |
|
md5:0ca6b5dd7ece421b4a4d21c050e90ee7
|
9.5 MB | Preview Download |
|
md5:0e7ce87ffca8e7caf5befdbc69fddbb1
|
9.5 MB | Preview Download |
|
md5:da310093a22f0aa7ff774a3abcd57bb4
|
9.0 MB | Preview Download |
|
md5:91e52e73188ead865c680568b3fe2154
|
9.8 MB | Preview Download |
|
md5:37bfe4ae26fe804f707e9cedaab79473
|
9.4 MB | Preview Download |
|
md5:2386944a0713bcec8c4633ba5f9f2c62
|
9.6 MB | Preview Download |
|
md5:ea68509e7c27e4d6f10b8ddd722c8753
|
9.6 MB | Preview Download |
|
md5:26136d97cb93d6a79d7d600834b760f6
|
9.6 MB | Preview Download |
|
md5:48471ab43db93f2f798187fd781c3832
|
9.5 MB | Preview Download |
|
md5:a6f2c5e0762b52f7b3e4a261d1077657
|
9.7 MB | Preview Download |
|
md5:0d1bad69a27717dad93c16856ec47f8f
|
9.5 MB | Preview Download |
|
md5:5bec668b1cfba558e3ad7ff562c47aeb
|
9.3 MB | Preview Download |
|
md5:e88b4340d4c9a69e18bf90fde61e61f9
|
9.6 MB | Preview Download |
|
md5:60703e3403ec60ff56e5133ea25b870e
|
9.2 MB | Preview Download |
|
md5:6790bdbeeeff26ec077cdee9a4f021bb
|
9.5 MB | Preview Download |
|
md5:802a130a9156bd45d1bc221bd07eff0b
|
9.5 MB | Preview Download |
|
md5:d9fea4c03166f2ae12e3036c5cd1c969
|
9.6 MB | Preview Download |
|
md5:22cb89030fde5ef4b1a41a1bbc9b4cb7
|
8.5 MB | Preview Download |
|
md5:5a8c0c2383b72acf7bc4b363118ebe3a
|
8.5 MB | Preview Download |
|
md5:80f79861aab3925494e7f2c28f731ba1
|
8.5 MB | Preview Download |
|
md5:8947049b612ea14944d43bdc37952be5
|
8.5 MB | Preview Download |
|
md5:acd963df6eb8e953dfd7c8373be5f00c
|
8.4 MB | Preview Download |
|
md5:11aa13fb1efac08060d10f25ed65cb94
|
8.5 MB | Preview Download |
|
md5:3f86cc0c1d96da33c4d324b92294eca4
|
8.5 MB | Preview Download |
|
md5:cbbc6aebd03fb2fc58c46c52ffe36197
|
8.6 MB | Preview Download |
|
md5:57828a99345db83c47ebfc8315bdbd54
|
8.5 MB | Preview Download |
|
md5:9ae9d809da3dcc4e91889fa052fab49c
|
8.5 MB | Preview Download |
|
md5:8c7e3fdde6dd8bdf70e112d809c3b22e
|
8.5 MB | Preview Download |
|
md5:dbe25821d211a0b4ad4831a032d2c07b
|
8.5 MB | Preview Download |
|
md5:f7928460b9a66de02487e25c47a3be08
|
8.5 MB | Preview Download |
|
md5:bf9e83ef2380df64b33ada147c6d3843
|
8.5 MB | Preview Download |
|
md5:9fb2595b5613b34562f34cd31ee770f7
|
8.5 MB | Preview Download |
|
md5:34eb9bd41494a5fe4513a8c349056cc3
|
8.5 MB | Preview Download |
|
md5:1bf707cfacc33f846015260746c7ac67
|
8.5 MB | Preview Download |
|
md5:58d5fe16b096ab29bee6ebdadb7a5387
|
8.6 MB | Preview Download |
|
md5:67fc3414a52fcdfc1b11f8fb60cdec78
|
8.5 MB | Preview Download |
|
md5:2f0aef400c4fb3f585fca86cffa3f33d
|
8.6 MB | Preview Download |
|
md5:338dad70089dd071e7bae5be3d373057
|
8.6 MB | Preview Download |
|
md5:d516d50298da859e1434adfd013342fd
|
8.5 MB | Preview Download |
|
md5:b03230be1b5ee7b80126b03862f2a3f4
|
8.5 MB | Preview Download |
|
md5:2a1a2dce9a3d2e82be9d4ef7253f5eca
|
8.5 MB | Preview Download |
|
md5:9e5ef9a6ebd2f1f29027d274cd63196e
|
8.5 MB | Preview Download |
|
md5:fe32cbfcb0075d0571ecabfcf1b201f6
|
8.5 MB | Preview Download |
|
md5:189643c6e268a81d0f2a55e4892fbfda
|
8.5 MB | Preview Download |
|
md5:ef3b58a1f774c221774715d3bbd8babb
|
8.4 MB | Preview Download |
|
md5:f7b89da22011698bf603c3c1a458c3aa
|
8.5 MB | Preview Download |
|
md5:3976148937d8ad8854749e6f079873cd
|
8.4 MB | Preview Download |
|
md5:e227d3c68f51b54adfd6b7a275df17b2
|
8.5 MB | Preview Download |
|
md5:5bb3affbc8d19e48d14089551940f521
|
8.5 MB | Preview Download |
|
md5:542dd5808a52ed89e4c9e90b99c74d62
|
8.6 MB | Preview Download |
|
md5:acc427c278db1fcf0b1c79cd93c75b40
|
8.5 MB | Preview Download |
|
md5:d80b3ac77afbed9ce089797ffd4a82ff
|
8.5 MB | Preview Download |
|
md5:1d1543f3c4588d845c571ae81734b724
|
8.4 MB | Preview Download |
|
md5:63e9a3d1cca926c867f4a5c460c9d48d
|
8.5 MB | Preview Download |
|
md5:87f632b507740ced19f2baa1b946e86e
|
8.5 MB | Preview Download |
|
md5:2d30a06f5d644a04b972bb32e98260a8
|
8.5 MB | Preview Download |
|
md5:90953e6b1b8d0b0f5470af4a4843d155
|
8.7 MB | Preview Download |
|
md5:b34209c8e3117c74b02624c523d5c563
|
9.6 MB | Preview Download |
|
md5:3e73eb5ab1c526509c09a94760d998f9
|
8.9 MB | Preview Download |
|
md5:058845fcd6503ff1fc7ebc9d395cc9c0
|
8.8 MB | Preview Download |
|
md5:8a66fe19aaa5317a03064429aa192a83
|
8.9 MB | Preview Download |
|
md5:6483a243de08eebefa59653a241e3516
|
8.8 MB | Preview Download |
|
md5:e85e7286956612529e62027bcc512e8e
|
9.7 MB | Preview Download |
|
md5:11aa1b4552fc376342615a49af2672a9
|
8.9 MB | Preview Download |
|
md5:090a916b69e71f3f3a8232ed35b9e0df
|
9.5 MB | Preview Download |
|
md5:e1fd79b5d2880afb8eb12506069b8992
|
8.9 MB | Preview Download |
|
md5:f63e8933fc3d0d8712b00044ccfbe8c9
|
8.7 MB | Preview Download |
|
md5:8217151615be12a66a311ff55abe51e3
|
8.8 MB | Preview Download |
|
md5:b96707fd3462360e2a87fdf1e9f9e0ba
|
8.8 MB | Preview Download |
|
md5:5c2241de4d917ba4ae4473bb5031d40a
|
8.7 MB | Preview Download |
|
md5:c043f9d7fe5b6b3a5670c95b07717127
|
8.9 MB | Preview Download |
|
md5:fa16a7dccb07315e77954d6ba5dcbc52
|
9.3 MB | Preview Download |
|
md5:353fed63f78741e0831e7873f4391c13
|
9.0 MB | Preview Download |
|
md5:7bf1de4d7c1ed453ee5e23628bbf3506
|
9.5 MB | Preview Download |
|
md5:d999632d355d4d8acfb015f527ddc682
|
8.7 MB | Preview Download |
|
md5:66a072c827ebd2503efdb5b77ea6d927
|
8.8 MB | Preview Download |
|
md5:b95e5fb374e54eae1ce7e687bc08de33
|
9.7 MB | Preview Download |
|
md5:8ecc8805ceed986b9e12d50c72848cc5
|
9.2 MB | Preview Download |
|
md5:69f073bf7a0488c8d45c002f86fb7669
|
8.9 MB | Preview Download |
|
md5:f92b04ab9e55aa6742c89259d595de81
|
8.9 MB | Preview Download |
|
md5:9b24522399be5cfb44e528aefbe800bc
|
8.7 MB | Preview Download |
|
md5:28114c48f8b0281adc72e98504f2e536
|
9.3 MB | Preview Download |
|
md5:381c464a3c83e1478f765553d2003565
|
8.9 MB | Preview Download |
|
md5:dd3fd5a83995d995c1320018340a6b24
|
9.7 MB | Preview Download |
|
md5:9df1790ec7e839ee971dc049f90da879
|
9.7 MB | Preview Download |
|
md5:47851d51412067cc37fddb3ad86a24af
|
1.1 MB | Preview Download |
Additional details
Dates
- Created
-
2026-10-15