Published October 15, 2026 | Version v4

Model selection on validation cohorts and risk-direction refitting inflate reported concordance in multi-algorithm transcriptomic survival pipelines: evidence from three cancers and a selection-aware benchmark

Authors/Creators

  • 1. EDMO icon Sun Yat Sen University

Description

Companion archive for the manuscript "Model selection on validation cohorts and risk-direction refitting inflate reported concordance in multi-algorithm transcriptomic survival pipelines: evidence from three cancers and a selection-aware benchmark" (Zhihui Li, Wenjin Ye; Zhongshan School of Medicine, Sun Yat-sen University).

The study shows that two evaluation choices used in multi-algorithm prognostic-modelling pipelines (re-estimating the risk-score direction in each evaluation cohort, and selecting the best model on the cohorts used to report its performance) inflate the reported concordance index (C-index). It uses simulations, Mime analyses of 239 random gene sets in hepatocellular carcinoma, lung adenocarcinoma and gastric adenocarcinoma, a selection-aware permutation benchmark and an audit of 18 public implementations.

Contents
- selection_direction_cindex_v4_part01.zip: analysis scripts, summary-level results, run manifest, frozen analysis plans, implementation-audit records (including the frozen commit of each audited repository), the fixedC R functions for fixed-direction C-indices, the number tables used in the manuscript and renv.lock. Start with README.md inside this file.
- selection_direction_cindex_v2_part02.zip to part08.zip: further summary-level results (unchanged from the previous version).
- selection_direction_cindex_v4_reproduce_part001.zip to part090.zip: frozen patient-level predictions and outcomes of every gene set in the three cancers, the explicit split indices and scripts/reproduce_main.R, which recomputes procedures D1 to D4 and all contrasts and checks every value against the reported results. Unzip all 90 parts into one folder.

Raw expression and clinical data are not redistributed; they are publicly available from TCGA/GDC (with TCGA-CDR survival endpoints), ICGC LIRI-JP via HCCDB and the GEO series listed in the manuscript. Third-party repositories are identified by their frozen commits.

Files

selection_direction_cindex_v2_part02.zip

Files (930.5 MB)

Name Size
md5:7ebc1532fa47e8173226ae13aaeefa5f
21.3 MB Preview Download
md5:f409e510dc7917a22e6c8a6da24c1c44
21.0 MB Preview Download
md5:4f4b45d97ef782edfea023e6be6bc1f5
21.3 MB Preview Download
md5:06b532588528541255c09787b98815c2
13.9 MB Preview Download
md5:1c22e0973b9579363bdcf8090411c6d4
29.9 MB Preview Download
md5:9e2789aadf6c27ef2d1f828e1b4a105a
16.7 MB Preview Download
md5:4d7b963a50209536ca2cf04ac5af4d2b
10.9 MB Preview Download
md5:2da0f36a262de1a5780aeb261903205f
2.9 MB Preview Download
md5:e68865657141524b1204e895b0afb7b9
6.8 MB Preview Download
md5:faeecd0f6ecc6813f9fb8150b625423b
9.7 MB Preview Download
md5:b54c492fa3d74719ca7dfe5ab414085c
9.3 MB Preview Download
md5:77bd0d54539d5b0700b870e2d23ab11a
9.8 MB Preview Download
md5:0ca6b5dd7ece421b4a4d21c050e90ee7
9.5 MB Preview Download
md5:0e7ce87ffca8e7caf5befdbc69fddbb1
9.5 MB Preview Download
md5:da310093a22f0aa7ff774a3abcd57bb4
9.0 MB Preview Download
md5:91e52e73188ead865c680568b3fe2154
9.8 MB Preview Download
md5:37bfe4ae26fe804f707e9cedaab79473
9.4 MB Preview Download
md5:2386944a0713bcec8c4633ba5f9f2c62
9.6 MB Preview Download
md5:ea68509e7c27e4d6f10b8ddd722c8753
9.6 MB Preview Download
md5:26136d97cb93d6a79d7d600834b760f6
9.6 MB Preview Download
md5:48471ab43db93f2f798187fd781c3832
9.5 MB Preview Download
md5:a6f2c5e0762b52f7b3e4a261d1077657
9.7 MB Preview Download
md5:0d1bad69a27717dad93c16856ec47f8f
9.5 MB Preview Download
md5:5bec668b1cfba558e3ad7ff562c47aeb
9.3 MB Preview Download
md5:e88b4340d4c9a69e18bf90fde61e61f9
9.6 MB Preview Download
md5:60703e3403ec60ff56e5133ea25b870e
9.2 MB Preview Download
md5:6790bdbeeeff26ec077cdee9a4f021bb
9.5 MB Preview Download
md5:802a130a9156bd45d1bc221bd07eff0b
9.5 MB Preview Download
md5:d9fea4c03166f2ae12e3036c5cd1c969
9.6 MB Preview Download
md5:22cb89030fde5ef4b1a41a1bbc9b4cb7
8.5 MB Preview Download
md5:5a8c0c2383b72acf7bc4b363118ebe3a
8.5 MB Preview Download
md5:80f79861aab3925494e7f2c28f731ba1
8.5 MB Preview Download
md5:8947049b612ea14944d43bdc37952be5
8.5 MB Preview Download
md5:acd963df6eb8e953dfd7c8373be5f00c
8.4 MB Preview Download
md5:11aa13fb1efac08060d10f25ed65cb94
8.5 MB Preview Download
md5:3f86cc0c1d96da33c4d324b92294eca4
8.5 MB Preview Download
md5:cbbc6aebd03fb2fc58c46c52ffe36197
8.6 MB Preview Download
md5:57828a99345db83c47ebfc8315bdbd54
8.5 MB Preview Download
md5:9ae9d809da3dcc4e91889fa052fab49c
8.5 MB Preview Download
md5:8c7e3fdde6dd8bdf70e112d809c3b22e
8.5 MB Preview Download
md5:dbe25821d211a0b4ad4831a032d2c07b
8.5 MB Preview Download
md5:f7928460b9a66de02487e25c47a3be08
8.5 MB Preview Download
md5:bf9e83ef2380df64b33ada147c6d3843
8.5 MB Preview Download
md5:9fb2595b5613b34562f34cd31ee770f7
8.5 MB Preview Download
md5:34eb9bd41494a5fe4513a8c349056cc3
8.5 MB Preview Download
md5:1bf707cfacc33f846015260746c7ac67
8.5 MB Preview Download
md5:58d5fe16b096ab29bee6ebdadb7a5387
8.6 MB Preview Download
md5:67fc3414a52fcdfc1b11f8fb60cdec78
8.5 MB Preview Download
md5:2f0aef400c4fb3f585fca86cffa3f33d
8.6 MB Preview Download
md5:338dad70089dd071e7bae5be3d373057
8.6 MB Preview Download
md5:d516d50298da859e1434adfd013342fd
8.5 MB Preview Download
md5:b03230be1b5ee7b80126b03862f2a3f4
8.5 MB Preview Download
md5:2a1a2dce9a3d2e82be9d4ef7253f5eca
8.5 MB Preview Download
md5:9e5ef9a6ebd2f1f29027d274cd63196e
8.5 MB Preview Download
md5:fe32cbfcb0075d0571ecabfcf1b201f6
8.5 MB Preview Download
md5:189643c6e268a81d0f2a55e4892fbfda
8.5 MB Preview Download
md5:ef3b58a1f774c221774715d3bbd8babb
8.4 MB Preview Download
md5:f7b89da22011698bf603c3c1a458c3aa
8.5 MB Preview Download
md5:3976148937d8ad8854749e6f079873cd
8.4 MB Preview Download
md5:e227d3c68f51b54adfd6b7a275df17b2
8.5 MB Preview Download
md5:5bb3affbc8d19e48d14089551940f521
8.5 MB Preview Download
md5:542dd5808a52ed89e4c9e90b99c74d62
8.6 MB Preview Download
md5:acc427c278db1fcf0b1c79cd93c75b40
8.5 MB Preview Download
md5:d80b3ac77afbed9ce089797ffd4a82ff
8.5 MB Preview Download
md5:1d1543f3c4588d845c571ae81734b724
8.4 MB Preview Download
md5:63e9a3d1cca926c867f4a5c460c9d48d
8.5 MB Preview Download
md5:87f632b507740ced19f2baa1b946e86e
8.5 MB Preview Download
md5:2d30a06f5d644a04b972bb32e98260a8
8.5 MB Preview Download
md5:90953e6b1b8d0b0f5470af4a4843d155
8.7 MB Preview Download
md5:b34209c8e3117c74b02624c523d5c563
9.6 MB Preview Download
md5:3e73eb5ab1c526509c09a94760d998f9
8.9 MB Preview Download
md5:058845fcd6503ff1fc7ebc9d395cc9c0
8.8 MB Preview Download
md5:8a66fe19aaa5317a03064429aa192a83
8.9 MB Preview Download
md5:6483a243de08eebefa59653a241e3516
8.8 MB Preview Download
md5:e85e7286956612529e62027bcc512e8e
9.7 MB Preview Download
md5:11aa1b4552fc376342615a49af2672a9
8.9 MB Preview Download
md5:090a916b69e71f3f3a8232ed35b9e0df
9.5 MB Preview Download
md5:e1fd79b5d2880afb8eb12506069b8992
8.9 MB Preview Download
md5:f63e8933fc3d0d8712b00044ccfbe8c9
8.7 MB Preview Download
md5:8217151615be12a66a311ff55abe51e3
8.8 MB Preview Download
md5:b96707fd3462360e2a87fdf1e9f9e0ba
8.8 MB Preview Download
md5:5c2241de4d917ba4ae4473bb5031d40a
8.7 MB Preview Download
md5:c043f9d7fe5b6b3a5670c95b07717127
8.9 MB Preview Download
md5:fa16a7dccb07315e77954d6ba5dcbc52
9.3 MB Preview Download
md5:353fed63f78741e0831e7873f4391c13
9.0 MB Preview Download
md5:7bf1de4d7c1ed453ee5e23628bbf3506
9.5 MB Preview Download
md5:d999632d355d4d8acfb015f527ddc682
8.7 MB Preview Download
md5:66a072c827ebd2503efdb5b77ea6d927
8.8 MB Preview Download
md5:b95e5fb374e54eae1ce7e687bc08de33
9.7 MB Preview Download
md5:8ecc8805ceed986b9e12d50c72848cc5
9.2 MB Preview Download
md5:69f073bf7a0488c8d45c002f86fb7669
8.9 MB Preview Download
md5:f92b04ab9e55aa6742c89259d595de81
8.9 MB Preview Download
md5:9b24522399be5cfb44e528aefbe800bc
8.7 MB Preview Download
md5:28114c48f8b0281adc72e98504f2e536
9.3 MB Preview Download
md5:381c464a3c83e1478f765553d2003565
8.9 MB Preview Download
md5:dd3fd5a83995d995c1320018340a6b24
9.7 MB Preview Download
md5:9df1790ec7e839ee971dc049f90da879
9.7 MB Preview Download
md5:47851d51412067cc37fddb3ad86a24af
1.1 MB Preview Download

Additional details

Dates

Created
2026-10-15