BY-COVID - WP5 - Baseline Use Case: COVID-19 vaccine effectiveness assessment

Survival analysis

Survival plot

We estimate the survival function using the Kaplan-Meier estimator and represent this function visually using a Kaplan-Meier curve, showing the probability of not getting infected by SARS-CoV-2 at a certain time after onset of follow-up. The survival function is estimated for the control and intervention group.

The cumulative incidence of the event (SARS-CoV-2 infection) was additionally plotted.

Survival (time-to-event)

The probability of not getting infected by SARS-CoV-2 beyond a certain time after onset of follow-up (survival function, estimated using the Kaplan-Meier estimator) is reported for different periods.

Strata Time Number at risk Cumulative sum of number of events Cumulative sum of number censored Survival Std. error Cumulative hazard Std. error cumulative hazard
Not fully vaccinated 0 761433 0 95 1.0000000 0.000000e+00 0.0000000000 0.000000e+00
Not fully vaccinated 100 119149 5478 637499 0.9766631 3.478019e-04 0.0236105180 3.560652e-04
Not fully vaccinated 200 23571 26040 712144 0.6908141 1.838902e-03 0.3691168317 2.655813e-03
Not fully vaccinated 300 9740 29204 722551 0.5559042 2.665070e-03 0.5861296320 4.786911e-03
Not fully vaccinated 400 3162 30586 727799 0.4645425 3.221136e-03 0.7654812388 6.925365e-03
Not fully vaccinated 500 204 30774 730456 0.3803081 7.844703e-03 0.9651017885 2.056845e-02
Fully vaccinated 0 760506 102 1022 0.9998659 1.327909e-05 0.0001341212 1.327998e-05
Fully vaccinated 100 123071 2918 636089 0.9890553 2.274531e-04 0.0110044036 2.299570e-04
Fully vaccinated 200 29558 16043 716159 0.8117937 1.503824e-03 0.2082508205 1.850005e-03
Fully vaccinated 300 16647 17750 727092 0.7486142 2.033233e-03 0.2892364160 2.713672e-03
Fully vaccinated 400 6518 18686 736421 0.7018092 2.434201e-03 0.3537724522 3.466128e-03
Fully vaccinated 500 366 18865 742203 0.6225177 8.032062e-03 0.4734834922 1.287877e-02

Median survival time

The median survival time is the time corresponding to a probability of not obtaining a SARS-CoV-2 infection probability of 0.5. (if NA, the probability of not obtaining a SARS-CoV-2 infection did not drop below 50%)

Characteristic Median survival (95% CI)
fully_vaccinated_bl
    FALSE 345 (340, 352)
    TRUE — (—, —)

Cox regression and estimation of the average treatment effect

A Cox regression model was built to examine the relationship between the distribution of the probability of not obtaining a SARS-CoV-2 infection (survival distribution) and completing a primary vaccination schedule (covariate). The Cox proportional hazards regression model was fitted with ‘fully_vaccinated_bl’ as a covariate and accounts for clustering within individuals (as one individual can be re-sampled as control).

A hazard ratio (HR) is computed for the covariate ‘fully_vaccinated_bl’. A hazard can be interpreted as the instantaneous rate of SARS-CoV-2 infections in individuals that are at risk for obtaining an infection (Cox proportional hazards regression assumes stable proportional hazards over time). A HR < 1 indicates reduced hazard of SARS-CoV-2 infection when having completed a primary vaccination schedule whereas a HR > 1 indicates an increased hazard of SARS-CoV-2 infection.

Parameter estimate SE coefficient Robust SE P-value Hazard Ratio (HR) (95% CI for HR)
fully_vaccinated_blTRUE -0.64 0.009 0.012 0 0.527 (0.504, 0.55)

The overall significance of the model is tested.

Test statistic Df P-value
Likelihood ratio test 4936.412 1 0
Wald test 2984.200 1 0
Score (logrank) test 4930.189 1 0
Robust score test 2380.225 1 0

Proportional hazards during the study period might be unlikely. As such, the RMST and RMTL ratios are additionally calculated, providing an alternative estimate for the the Average Treatment Effect (ATE), without requiring the proportional hazards assumption to be met.

Arm Measure Estimate SE CI.lower CI.upper
fully_vaccinated_bl==FALSE RMST 280.554 0.416 279.738 281.370
fully_vaccinated_bl==TRUE RMST 316.724 0.338 316.063 317.386
fully_vaccinated_bl==FALSE RMTL 84.446 0.416 83.630 85.262
fully_vaccinated_bl==TRUE RMTL 48.276 0.338 47.614 48.937
Measure Estimate CI.lower CI.upper p_value
RMST (fully_vaccinated_bl==TRUE)-(fully_vaccinated_bl==FALSE) 36.170 35.120 37.221 0
RMST (fully_vaccinated_bl==TRUE)/(fully_vaccinated_bl==FALSE) 1.129 1.125 1.133 0
RMTL (fully_vaccinated_bl==TRUE)/(fully_vaccinated_bl==FALSE) 0.572 0.562 0.581 0