Skip to main content

Table 4 Predictive performance of blending models, SAPS II and refitted SOFA on test set

From: Development and validation of a novel blending machine learning model for hospital mortality prediction in ICU patients with Sepsis

  Accuracy
[95% CI]
Recall
[95% CI]
Precision
[95% CI]
F1 score
[95% CI]
AUPRC
[95% CI]
AUROC
[95% CI]
P-value for comparison between AUROCs
BM_total 0.845
[0.844, 0.846]
0.203
[0.190, 0.216]
0.748
[0.737, 0.758]
0.318
[0.302, 0.335]
0.536
[0.534, 0.539]
0.815
[0.808, 0.822]
vs. BM_reg: p = 0.251
BM_reg 0.845
[0.844, 0.845]
0.192
[0.183, 0.201]
0.768
[0.759, 0.776]
0.306
[0.295, 0.318]
0.542
[0.540, 0.544]
0.817
[0.810, 0.823]
vs. BM_SAPSII: p < 0.001
vs. BM_SOFA: p < 0.001
BM_SAPSII 0.842
[0.841, 0.844]
0.198
[0.179, 0.216]
0.726
[0.706, 0.746]
0.309
[0.286, 0.331]
0.515
[0.511, 0.518]
0.806
[0.799, 0.813]
vs. SAPSII: p < 0.001
BM_SOFA 0.835
[0.834, 0.836]
0.154
[0.145, 0.163]
0.679
[0.668, 0.690]
0.251
[0.239, 0.262]
0.428
[0.426, 0.431]
0.742
[0.734, 0.749]
vs. SOFA: p < 0.001
SAPS II 0.798 0.458 0.438 0.448 0.429 0.771
[0.764, 0.779]
 
Refitted SOFA 0.833 0.130 0.680 0.218 0.381 0.706
[0.698, 0.714]
 
  1. Abbreviations: AUPRC area under the precision-recall curve, AUROC area under the receiver operating characteristic curve, CI confidence interval, SAPS II Simplified Acute Physiology Score II, SOFA Sequential Organ Failure Assessment, BM_total blending model based on the total variables, BM_reg blending model based on variables selected by stepwise regression model, BM_SAPSII blending model based on SAPS II related variables, BM_SOFA blending model based on SOFA related variables