Skip to main content

Table 3 Number of scenarios for which PICV yielded smaller median, maximum differences between training and testing

From: Improving machine learning reproducibility in genetic association studies with proportional instance cross validation (PICV)

Measure, Model PICV median less than traditional CV median (out of 15) PICV maximum less than traditional CV maximum (out of 15)
Prevalence Prevalence
0.02 0.1 0.5 0.02 0.1 0.5
Specificity, without interaction 15 15 12 15 15 15
Specificity, with interaction 15 15 15 15 15 15
NPV, without interaction 14 9 9 11 8 8
NPV, with interaction 8 9 10 8 9 9