Reasoning Strategy | Deductive Only | Deductive + Plausible (Without Expert’s Verification) | Deductive + Plausible (With Expert’s Verification) | Deductive Only | Deductive + Plausible (Without Expert’s Verification) | Deductive + Plausible (With Expert’s Verification) | Deductive Only | Deductive + Plausible (Without Expert’s Verification) | Deductive + Plausible (With Expert’s Verification) | Deductive Only | Deductive + Plausible (Without Expert’s Verification) | Deductive + Plausible (With Expert’s Verification) | Deductive Only | Deductive + Plausible (Without Expert’s Verification) | Deductive + Plausible (With Expert’s Verification) | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
 |  | Dataset #5–1 | Dataset #5–2 | Dataset #5–3 | Dataset #5–4 | Dataset #5–5 | ||||||||||
5% Missing Data | #Queries answered correctly | 141 | 150 | 144 | 136 | 148 | 138 | 139 | 150 | 144 | 140 | 150 | 145 | 142 | 149 | 144 |
#Queries answered incorrectly | 7 | 4 | 7 | 8 | 6 | 8 | 8 | 4 | 9 | 8 | 4 | 8 | 7 | 3 | 7 | |
#Queries unanswered | 7 | 1 | 4 | 11 | 1 | 9 | 8 | 1 | 2 | 7 | 1 | 2 | 6 | 3 | 4 | |
# Plausible Rules | N/A | 3 | 2 | N/A | 5 | 1 | N/A | 6 | 3 | N/A | 2 | 2 | N/A | 3 | 1 | |
# Plausible Facts | N/A | 4 | 1 | N/A | 1 | 4 | N/A | 3 | 3 | N/A | 2 | 2 | N/A | 1 | 2 | |
Coverage | 95% | 99% | 97% | 93% | 99% | 94% | 95% | 99% | 99% | 95% | 99% | 99% | 96% | 98% | 97% | |
Correctness | 95% | 97% | 95% | 94% | 96% | 95% | 95% | 97% | 94% | 95% | 97% | 95% | 95% | 98% | 95% | |
 | Dataset #10–1 | Dataset #10–2 | Dataset #10–3 | Dataset #10–4 | Dataset #10–5 | |||||||||||
10% Missing Data | #Queries answered correctly | 128 | 155 | 144 | 135 | 150 | 142 | 133 | 151 | 144 | 131 | 152 | 141 | 137 | 151 | 143 |
#Queries answered incorrectly | 8 | 0 | 8 | 6 | 3 | 8 | 7 | 3 | 7 | 10 | 3 | 8 | 6 | 3 | 6 | |
#Queries unanswered | 19 | 0 | 3 | 14 | 2 | 5 | 15 | 1 | 4 | 14 | 0 | 6 | 12 | 1 | 6 | |
# Plausible Rules | N/A | 4 | 3 | N/A | 4 | 1 | N/A | 7 | 3 | N/A | 4 | 2 | N/A | 6 | 2 | |
# Plausible Facts | N/A | 3 | 4 | N/A | 3 | 2 | N/A | 1 | 2 | N/A | 1 | 8 | N/A | 3 | 3 | |
Coverage | 88% | 100% | 98% | 91% | 99% | 97% | 90% | 99% | 97% | 91% | 100% | 96% | 92% | 99% | 96% | |
Correctness | 94% | 100% | 95% | 96% | 98% | 95% | 95% | 98% | 95% | 93% | 98% | 95% | 96% | 98% | 96% | |
 | Dataset #15–1 | Dataset #15–2 | Dataset #15–3 | Dataset #15–4 | Dataset #15–5 | |||||||||||
15% Missing Data | #Queries answered correctly | 119 | 150 | 146 | 128 | 151 | 140 | 124 | 147 | 139 | 113 | 147 | 141 | 128 | 150 | 142 |
#Queries answered incorrectly | 9 | 4 | 7 | 9 | 4 | 10 | 9 | 5 | 9 | 8 | 8 | 9 | 9 | 4 | 8 | |
#Queries unanswered | 27 | 1 | 2 | 18 | 0 | 5 | 22 | 3 | 7 | 34 | 0 | 5 | 18 | 1 | 5 | |
# Plausible Rules | N/A | 6 | 5 | N/A | 5 | 2 | N/A | 5 | 4 | N/A | 8 | 4 | N/A | 6 | 3 | |
# Plausible Facts | N/A | 1 | 1 | N/A | 3 | 2 | N/A | 0 | 0 | N/A | 3 | 3 | N/A | 1 | 3 | |
Coverage | 83% | 99% | 99% | 88% | 100% | 97% | 86% | 98% | 95% | 78% | 100% | 97% | 88% | 99% | 97% | |
Correctness | 93% | 97% | 95% | 93% | 97% | 93% | 93% | 97% | 94% | 93% | 95% | 94% | 93% | 97% | 95% | |
 | Dataset #20–1 | Dataset #20–2 | Dataset #20–3 | Dataset #20–4 | Dataset #20–5 | |||||||||||
20% Missing Data | #Queries answered correctly | 111 | 143 | 135 | 115 | 152 | 138 | 113 | 150 | 140 | 111 | 148 | 135 | 113 | 148 | 129 |
#Queries answered incorrectly | 9 | 10 | 10 | 9 | 3 | 10 | 12 | 5 | 10 | 10 | 7 | 13 | 11 | 7 | 13 | |
#Queries unanswered | 35 | 2 | 10 | 31 | 0 | 7 | 30 | 0 | 5 | 34 | 0 | 7 | 31 | 0 | 13 | |
# Plausible Rules | N/A | 6 | 5 | N/A | 8 | 3 | N/A | 7 | 3 | N/A | 6 | 3 | N/A | 8 | 4 | |
# Plausible Facts | N/A | 4 | 5 | N/A | 1 | 1 | N/A | 4 | 4 | N/A | 3 | 4 | N/A | 4 | 4 | |
Coverage | 77% | 99% | 94% | 80% | 100% | 95% | 81% | 100% | 97% | 78% | 100% | 95% | 80% | 100% | 92% | |
Correctness | 93% | 93% | 93% | 93% | 98% | 93% | 90% | 97% | 93% | 92% | 95% | 91% | 91% | 95% | 91% |