Comparison of the average percentage of accurate of responses before and after interventions and tests of significance
| N | Average % of accurate responses before intervention (SD) | Average % of accurate responses after intervention (SD) | Difference in % before and after (95% CI)* | Test of significance for each department and overall (p value)† | Does the amount of improvement differ by department? (p value)† | |
|---|---|---|---|---|---|---|
| Abstract-only (intervention 1) | ||||||
| Department | ||||||
| Surgery | 10 | 48 (27) | 62 (15) | 14 (0 to 40) | 0.16 | |
| Internal medicine | 10 | 36 (18) | 66 (16) | 30 (20 to 60) | 0.003 | 0.06 |
| Emergency medicine | 10 | 54 (21) | 72 (14) | 18 (0 to 40) | 0.06 | |
| Family medicine | 8 | 25 (14) | 75 (14) | 50 (40 to 60) | <0.0001 | |
| Overall | 38 | 42 (23) | 68 (15) | 27 (20 to 40) | <0.0001 | |
| Full-text (intervention 2) | ||||||
| Department | ||||||
| Surgery | 10 | 60 (13) | 86 (0.16) | 26 (20 to 40) | 0.003 | |
| Internal medicine | 10 | 46 (16) | 68 (0.1) | 22 (0 to 40) | 0.03 | 0.0001 |
| Emergency medicine | 10 | 64 (25) | 64 (0.23) | 0 (−20 to 20) | 1.0 | |
| Family medicine | 9 | 20 (14) | 82 (0.21) | 62 (40 to 80) | <0.0001 | |
| Overall | 39 | 48 (24) | 75 (0.2) | 27 (20 to 40) | <0.0001 | |
*95% CI based on Wilcoxon test.
†Based on values from the logistic regression mixed model.