Table 3:

Efficiency and comprehensiveness of physician-generated searches with and without search filters, limited to the first 40 results retrieved

Clinical queries therapy filterNephrology filterSearch performancePercentage-point change from nonfiltered search (99% CI)p value*
BroadNarrowBroadNarrowEfficiency; ComprehensivenessMean, %
No filter (physician-provided searches)Efficiency5.5
Comprehensiveness12.7
xEfficiency5.60.1 (−1.8 to 2.1)0.86
Comprehensiveness13.30.6 (−1.6 to 2.8)0.38
xEfficiency23.117.6 (10.6 to 24.6)< 0.003
Comprehensiveness26.113.4 (5.5 to 21.3)< 0.003
xEfficiency4.5−1.0 (−2.2 to 0.2)0.006
Comprehensiveness9.9−2.8 (−6.8 to 1.3)<0.003
xEfficiency5.60.1 (−1.8 to 2.0)0.93
Comprehensiveness11.4−1.3 (−5.0 to 2.3)< 0.003
xxEfficiency4.5−1.0 (−3.0 to 1.0)0.09
Comprehensiveness11.3−1.4 (−5.3 to 2.5)0.002
xxEfficiency5.70.2 (−2.3 to 2.7)0.84
Comprehensiveness12.4−0.3 (−4.1 to 3.6)0.01
xxEfficiency19.614.1 (7.9 to 20.4)< 0.003
Comprehensiveness25.612.9 (4.9 to 21.0)0.98
xxEfficiency21.716.2 (9.4 to 23.0)< 0.003
Comprehensiveness26.814.1 (5.6 to 22.6)0.55
  • Note: CI = confidence interval.

  • * Bonferroni-adjusted α = 0.003.

  • Efficiency is the proportion of articles retrieved by the search query that are relevant to the search question (search precision, positive predictive value).

  • Comprehensiveness is the proportion of all relevant articles that are retrieved by the search query (search recall, sensitivity).