Using electronic knowledge resources for person-centered medicine - II: The Number Needed to Benefit from Information (NNBI)

Article Sidebar

Requires Subscription or Fee PDF (USD 25)
Published: Jun 30, 2011
DOI: https://doi.org/10.5750/ijpcm.v1i2.83

Main Article Content

Pierre Pluye
Department of Family Medicine, McGill University, Montreal, Quebec, Canada
Roland M. Grad
Department of Family Medicine, McGill University, Montreal, Quebec, Canada
Naveen Mysore
Information Technology Primary Care Research Group, Department of Family Medicine, McGill University, Montreal, Quebec, Canada
Michael Shulha
Information Technology Primary Care Research Group, Department of Family Medicine, McGill University, Montreal, Quebec, Canada
Janique Johnson-Lafleur
Information Technology Primary Care Research Group, Department of Family Medicine, McGill University, Montreal, Quebec, Canada

Abstract

Rationale: Electronic knowledge resources are routinely searched by physicians for clinical information in practice. With respect to searching, no studies have systematically assessed the relevance of clinical information, its cognitive impact, the use of information for specific patients and information-related patient health benefits. In our companion paper (Part 1) we critically reviewed the literature and proposed a model of the value of clinical information for health professionals, which includes types of information use and subsequent patient health benefits.Aims and objectives: The purpose of the present paper (Part 2) is to systematically examine patient health benefits associated with physicians’ use of information retrieved from one electronic knowledge resource in routine clinical practice. Methods: Longitudinal mixed methods study. Cases were 84 critical searches for information for patients conducted by 16 family medicine residents over two months. Using the Information Assessment Method (IAM), each ‘opened’ information object was linked to a questionnaire (n = 309). IAM permitted residents to systematically document the cognitive impact of information. Guided by reports of quantitative data, residents were interviewed to explore the search context, the cognitive impact, the use of information and information-related patient health benefits.Results and conclusion: Our results suggest patterns of information use and show that 14.3% of residents’ searches were associated with health benefits. This suggests a new concept we refer to as the Number Needed to Benefit from Information (NNBI). In this study, the number of patients for whom information was retrieved to observe health benefits for one patient, was seven.

Article Details

Issue
Vol. 1 No. 2 (2011): June
Section
Regular Articles
Author Biographies

Pierre Pluye, Department of Family Medicine, McGill University, Montreal, Quebec, Canada

Associate Professor

Roland M. Grad, Department of Family Medicine, McGill University, Montreal, Quebec, Canada

Associate Professor

Naveen Mysore, Information Technology Primary Care Research Group, Department of Family Medicine, McGill University, Montreal, Quebec, Canada

Associate Professor

Michael Shulha, Information Technology Primary Care Research Group, Department of Family Medicine, McGill University, Montreal, Quebec, Canada

Research Assistant

Janique Johnson-Lafleur, Information Technology Primary Care Research Group, Department of Family Medicine, McGill University, Montreal, Quebec, Canada

Research Assistant

References

. Creswell, J. W. and Plano Clark, V. L. (2007) Designing and conducting mixed methods research. Thousand Oaks: Sage.

. Yin, R. K. (2009) Case study research : Design and methods. Thousand Oaks: Sage.

. O'Cathain, A., Murphy, E. and Nicholl, J. (2010) Three techniques for integrating data in mixed methods studies. British Medical Journal 341(7783), 1147-1150.

. Grad, R. M., Pluye, P., Meng, Y., Segal, B. and Tamblyn, R. (2005) Assessing the impact of clinical information-retrieval technology in a family practice residency. Journal of Evaluation in Clinical Practice 11(6), 575-586.

. Flanagan, J. C. (1954) The critical incident technique. Psychological Bulletin 51(4), 327-358.

. Paillé, P. (1996) De l’analyse qualitative en général et de l’analyse thématique en particulier. Recherches Qualitatives 15, 179-194.

. Cook, R. J. and Sackett, D. L. (1995) The number needed to treat: A clinically useful measure of treatment effect. British Medical Journal 22(310), 452-454.

. Shekelle, P. G., Takata, G., Newberry, S. J. et al. (2010) Management of acute otitis media: Update. Evidence Report/Technology Assessment No 198. Retrieved on April 2, 2011, from doi:http://www.ahrq.gov/downloads/pub/evidence/pdf/otitis/otitisup.pdf

. Toth, B., Muir Gray, J. A. and Brice, A. (2005) The number needed to read: A new measure of journal value. Health Information and Libraries Journal 22(2), 81-82.

. Pluye, P., Grad, R. M., Levine, A. and Nicolau, B. (2009) Understanding divergence of quantitative and qualitative data (or results) in mixed methods studies. International Journal of Multiple Research Approaches 3(1), 58-72.

. Westbrook, J. I., Coiera, E. W., Gosling, A. S. & Braithwaite, J. (2007) Critical incidents and journey mapping as techniques to evaluate the impact of online evidence retrieval systems on health care delivery and patient outcomes. International Journal of Medical Informatics 76(2-3), 234-245.

. Lindberg, D. A., Siegel, E. R., Rapp, B. A., Wallingford, K. T. and Wilson, S. R. (1993) Use of MEDLINE by physicians for clinical problem solving. Journal of the American Medical Association 269(24), 3124-3129.

. Wilson, S. R., Starr-Schneidkraut, N. and Cooper, M. D. (1989). Use of the critical incident technique to evaluate the impact of MEDLINE: Final report. Bethesda: National Library of

Medicine, Office of Health Information Programs Development. Retrieved February 11, 2010, from http://www.nlm.nih.gov/archive/20040721/od/ope/cit.html

. McKibbon, K. A. and Fridsma, D. B. (2006) Effectiveness of clinician-selected electronic information resources for answering primary care physicians information needs. Journal of the American Medical Informatics Association 13(6), 653-659.

. Westbrook, J. I., Gosling, A. S. and Coirea, E. W. (2005) The impact of an online evidence system on confidence in decision making in a controlled setting. Medical Decision Making 25(2), 178-185.

. Pluye, P., Grad, R. M., Repchinsky, C. et al. (2009) IAM: A comprehensive and systematic information assessment method for electronic knowledge resources. In Handbook of research on it management and clinical data administration in healthcare (ed A. Dwivedi), Vol. 2, pp. 521-548. Hershey: IGI Publishing.

. Ely, J. W., Osheroff, J. A., Chambliss, M. L., Ebell, M. H. and Rosenbaum, M. E. (2005) Answering physicians' clinical questions: Obstacles and potential solution. Journal of the American Medical Informatics Association 12(2), 217-224.

. Magrabi, F., Westbrook, J. I. and Coiera, E. W. (2007) What factors are associated with the integration of evidence retrieval technology into routine general practice settings? International Journal of Medical Informatics 76(10), 701-709.