The Real World Failure of Evidence-Based Medicine

Main Article Content

Clifford G Miller
Donald W. Miller

Abstract

As a way to make medical decisions, Evidence-Based Medicine (EBM) has failed. EBM's failure arises from not being founded on real-world decision-making. EBM aspires to a scientific standard for the best way to treat a disease and determine its cause, but it fails to recognise that the scientific method is inapplicable to medical and other real-world decision-making. EBM also wrongly assumes that evidence can be marshaled and applied according to an hierarchy that is determined in an argument by authority to the method by which it has been obtained. If EBM had valid theoretical, practical or empirical foundations, there would be no hierarchy of evidence. In all real-world decision-making, evidence stands or falls on its inherent reliability. This has to be and can only be assessed on a case-by-case basis applying understanding and wisdom against the background of all available facts—the “factual matrix.” EBM's failure is structural and was inevitable from its inception. EBM confuses the inherent reliability and probative value of evidence with the means by which it is obtained.EBM is therefore an ad hoc construct and is not a valid basis for medical decision-making. This is further demonstrated by its exclusion of relevant scientific and probative real-world decision-making evidence and processes. It draws upon a narrow evidence base that is itself inherently unreliable. It fails to take adequate account of the nature of causation, the full range of evidence relevant to its determination, and differing approaches to determining cause and effect in real-world decision-making. EBM also makes a muddled attempt to emulate the scientific method and it does not acknowledge the role of experience, understanding and wisdom in making medical decisions.

Article Details

Section
Regular Articles
Author Biographies

Clifford G Miller, Supreme Court of England & Wales and former Lecturer in Law, Imperial College, London, UK

Solicitor, Supreme Court of England & Wales and former Lecturer in Law, Imperial College, London, UK

Donald W. Miller, Professor of Surgery, Division of Cardiothoracic Surgery, University of Washington School of Medicine, Seattle, Washington, USA.

Professor of Surgery, Division of Cardiothoracic Surgery, University of Washington School of Medicine, Seattle, Washington, USA.

References

. Cohen,A.M., Stavri, P.Z., Hersh, W.R. (2004). A categorization and analysis of the criticisms of Evidence-Based Medicine. International Journal of Medical Informatics 73, 35-43.

. Oxford Centre for Evidence-Based Medicine – Levels of Evidence (2009, March) Available at: http://www.cebm.net/index.aspx?o=1025 Accessed 7 February 2011.

. Penston, J. (2010). Stats.con: How we’ve been fooled by statistics-based research in medicine. UK: The London Press.

. Saver, J.L. and Kalafut, M. (2001). Combination therapies and the theoretical limits of evidence-based medicine. Neuroepidemiology 20, 57-64.

. Ackoff, R.L. (1989). From Data to Wisdom. Journal of Applied Systems Analysis 16, 3-9.

. Surgeon General’s Advisory Committee on Smoking and Health: Smoking and Health (1964). United States Department of Health, Education and Welfare, Public Health Service Publication No. 1103.

. Hill, A.B. (1965). The environment and disease: association or causation? Proceedings of the Royal Society of Medicine 58, 295-300.

. Feinstein, A.R. (1979). Clinical biostatistics. Scientific standards vs. statistical association and biologic logic in the analysis of causation. Clinical Pharmacology and Therapeutics 25, 481-492.

. Susser, M. (1986). Rules of inference in epidemiology. Regulatory Toxicology and Pharmacology 6, 116-128.

. Brown, L.M. (2000). Heliobacter pylori: epidemiology and routes of transmission. Epidemiology Reviews, 22,283-297. Available at: http://epirev.oxfordjournals.org/content/22/2/283.long Accessed June 7, 2001.

. Miller, D.W. and Miller, C.G. (2005). On evidence medical and legal. Journal of American Physicians and Surgeons 10, 70-75.

. Smith, R. (2009). In Search Of an Optimal Peer Review System. Journal of Participatory Medicine 1, (1) e13.

. Godlee, F. (2006). Editor’s Choice. Of measles and flu. British Medical Journal 333, doi: 10.1136/bmj.333.7574.0-f (published 26 October 2006).

. Smith, R. (2010). Scrap peer review and beware of “top journals”. British Medical Journal group blogs. Available at: http://blogs.bmj.com/bmj/2010/03/22/richard-smith-scrap-peer-review-and-beware-of-%e2%80%9ctop-journals%e2%80%9d Accessed June 7, 2011.

. Rout, M. (2009). Doctors signed Merck’s Vioxx studies The Australian, April 2009. Available at: http://www.theaustralian.com.au/news/doctors-signed-vioxx-studies/story-e6frg6no-1225696993365 Accessed June 7, 2011.

. Charlton, B.G. and Miles, A. (1998). The Rise and Fall of EBM. Quarterly Journal of Medicine 91, 371-374.

. Silverman, M.E., Murray, T.J. and Bryan, C.S., eds. (2002). The Quotable Osler. Philadelphia: American College of Physicians.

. Brownlee, S. (2004). Doctors without borders: why you can’t trust medical journals anymore. Washington Monthly (April). Available at: http://www.washingtonmonthly.com/features/2004/0404.brownlee.html Accessed May 31, 2011.

. Kirby, D. (2005). Evidence of Harm: Mercury in Vaccines and the Autism Epidemic: A Medical Controversy. New York: St. Martin’s Press.

. Zaman, K., Roy, E., Arifeen, S.E., Rahman, M., Raqib, R., Wilson, E., Omer, S.B., Shahid, N.S., Breiman, R.F. and Steinhoff, M.C. (2008). Effectiveness of maternal influenza immunization in mothers and infants. New England Journal of Medicine 359(15), 1555-1564.

. Jefferson, T., Di Pietrantonj, C., Rivetti, A., Bawazeer, G.A., Al-Ansary, L.A.and Ferroni, E. (2010). Vaccines for preventing influenza in healthy adults (Review). The Cochrane Library July 7 issue, 1-104.

. Curtis, N. (2010). The Cholesterol Delusion. Indianapolis, IN: Dog Ear Publishing.

. Miller, D.W. (2008). Questioning HIV/AIDS, Human-Caused Global Warming and other Orthodoxies in the Biomedical Sciences. Lew Rockwell.com (March 4). Available at: http://www.lewrockwell.com/miller/miller26.html Accessed June 1,2011.