August 23, 2020

Understanding science

Normative errors and Surgisphere

Last month, the New York Times profiled Dr. Sapan Desai, founder of Surgisphere, the company that supplied the data for two recently retracted studies.

Read Time 4 minutes

On June 4th, the Lancet and the New England Journal of Medicine retracted two high-profile COVID-19 papers after critics challenged the data in those studies. The Lancet paper found COVID-19 patients treated with hydroxychloroquine and chloroquine were associated with more deaths and adverse effects, resulting in the World Health Organization halting its clinical trials that use hydroxychloroquine to treat COVID-19 patients. The NEJM study found that certain blood pressure drugs, including ACE inhibitors, were not associated with an increased risk of death among COVID-19 patients.   Last month, the New York Times profiled Dr. Sapan Desai, founder of Surgisphere, the company that supplied the data for both retracted studies. Desai is a co-author on both the Lancet and NEJM papers. The Times story should be a case study on the importance of “normative errors” and why they cannot be brushed aside in medicine (or, frankly, anywhere else).

For those of you who may have missed it, I did a podcast in early June with my daughter, Olivia, speaking about the George Floyd case. In that podcast, I talked about a training system for physicians that identifies and addresses different types of errors, using surgeons as an example, and how this type of system might be useful for law enforcement and other fields where the stakes are high. 

In medicine, and specifically in medical training, there are three types of errors: technical errors, judgmental errors, and normative errors. (Technically, there is a fourth called quasi-normative errors, but we’ll save that for another time.)

A technical error is an error in performance. “When a surgeon makes a technical error,” wrote Charles Bosk in Forgive and Remember: Managing Medical Failure, “he is performing his role conscientiously but his skills fall short of what the task requires.” These errors are expected to happen to everyone, but infrequently. When I was in residency as a surgeon, I once operated on a patient and accidentally cut the bile duct (a series of thin tubes that go from the liver to the small intestine). Is a surgeon forgiven for this type of error? Yes, but only on two conditions. One, he must admit his mistake immediately and take full responsibility. For an error to be defined as a technical one, the error needs to be swiftly noticed, reported, and treated. Two, he must not make the same mistake repeatedly. That is, he must learn from it. 

A judgmental error is an error in strategy. The two most common judgmental errors for surgeons, for example, are (1) operating on a patient that cannot tolerate the procedure or in whom surgery is not actually indicated (that is, operate when you should not) and (2) not operating on a patient when the situation demands it. In both cases, the surgeon believes she is acting in the best interest of the patient. Is a surgeon forgiven for this type of error? Yes, but only under the same two conditions that a technical error is forgiven.

A normative error is an error in character. More broadly, a normative error occurs when, in the eyes of others, a person has failed to perform his role obligations conscientiously. In other words, the person’s behavior goes against the accepted norms and values of medical practice. In this case, a physician covers up the truth or willfully neglects his duties. For example, a physician goes into the ER and sees someone who comes in with an infection and gives him penicillin. The physician didn’t ask the patient if he was allergic to the antibiotic, and the patient has an allergic reaction to it. The physician later claims he asked the patient if he had an allergy to the drug, and the patient said he didn’t. These types of errors can often seem like a small mistake, but they’re not. The physician is putting his own interest ahead of the patient. People who make these kinds of errors will go on to make bigger and bigger mistakes. Normative errors are not to be excused. They are a harbinger of the kind of gross negligence that winds up in tabloids.

A good training system in medicine fosters and encourages open and honest discussions of technical and judgment errors. Everyone can learn from them, and the system improves as a result. A good training system also has no tolerance for normative errors. The individuals that commit them are not only kicked out of the program they’re in, but kicked out of medicine entirely. This may seem harsh, but if a person commits a normative error and they are ejected from one program, only to be picked up by another, the problem doesn’t go away.

The Times article details a history of normative errors by Dr. Desai according to different sources. Former colleagues said he often did not follow through on directives about treating patients and was dishonest when confronted. In one instance, he didn’t return pages to the nurses while he was on call, and when asked about why he missed them, Desai said he was busy resuscitating an infant by performing a rare and complicated procedure: an incident the charge nurse and another doctor present for his explanation said never occurred. Several doctors recalled Dr. Desai saying he had a law degree—and a license plate listing it among his credentials: M.D., J.D., and Ph.D.—but there is no evidence of this being true. He became involved in at least four medical malpractice cases that are still pending, including three filed last year. 

As for the Surgisphere data, Desai said his data analytics product, called QuartzClinical, accumulated a registry with patient data from more than 1,200 hospitals and health centers, with data about more than 240 million (the WSJ reports 240 billion) patient encounters in 45 countries. One former Surgisphere employee told the Times that by the end of 2019, she knew of only one hospital that had signed a contract with QuartzClinical.

Typically, nobody shows up with the degree of corruption out of the gate to falsify and publish data concerning treatments for hospitalized patients in life-and-death situations. There’s usually a history of normative errors preceding it. If the accounts of colleagues and critics are correct, Desai left a trail spanning at least two decades in his wake. We must identify and call out normative errors when we see them and remove the people who make them. The stakes are too high to do otherwise. 

 

– Peter

Disclaimer: This blog is for general informational purposes only and does not constitute the practice of medicine, nursing or other professional health care services, including the giving of medical advice, and no doctor/patient relationship is formed. The use of information on this blog or materials linked from this blog is at the user's own risk. The content of this blog is not intended to be a substitute for professional medical advice, diagnosis, or treatment. Users should not disregard, or delay in obtaining, medical advice for any medical condition they may have, and should seek the assistance of their health care professionals for any such conditions.
  1. One of the things I hope doesn’t happen is that we lose the opportunity to make use of this pandemic to better prepare ourselves for when something similar occuring again.
    We are in a position to record and analyze data for future use and as much data as possible should be accurate to help us do so.

  2. Great article regarding the fraudulent doctor. I take exception however with two points you make; you state that the surgeon is “forgiven“ if they make a technical error such as accidentally cutting the bike duct, or a judge mental error in performing a necessary surgery or failing to perform one that is indicated.

    I’m not sure what context you are using the term “forgiven“, but I would assume that you would agree that in both of those examples there would have been a deviation from the acceptable standard of care, and the patient, or in the case of the patient’s demise, his survivors,Would have a claim against the physician for malpractice.
    The other example about fraudulent conduct, change in medical records, destroying medical records etc. most assuredly is the most egregious example of conduct on the part of a physician, and that conduct, if proven, which subject the physician most likely to an additional claim of punitive damages for such intentional egregious conduct.
    Curious if you agree with these observations.
    Thank you, and by the way I very much look forward to learning more about your fascinating interest in the study of longevity.
    Keep up the good work.

  3. Very nice article. You illustrated a very important topic in a concise and readable way. Since the topic was in response to false and misleading studies in reputable medical journals, which also received a lot of media coverage when they came out, it is equally important for people to recognize and “punish” normative errors by the editors of these journals and the media. Both groups appear to have demonstrated repeated normative errors in their fields. Should not we expect critical review and validation of such studies by these groups before they leverage their influence to spread the false results? Retractions way after the fact does not atone for their mistakes. That would be like the Dr. apologizing only once he was caught. There are still plenty of people who desire to understand the facts and complex truths about important topics that might impact their lives, like the effectiveness of a certain treatment during a pandemic for instance, over their desire for a momentary emotional charge received by news that supports their political, tribal identity. The medical journals and news outlets seem to increasingly prioritize the latter.

  4. Cue Andrew Wakefield and his falsified MMR study linking MMR vaccine and Autism, a serious scientific fraud that has been difficult to shake off the world over.

    People still believe in him and his fraudulent study despite evidence to the contrary. In fact, when he was put on trial by the UK General Medical Council, his supporters were out protesting his innocence claiming a witch-hunt.

    The anti-vaxxer seed was sown and its grown and grown ever since. Thanks to him. That surely will be his legacy.

  5. So, what does the literature say about the drugs mentioned? I am particularly interested in following the studies, and I do a fair amount of research on my own, about the impact of Covid 19 with those patients who take ACE Inhibitors.

Facebook icon Twitter icon Instagram icon Pinterest icon Google+ icon YouTube icon LinkedIn icon Contact icon