AI can help screen for cancer—but there’s a catch

Why this might be isn’t totally clear. It could be because of design flaws in the study. The trials the authors included in their analysis might not have followed participants long enough to see a difference.  Another explanation is that the benefits of screening for some may be outweighed by the harms for others who don’t benefit. For example, if screening catches deadly cancers early, patients might gain precious time to successfully treat the disease.  But if a screening is catching many cancers that aren’t killing people, the balance tips. The problem is known as overdiagnosis. I like this description from a team of researchers in Australia: “Overdiagnosis is not a false-positive diagnosis (diagnosing a disease in an individual who does not meet diagnostic criteria) or a misdiagnosis (diagnosing the wrong condition in an individual who does have an underlying disease).” The diagnosis is correct, but it will provide little to no health benefit for the patient and may even result in harm.

There is no question that screening programs have caught cancers that would have killed people had they gone undetected. So why worry about overdiagnosis? Screening can also cause harm. Patients undergoing colonoscopies sometimes end up with a perforated bowel. Biopsies can lead to infection. Treatments like radiation and chemotherapy come with serious risks to people’s health, and so does surgery to remove tumors.

So will AI-assisted screening lead to more overdiagnosis? I checked in with Adewole Adamson, a dermatologist and researcher at the Dell School of Medicine at the University of Texas at Austin. “Without reservation I would say ‘Yes, it will,’” he says. “People think that the goal is to find more cancer. That’s not our goal. Our goal is to find cancers that will ultimately kill people.”  

And that’s tricky. For the vast majority of cancers, there aren’t good ways to separate nonlethal cases from lethal ones. So doctors often treat them all as if they might be deadly.
In a 2019 paper, Adamson explains how these cancer-detecting algorithms learn. The computer is presented with images that are labeled “cancer” or “not cancer.” The algorithm then looks for patterns to help it discriminate. “The problem is that there is no single right answer to the question, “What constitutes cancer?” Adamson writes. “Diagnoses of early-stage cancer made using machine-learning algorithms will undoubtedly be more consistent and more replicable than those based on human interpretation. But they won’t necessarily be closer to the truth—that is, algorithms may not be any better than humans at determining which tumors are destined to cause symptoms or death.”

But there’s also a chance AI might help address the problem of overdiagnosis. The Australian researchers I referenced above offer up this example: AI could use the information embedded in medical records to examine the trajectories of different patients’ cancers over time. In this scenario, it might be possible to distinguish those who don’t benefit from a diagnosis.

Adamson isn’t anti-AI. He sees value in simply adding a third category to the data that the algorithms learn from: “Maybe cancer.” This classification would encompass slides or images that provoke disagreement among experts. For those patients, “maybe you investigate treatments that are a bit more conservative.”

So it’s probably too early to make a ruling on AI’s role in cancer diagnoses, but we should probably read any future claims about AI cancer screening with a more skeptical eye. For his part, Adamson is tired of seeing headlines trumpet the power of AI to catch more cancers. “People get duped by those kinds of headlines into thinking that finding more cancer is better,” he says. “I want to rip my hair out, if I had any.”

Another thing

Last week I wrote about what you should know about this fall’s covid vaccines. This week, I have another story on the site about who is expected to benefit most from the vaccines, which were endorsed by the CDC on September 12.

Read more from Tech Review’s archive

When radiologists and AI work together, they can catch more breast cancer cases than either can on their own. Hana Kiros has the story. 

AI might also hold promise for skin cancer, Megan Lewis reports.