#Cancer #AI
"Doctors Catch Cancer-Diagnosing AI Extracting Patients’ Race Data and Being Racist With It
'Reading demographics from a pathology slide is thought of as a 'mission impossible' for a human pathologist, so the bias in pathology AI was a surprise to us.
To conduct the study, researchers at Harvard University combed through nearly 29,000 cancer pathology images from some 14,400 cancer patients. Their analysis found that the deep learning models exhibited alarming biases 29.3 percent of the time — on nearly a third of all the diagnostic tasks they were assigned, in other words.
'We found that because AI is so powerful, it can differentiate many obscure biological signals that cannot be detected by standard human evaluation,' Harvard researcher Kun-Hsing Yu, a senior author of the study, said in a press release. 'Reading demographics from a pathology slide is thought of as a ‘mission impossible’ for a human pathologist, so the bias in pathology AI was a surprise to us.'
Yu said that these bias-based errors are the result of AI models relying on patterns linked to various demographics when analyzing cancer tissue. In other words, once the four AI tools locked onto a person’s age, race, or gender, those factors would form the backbone of the tissue analysis. In effect, AI would go on to replicate bias resulting from gaps in AI training data.
The AI tools were able to identify samples taken specifically from Black people, to give a concrete example. These cancer slides, the authors wrote, contained higher counts of abnormal, neoplastic cells, and lower counts of supportive elements than those from white patients, allowing AI to sniff them out, even though the samples were anonymous.
Then came the trouble. Once an AI pathology tool had identified a person’s race, they became overly-obsessed with finding previous analyses that fit that particular identifier. But when the model was trained mostly on data from white people, the tools would struggle with those who aren’t as represented. The AI models had trouble distinguishing subclasses of lung cancer cells in Black people, for example — not because there was a lack of lung cancer data for them to draw from, but because there was lacking data from Black lung cancer cells to draw from."
Futurism
Doctors Catch Cancer-Diagnosing AI Extracting Patients' Race Data and Being Racist With It
A new study reveals an alarming bias present in four leading AI cancer screening tools, related to race, gender, and age.
