Training data bias reduced Black patient care identification by half.
A study published in Science revealed that a healthcare algorithm showed racial bias in patient care. Specifically, Black patients who were assigned the same risk level as White patients were actually sicker. This bias had serious consequences, reducing the number of Black patients identified for extra care by more than half. The study points to initial training data as often being the culprit for such algorithmic bias, demonstrating how AI systems can perpetuate inequities in critical areas like healthcare.
— President Biden Is Man, Woman And 40 Years Old - Why We Need Algorithmic Transparency · Forbes