IBM Watson for Oncology disappointment (2013-2018)
IBM marketed Watson as an AI system that could recommend cancer treatments by analyzing patient records and medical literature. Over five years, hospitals in the United States, India, South Korea, and elsewhere deployed it. Internal IBM documents later revealed the system frequently made unsafe and incorrect treatment recommendations, and its training relied heavily on a small number of doctors at Memorial Sloan Kettering rather than broad medical evidence.
Several hospitals abandoned Watson for Oncology. IBM's healthcare AI division lost credibility and was eventually sold to Francisco Partners in 2022 for roughly $1 billion — a fraction of the estimated $4 billion IBM had invested.
Watson became shorthand for the gap between AI marketing and AI reality in healthcare. It raised lasting questions about validation standards for AI systems making scientific or medical recommendations.
The AI Co-Scientist faces the same fundamental challenge Watson did: proving that AI-generated scientific recommendations are reliable enough to act on. Google's strategy of publishing validated results in peer-reviewed journals and running a Trusted Tester Program suggests it learned from Watson's failure to establish credibility through rigorous, independent validation rather than marketing claims.
