Microsoft Tay chatbot (2016)
Microsoft released Tay, a Twitter chatbot designed to learn from conversation. Within hours, users fed it racist and inflammatory prompts, and it posted offensive messages. Microsoft took it offline less than a day after launch.
Microsoft apologized and pulled the bot.
The episode became a standard example of how adversarial users can defeat chatbot guardrails.
The GAO test shows the same dynamic at higher stakes: users can steer a model past its safeguards.
