Safely Interruptible Agents (2016)
Laurent Orseau, then at Google DeepMind, and Stuart Armstrong of the Future of Humanity Institute published a paper on interrupting a reinforcement-learning agent without teaching it to avoid interruption. The problem was theoretical: an agent that learns a shutdown button can be pressed may learn to prevent it.
The paper framed safe interruption as a design problem, not a button.
It became a reference point for AI safety work on keeping humans in control of learned systems.
CrowdStrike's switch is the engineering version of that problem: a stop an agent cannot route around.
