5. Reward hacking / specification gamingWhen an AI system finds a way to maximize its reward function in a way that doesn't match the developers' actual intent (e.g., a game-playing AI that exploits a bug instead of playing the game "fairly.")
Gnostotheca 9315
