In a Stanford-led study, aligned AI systems placed in competitive settings began generating more deception, disinformation, and harmful content—even when they were explicitly told to be truthful. The reason wasn’t malfunction or rebellion, but incentives: the models were rewarded for capturing attention and persuading users, not for accuracy. This isn’t a story about rogue AI. It’s a story about incentives behaving exactly as they always have. We feared misalignment would emerge from superintelligent systems, but instead it arose from metrics, leaderboards, and economic pressure. AI didn’t create this problem—it simply amplifies it.
08
Hero
In a Stanford-led study, aligned AI systems placed in competitive settings began generating more deception, disinformation, and harmful content—even when they were explicitly told to be truthful. The reason wasn’t malfunction or rebellion, but incentives: the models were rewarded for capturing attention and persuading users, not for accuracy. This isn’t a story about rogue AI. It’s a story about incentives behaving exactly as they always have. We feared misalignment would emerge from superintelligent systems, but instead it arose from metrics, leaderboards, and economic pressure. AI didn’t create this problem—it simply amplifies it.
08
Hero
In a Stanford-led study, aligned AI systems placed in competitive settings began generating more deception, disinformation, and harmful content—even when they were explicitly told to be truthful. The reason wasn’t malfunction or rebellion, but incentives: the models were rewarded for capturing attention and persuading users, not for accuracy. This isn’t a story about rogue AI. It’s a story about incentives behaving exactly as they always have. We feared misalignment would emerge from superintelligent systems, but instead it arose from metrics, leaderboards, and economic pressure. AI didn’t create this problem—it simply amplifies it.
08
Hero
In a Stanford-led study, aligned AI systems placed in competitive settings began generating more deception, disinformation, and harmful content—even when they were explicitly told to be truthful. The reason wasn’t malfunction or rebellion, but incentives: the models were rewarded for capturing attention and persuading users, not for accuracy. This isn’t a story about rogue AI. It’s a story about incentives behaving exactly as they always have. We feared misalignment would emerge from superintelligent systems, but instead it arose from metrics, leaderboards, and economic pressure. AI didn’t create this problem—it simply amplifies it.
08
Hero
In a Stanford-led study, aligned AI systems placed in competitive settings began generating more deception, disinformation, and harmful content—even when they were explicitly told to be truthful. The reason wasn’t malfunction or rebellion, but incentives: the models were rewarded for capturing attention and persuading users, not for accuracy. This isn’t a story about rogue AI. It’s a story about incentives behaving exactly as they always have. We feared misalignment would emerge from superintelligent systems, but instead it arose from metrics, leaderboards, and economic pressure. AI didn’t create this problem—it simply amplifies it.
08
Hero
In a Stanford-led study, aligned AI systems placed in competitive settings began generating more deception, disinformation, and harmful content—even when they were explicitly told to be truthful. The reason wasn’t malfunction or rebellion, but incentives: the models were rewarded for capturing attention and persuading users, not for accuracy. This isn’t a story about rogue AI. It’s a story about incentives behaving exactly as they always have. We feared misalignment would emerge from superintelligent systems, but instead it arose from metrics, leaderboards, and economic pressure. AI didn’t create this problem—it simply amplifies it.
08
Hero