The Dangerous Ideology Behind the AI Warnings

Author: Shyam Sankar (The Free Press, The Big Read) URL: https://www.thefp.com/p/dangerous-ideology-effective-altruism-artificial-intelligence One-line: The week’s AI-extinction warnings shouldn’t be taken at face value: they are infused with Effective Altruism, the ideology Sam Bankman-Fried said drove him, and what looks like a responsible plea to slow progress is really about taking control of AI out of the hands of ordinary Americans.

[PARTIAL] This capture is the free email preview only. It contains the editors’ note, the photo caption and the first three paragraphs of Sankar’s essay, and cuts off mid-argument at the line about SBF’s 25-year prison sentence (“…sentenced to 25 years in prison…”), just before “Continue reading” and the subscribe wall. Sankar’s case for how EA shaped the safety movement, and what he proposes instead, is NOT in this capture.

Key claims

• Sankar represents a distinct camp. The Free Press editors frame the piece as the third view after a week of pieces from Niall Ferguson and Daniel Kokotajlo (rising risk of AI catastrophe) and Tyler Cowen (slowing AI won’t necessarily impede progress): the view that warnings from AI researchers and leaders “should not be taken at face value.” They describe Sankar, CTO and EVP at Palantir, as an influential member of that camp.
• The warnings began with one resignation and a media tour. On September 8 Jacob Coxon, “a software engineer who resigned from Anthropic,” posted on X that “[t]he people building AI earnestly believe that it could kill us all by the end of the decade,” then went on cable news. A current frontier-lab employee (Evan Hubinger, unnamed in the preview) confirmed that he and many colleagues put the odds of AI killing everyone at perhaps more than 10 percent.
• The result was a firestorm and calls for regulation. Sankar calls the warnings “vague and apocalyptic” and says they produced calls for AI safety regulation from the leaders of almost every major AI company. “But there is reason for skepticism.”
• The skepticism rests on who is behind the warnings. The warnings “are infused with an ideology called effective altruism (EA).” The caption calls EA “the unseen force driving AI safety discourse.”
• SBF is the cautionary example. EA is the idea Sam Bankman-Fried said motivated him: make a fortune with FTX and give it away to protect humanity’s future, especially from big existential risks. “Instead, he stole billions from his customers and was sentenced to 25 years in prison.”
• The stakes, in Sankar’s framing, are access. The pull quote says the EA crowd “is trying to restrict your access to the most important technology of the 21st century”. The editors summarize his argument as saying that a responsible-looking plea to slow progress “is actually about taking control out of the hands of the American people.”

Notable quotes

“Effective altruism is the unseen force driving AI safety discourse. And Americans deserve to know about it, because the EA crowd is trying to restrict your access to the most important technology of the 21st century.” — Sankar, quoted in the photo caption

“These vague and apocalyptic warnings caused a firestorm online, including calls for AI safety regulations from the leaders of almost every major AI company. But there is reason for skepticism.”

“The warnings from Coxon and others are infused with an ideology called effective altruism (EA).”

“SBF, you may remember, was supposed to be the good billionaire. He was to make a fortune with his company, FTX, and give it away to protect humanity’s future, especially from big, existential risks. Instead, he stole billions from his customers and was sentenced to 25 years in prison”

“But there’s another view of this issue—and especially the developments of the past week—that argues that the warnings from AI researchers and leaders should not be taken at face value.” — The Editors

“In today’s Big Read, he lays out what he sees as the destructive ideology that lies behind calls for safety regulation—and why he believes what looks like a responsible plea to slow progress is actually about taking control out of the hands of the American people.” — The Editors

How it connects

• Shyam Sankar: author. CTO and EVP at Palantir, writing for the tech right on AI policy.
• Effective Altruism: the ideology Sankar says lies behind AI safety discourse, with Sam Bankman-Fried and FTX as his opening exhibit.
• Artificial Intelligence and AI Safety: the subject. Sankar’s target is the safety movement and its push for regulation, not the technical question of whether AI is dangerous.
• Two Missing Pieces in the AI Safety Discussion: Noah Smith reads the same Coxon and Hubinger posts the other way, as sincere, long-standing and confirmed by surveys of thousands of researchers. He also argues that the lab heads’ calls to pace are costly signals, which is the opposite of Sankar’s suspicion.
• What Just Happened With the Pacing AI Debate (TBPN): Ben Thompson’s line there, about “a specific political movement in San Francisco” inserting itself into every AI company, is the same charge before Sankar names the movement as EA.
• Niall Ferguson and Tyler Cowen — AIpocalypse Now: the Ferguson and Cowen pieces the editors’ note lists as the views already aired. This essay is The Free Press’s third position in the same week.
• AI Is Already in Dangerous Hands: Ed Zitron also distrusts the safety narrative, but from the left: the danger is corporate concentration. Sankar fears the safety push will produce that concentration by restricting public access.
• Tech Regulation and Regulatory Capture: Sankar reads the regulation calls as a bid for control, not protection.
• Effective Accelerationism: the counter-movement that defines itself against EA-style safety arguments.
• Jacob Coxon and Evan Hubinger: the warnings Sankar opens with. The full online argument is mapped in Discourse: The Anthropic Resignation Thread.