Skip to content

AI·News & analysis

A new book reveals the real reason Anthropic split from OpenAI

A new Atlantic excerpt from Kevin Roose's book says a 2017 plan to sell AGI access to governments, not just safety worries, drove Dario Amodei and his team out of OpenAI to found Anthropic.

By Dan Kost aka Poseidan7 min read
Dario Amodei smiling in a suit and tie at a formal meeting setting
Photo: UK Prime Minister / Wikimedia Commons, CC BY 2.0

Tide

Ripple

Sci-fi

5/10

Reality

Shipping

A pitch to auction off superintelligence to world governments.How we rate

The Squeeze

A new Atlantic excerpt from Kevin Roose's book 'The AGI Chronicles' reveals a 2017 OpenAI plan, proposed by Greg Brockman, to sell AGI access to governments worldwide.

Dario Amodei reportedly called selling AGI to hostile countries close to 'an act of treason' and considered resigning over it. By late 2020, Amodei and about 10 colleagues left to found Anthropic, after board-reporting demands and refusing to keep working with Brockman went unmet. The book draws on more than 150 interviews and previously unpublished internal documents.

What to know

  1. A new Atlantic excerpt from Kevin Roose's book 'The AGI Chronicles' details a 2017 OpenAI plan, proposed by Greg Brockman, to sell AGI access to governments worldwide.
  2. Dario Amodei reportedly called selling AGI to hostile countries close to 'an act of treason' and considered resigning over the idea.
  3. By late 2020, Amodei and about 10 colleagues left OpenAI to found Anthropic, after demanding board-level reporting and refusing to keep working with Brockman.
  4. Roose's book draws on more than 150 interviews with insiders at OpenAI, Anthropic, and Google DeepMind, plus unpublished internal documents.

Everyone assumed Anthropic split from OpenAI over abstract AI safety philosophy. A new book says the actual spark was a lot more specific: a plan to auction off AGI access to world governments.

A new Atlantic excerpt from journalist Kevin Roose's book, "The AGI Chronicles," details a 2017 OpenAI proposal to sell access to future artificial general intelligence systems to governments around the world.

What was actually being proposed?

Why it matters: the idea reportedly came from Greg Brockman, OpenAI's co-founder and president, as part of a broader vision in which OpenAI would essentially coordinate AI systems for governments worldwide, rather than simply operating as a research lab pursuing safety-focused science.

That's a genuinely different mission than the nonprofit safety-research image OpenAI publicly projected at the time. Selling access to the most powerful AI systems ever built, to any government willing to pay for it, raised the kind of question that doesn't have an easy or comfortable answer: which governments specifically, and under exactly what conditions.

How did Dario Amodei react?

By the numbers, or rather by the words used: Amodei reportedly said selling AGI to hostile countries was close to "an act of treason," and seriously considered resigning from OpenAI over the proposal alone.

That's an unusually strong, dramatic internal reaction for what started out as a fairly ordinary, run-of-the-mill corporate strategy planning disagreement. It signals this wasn't a minor philosophical difference of opinion, it was, in Amodei's apparent view, a fundamental question about who should control the most consequential technology his team was building.

In real life imagine finding out your company's leadership was seriously discussing selling a weapon-grade technology to the highest bidder among world governments. That's roughly the scale of disagreement being described here, even if AGI itself remains unbuilt.

So how did the actual split happen?

What's next, or rather what happened next: the disagreement didn't resolve quickly. Reporting indicates tensions escalated over the following years, through 2018 and into 2020, as Sam Altman became OpenAI's de facto leader and Brockman's role in the company's direction grew.

By the end of 2020, Amodei set conditions for staying: direct reporting to OpenAI's board, and no longer working alongside Brockman. When those terms went unmet, negotiations broke down entirely. Amodei, his sister Daniela Amodei, and roughly 10 other colleagues left to found Anthropic.

  • 2016: Amodei joins OpenAI, early friction with Brockman over transparency.
  • 2017: The AGI-to-governments proposal creates major internal conflict.
  • 2018-2020: Altman consolidates leadership; tensions continue building.
  • Late 2020: Amodei's departure conditions go unmet; Anthropic is founded.

How solid is this reporting?

Who's affected: this isn't a single anonymous tip. Roose's book draws on more than 150 interviews with people inside OpenAI, Anthropic, and Google DeepMind, along with unpublished internal documents and research memos. That's a substantial reporting base for a story this specific.

The book reportedly also covers new details on Sam Altman's 2023 firing and reinstatement as OpenAI's CEO, suggesting it offers a broader reexamination of the company's internal history, not just this one 2017 episode.

Why was OpenAI even in a position to consider this?

Background: OpenAI was founded in 2015 as a nonprofit, with a stated mission to ensure AGI "benefits all of humanity" rather than the private gain of any one person or company. That framing is exactly why a 2017 proposal to sell AGI access to governments would have struck insiders as such a sharp departure.

The organization's structure shifted dramatically not long after. In 2019, facing costs that donations alone couldn't cover, OpenAI created a "capped-profit" for-profit arm still controlled by the nonprofit, capping early investor returns at 100 times their investment while directing anything beyond that back to the nonprofit's mission. Microsoft invested $1 billion that same year, eventually taking a stake reported around 49% of the for-profit entity.

Why it matters: that same tension, mission-driven nonprofit ideals colliding with the practical need for massive capital, runs through both the 2017 government-sales proposal and OpenAI's broader restructuring. Amodei's objection wasn't an isolated personality clash.

It was one early flashpoint in a fight over what kind of company OpenAI was actually going to become, a fight still playing out publicly years later as OpenAI moved even further from its nonprofit roots toward a full Public Benefit Corporation structure.

Does this rivalry still show up publicly?

Yes, repeatedly, even years later. At a 2026 AI summit in India, Altman and Amodei were photographed visibly avoiding a handshake, a moment widely noticed given both men have appeared together at more formal events, including the UN Security Council, where they jointly called for global AI safety rules just this September.

The catch: that contrast, cooperating publicly on policy while privately maintaining a well-documented personal rivalry, is exactly the kind of complexity a corporate press release never captures. Public statements and actual working relationships between AI's most influential leaders don't always match.

What did Anthropic actually become instead?

What's next, in the sense of how the story ended: Anthropic launched in January 2021, founded as a public benefit corporation, a structure legally required to weigh positive social impact alongside profit rather than profit alone. That's a direct structural echo of the exact tension Amodei's team said drove them out of OpenAI in the first place.

The company's early research agenda crystallized around Constitutional AI, a training method that uses an explicit set of written principles to guide how models critique and refine their own behavior, rather than relying purely on human feedback after the fact. It became one of Anthropic's most distinctive technical contributions, and a direct product of the safety-first philosophy the founding team said OpenAI wasn't fully committed to.

Who's affected: that distinction matters for anyone choosing between the two companies' products today. Anthropic has built its entire public identity specifically around the idea that safety and capability shouldn't have to trade off against each other, a positioning that traces directly back to this exact 2017 disagreement rather than being an abstract marketing choice dreamed up separately, later, by a branding team.

What it means for you

  • This won't change any AI product you use today, but it explains real structural history behind why OpenAI and Anthropic exist as separate, competing companies.
  • The 2017 proposal underscores how early and how seriously "who controls AGI" was being debated, years before most of the public was paying attention to AI at all.
  • Company origin stories matter for understanding today's AI safety debates. Anthropic's stricter public safety stance traces back to this exact kind of internal disagreement.
  • Expect more detail as the book releases fully. This Atlantic excerpt is reportedly just the first piece of a larger, deeply sourced account.

The bottom line

The commonly told story of Anthropic's founding, a philosophical split over AI safety, turns out to have a much sharper, more specific origin: a real 2017 proposal to sell AGI access to governments, and Dario Amodei's apparent refusal to go along with it.

It's a reminder that the biggest disagreements shaping today's AI industry were happening years earlier than most outsiders realized, over exactly the kind of questions, who controls the most powerful AI systems, and who gets to decide, that the public is only now beginning to seriously grapple with.

Key facts

The proposal
Sell AGI access to governments worldwide
Proposed by
Greg Brockman, 2017
Amodei's departure
Late 2020, with about 10 colleagues
Book's sourcing
150+ interviews, unpublished documents

Got questions?

Quick answers, plain words

What new detail does this book reveal about the OpenAI-Anthropic split?

That a 2017 plan to sell AGI access to governments around the world, not just general AI safety disagreements, was a major, previously underreported trigger for the departure that led to Anthropic's founding.

Who proposed selling AGI to governments?

Greg Brockman, OpenAI's co-founder and president, reportedly proposed the plan as part of a broader idea for OpenAI to coordinate AI systems for governments globally.

What did Dario Amodei say about the plan?

He reportedly said selling AGI to hostile countries was close to 'an act of treason,' and considered resigning from OpenAI over the proposal.

When did Amodei actually leave OpenAI to start Anthropic?

By the end of 2020, Amodei led a departure of roughly 10 people, including his sister Daniela Amodei, to found Anthropic.

What conditions did Amodei set before leaving?

He reportedly demanded direct reporting to OpenAI's board and said he could no longer work with Greg Brockman. When those terms weren't met, negotiations broke down and he left.

What is 'The AGI Chronicles'?

A book by journalist Kevin Roose, drawing on more than 150 interviews with people at OpenAI, Anthropic, and Google DeepMind, along with unpublished internal documents and research memos.

Does the book explain Sam Altman's 2023 firing and rehiring too?

Yes, reporting indicates the book includes new details on OpenAI's board losing confidence in Altman and his brief removal and reinstatement as CEO, alongside the earlier Anthropic split.

Is the OpenAI-Anthropic rivalry still ongoing?

Yes. Despite occasionally appearing together at events like the UN Security Council, Altman and Amodei have a well-documented history of tension, including visibly avoiding a handshake at a 2026 AI summit in India.

SourcesThe Atlantic
Topics and tagsOpenAI, Anthropic, AI safety, openai

The daily newsletter

Tech news you'll actually get.

One short email a day. Five minutes. Plain words. The daily email is launching soon. Join the early list.

Free. Early list: we'll email you when the first issue goes out.

More in brief