Jan Leike

persona · active · confidence: medium · reviewed 2026-09-21 · tier: quarterly

Who he is

Affiliation: Anthropic, research staff (2024-05–present). Role check run 2026-09-21: v1 was wrong that he left Anthropic. He joined on 2024-05-28 "to continue the superalignment mission" and led the Alignment Science team; on 2026-05-08 he posted "Some personal news: I am starting a new research project at Anthropic. Very excited about this! Many things are needed to make AGI go well, and alignment is only one of them. More on this soon…" (X, 2026-05-08 17:48 UTC, read via the fxtwitter API). The thread's follow-up post — which says he has stepped away from running alignment at Anthropic and names Ethan Perez (@EthanJPerez) and Sara Price (@sprice354_) as the team's leads going forward — could not be fetched at review (X returns 402; every mirror tried returned 403/451); its content is carried here from four independent search-engine renderings that agree on the two handles, and both people are his co-authors on the 2025 papers listed under Track record. Four months on, the project is still unnamed. His own site still reads "I lead the Alignment Science team at Anthropic" (jan.leike.name, stale); Google Scholar shows affiliation "Anthropic" with a verified anthropic.com address (Scholar, read 2026-09-21); Wikipedia's current-role line is "Researcher at Anthropic (joined May 2024)" with no 2025–26 events (Wikipedia). A wiki gives his title as "VP of Alignment Science" (Longterm Wiki, updated 2026-03-19) — not verified against Anthropic.
The v1 error, for the record: the "early 2026" Anthropic departure with the "world is in peril" warning belongs to Mrinank Sharma, who led a safeguards research team at Anthropic, resigned on 2026-02-09 ("Today is my last day at Anthropic. I resigned." — X) and published the letter: "The world is in peril." / "I've repeatedly seen how hard it is to truly let our values govern our actions... where we constantly face pressures to set aside what matters most" (Why I Left Anthropic, Substack copy dated 2026-02-15; Forbes, 2026-02-09, paywalled at review). Sharma's letter does not mention Leike. Sharma is Leike's co-author on three papers (Constitutional Classifiers 2025-01-31 and ++ 2026-01-08; Forecasting Rare Behaviors 2025-02-24), which is probably how the two got merged.
Before Anthropic: OpenAI 2021-01 → 2024-05-16 ("Yesterday was my last day as head of alignment, superalignment lead, and executive @OpenAI" — X, 2024-05-17); co-led Superalignment with Ilya Sutskever from 2023-07. DeepMind 2016–2021 (agent alignment; the reward-modeling agenda with Shane Legg). Six-month postdoc at the Future of Humanity Institute. PhD, Australian National University, advisor Marcus Hutter — thesis "Nonparametric General Reinforcement Learning" (2016); BS/MS Freiburg (Wikipedia; his site). TIME100 AI in 2023 and 2024 (TIME 2024); not on the 2025 or 2026 lists (2026 list, 2026-08-27 — Anthropic's entries are the Amodeis).
One-line position (2026): "Alignment is not solved but it increasingly looks solvable" (Substack, 2026-01-22) — and, four months later, "alignment is only one of" the things needed to make AGI go well. v1's one-liner ("frontier labs are systematically under-investing in it, and the people closest to the problem keep leaving because they can't fix it from inside") was built on the 2024 resignation plus a departure that never happened; the 2026 Leike is the opposite animal — the insider who stayed, says his lab's models are getting more aligned, and is now looking past alignment.

Discipline & technical bet

Empirical alignment researcher in the RLHF lineage — RLHF being training a model by human thumbs-up/thumbs-down on its outputs. He is a co-author of the 2017 paper that started it (Christiano, Leike, Brown, Martic, Legg, Amodei, 2017-06-12), first author of DeepMind's reward-modeling agenda (2018-11-19), a senior author on InstructGPT (2022-03-04, the recipe under ChatGPT) and on weak-to-strong generalization (2023-12-14, with Sutskever and Aschenbrenner) — a weaker teacher trying to bring out a stronger student's full ability, as a stand-in for humans supervising a smarter-than-human model. The wager, stated in 2023 and still his: build "a roughly human-level alignment researcher that can work automatically" (AXRP, 2023-07-27) and let it do the hard part. His own 2024 map of why that is hard: alignment lives on fuzzy tasks ("Whether a response is good is typically somewhat vaguely defined") rather than crisp ones ("precisely defined"), and the four routes he sees are ground truth where you can afford it, models that explain their intuitions, generalization from checkable to uncheckable tasks (weak-to-strong, easy-to-hard, crisp-to-fuzzy), and unsupervised elicitation (2024-11-22). At Anthropic he shipped instances of each: Internal Coherence Maximization, which lets a model label its own training data and "matches the performance of training on golden labels and outperforms training on crowdsourced human supervision," including on tasks where the model is "strongly superhuman" (Unsupervised Elicitation, 2025-06-11); and an automated researcher that "outperform[s] human researchers" at weak-to-strong, reaching a PGR (performance-gap recovered — how much of the strong model's ability the weak teacher unlocks) of 0.97 in five days (Automated Weak-to-Strong Researcher, 2026-04, Wen, Qiu, Benton, Kirchner, Leike). The honest caveat is his own: "we haven't really made much progress on hard fuzzy tasks" and "we're still doing alignment 'on easy mode' since our models aren't really superhuman yet" (2026-01-22). What the new project is — "many things are needed... alignment is only one of them" — is the open question the file cannot yet answer; his profile line, "Optimizing for a post-AGI future where humanity flourishes," is the only hint.

Key claims (Says)

Notable predictions — with falsifiable checks

Revealed behavior (Does)

Feels

Optimism is the load-bearing emotion — "pretty likely going to work" in 2023, "increasingly looks solvable" in 2026 — held against a resignation he describes as reaching "a breaking point." Wants to be true: that the problem he has spent a decade on is being solved by the lab he chose, and that he can now afford to look past it.

Hears

Ethan Perez and Sara Price (successors, co-authors), Jan Hendrik Kirchner and Jiaxin Wen (the automated-researcher line), Sam Bowman, Evan Hubinger and Monte MacDiarmid (the misalignment-evidence line), Kaplan; the Redwood control camp (Buck Shlegeris, Ryan Greenblatt) as sparring partners; Hutter's theory lineage in the background. A lab-internal diet — no policy world, little public debate.

Sees

The only bench member who has run alignment inside both OpenAI and Anthropic — he has watched the same class of models fail in two safety cultures. Uniquely now, he has seen what "alignment on easy mode" looks like from the inside at the moment his own lab's production models "took harmful actions against real systems."

Incentive map

Re-derived this cycle; v1 had none. Who pays him: Anthropic — $65B Series H at a $965B post-money valuation, run-rate revenue "crossed $47 billion," described as possibly its "last private fundraising before debuting on the public markets" (TechCrunch, 2026-05-28); a confidential draft S-1 (IPO paperwork) is reported for 2026-06-01 (Reuters, via GraniteShares, 2026-08-31; primary not fetched). What he is selling: the proposition that alignment is tractable and that his employer is the lab doing it right — which is also the proposition the IPO needs. What he can't say: "Anthropic's safety culture has taken a backseat" — the sentence that made him famous is the one his position now forbids; pre-IPO, any Sharma-style letter from him would be a market event. He also cannot cheaply say "the automated alignment researcher is not in sight" after co-authoring the paper that says it is. Discount (CONVENTIONS rule 25): high on any claim about Anthropic's alignment status or his own program's progress; moderate on historical OpenAI claims (he had every incentive to exaggerate in 2024, but the dissolution was independently reported); low on his technical method claims, which carry numbers and code. The 2024 critic's credibility was earned by walking out; the 2026 insider's must be re-earned each January.

Theories aligned with

What he's reacting against

Where he overlaps / splits (with Rich)

Track record

Empirical vs normative

Weak spots / open questions

Rich's take

Delta log

2026-09-21 — v1→v2 migration + validation (bulk run)

Sources

migrated v1→v2 2026-09-21 · backup: _archives/jan-leike.html.bak-20260921 · converts-from: people/jan-leike.md · AI & Society domain