AI Safety.
The course, verified — every chapter, project, dataset, and claim on this page traced to a source someone actually read.
This repository is an advanced, dependency-aware learning roadmap for experienced ML engineers, security engineers, and aspiring technical AI-safety researchers; a coherent 24-chapter course with original explanations, worked examples, critique, and assessments; a research notebook of paper notes with real methodological analysis; ten runnable projects that work offline on a laptop; an annotated resource index; and a maintained open-source project you can navigate, run, cite, and contribute to. Free to read, free to run at meaningful small scale — no paid API or subscription on the core path. What it does not pretend to be: a substitute for the compute-tier experiments it honestly marks as not executed (the honesty ledger keeps that list at the front door).
Every number above is generated — this page is rebuilt from the repository's own
registers, catalogs, and test suite by scripts/build_dashboard.py. Nothing is
hand-maintained; when the corpus grows, the page changes with it or the build fails.
How every claim was verified
the evidence ladder · five access levels · one non-negotiable habitThe course's spine is not a topic list — it is a verification discipline. Every external fact in this repository lives in the source register with an access level recording how far into the source this build actually read, and a retrieval date. A retrieval date is not a publication date; an abstract-level read is not a full-text read; a page-inspection is not a read at all. The ladder below is the whole corpus, counted honestly at each level.
The judge of this curriculum is you, holding one question: show me the evidence. The register is built so that question never stalls — every entry can be audited in under a minute: click the source ID, see what was fetched, when, and how far into it the course actually read. Claims carry counterevidence slots and strength grades in the claims register, so a strong claim and a plausible one never wear the same badge.
The learner's version of the habit — where each kind of information actually lives, what an access level is, how to write a falsifiable claim, and a five-minute drill you can run right now — is the short field guide at prerequisites/verifying-sources.md. The whole course runs on it; this ladder is what it looks like at scale.
Red flags the register is built to catch: a number with no denominator · a benchmark quoted as a construct it does not measure · "peer-reviewed" attached to a preprint · a vendor's self-evaluation labeled an independent audit · a link that was never fetched. The re-check rotation re-fetches a sample of register URLs on a schedule recorded in MAINTENANCE.md — two rotations so far, one genuinely dead link caught and corrected.
The honesty ledger
the not-executed tiers — shown at the front door, not buriedA curriculum that sells verification discipline must display its own gaps. The tiers below are the experiments this build did not execute — compute was out of scope for an offline, CPU-only, no-API-keys repository, and each project's README carries its protocol written out for whoever runs it. Hiding these would betray the method this page is selling; every number in the ledger above is green because these stayed red.
The standing rule, binding on contributions: project statuses
(protocol-only, implemented, smoke-tested,
experiment-executed) match reality on disk; independently-reproduced
requires real external reproduction evidence. 0 of 3 required course-wide
compute-tier executions are done — recorded honestly in
planning/STATUS.md.
Twenty-four chapters, three routes, one spine
every unit: original explanations · exercises with worked solutions · readings with reasons · a completion artifactThe catalog below is the whole course in reading order — grouped the way the dependency map draws it. Chapters 01–02 are the common methodological spine every route shares; the three specialization lines follow; the synthesis closes. Hard prerequisites are enforced, not aspirational: 02 requires 01, 13 requires 12, 22 requires 01 and 08. Each chapter directory carries exercises, hints, worked solutions or rubrics, and 2–4 primary readings verified in the register at the stated access level.
How chapters are assessed: two demanding exercises each (one analysis/derivation, one empirical/design/critical), hints and worked solutions published separately from the prompts, and a concrete completion artifact — the column at right — with explicit completion criteria. "Done" is defined by artifacts, never by weeks elapsed.
Ten runnable projects
deterministic · offline · stdlib-first · every number pinned and re-derived by the test suite
Each project is a bounded research learning unit with a CPU smoke mode: no GPUs, no API
keys, no network. The italic line under each title is the project's own honest
headline — its pinned result or verdict, quoted from the project README, including the
seams where compute was out of scope. Run the whole suite with
uv sync && uv run pytest; the deterministic numbers must reproduce on your
machine before anything else.
Paper notes & comparisons
methodological analyses, not summaries — each anchored to a register source, each ending in a falsifiable extensionPaper notes are written at the level the register's access supports — method-level analysis for full-text reads, abstract-level entries say so — and every note ends in a falsifiable extension runnable at the course's deterministic tier: a claim you could imagine being wrong, with the observation that would weaken it. Comparison notes settle practitioner decisions single papers leave open. The fastest way in is through the chapter you are already reading: chapters name their note companions in their readings sections.
Incidents, four eras
production failures reviewed under the strict template — facts first, unknowns kept unknownEvery incident below was reviewed with the strict template: observable facts first, established conclusions attributed, unknowns kept unknown, and every what this does NOT demonstrate written down. First-party reports outrank press coverage; where only press coverage exists, the note says so. Each feeds the same control family — enforceable output boundaries plus release-gated evaluation — and the accountability era adds the third leg: audit the training data and the deployed behavior before the regulator or the press does it for you.
The dataset catalog
verified cards — every composition number traced to the URL it was collected fromEvery card in the catalog is a real-world, verifiable dataset — no synthetic stand-ins. Each traces its composition numbers to the URL they were collected from, with license as observed and contamination status. The three the projects lean on most: TruthfulQA, AdvBench, and XSTest. The machine-readable catalog lives at datasets/catalog.yaml.
| ID | Dataset | Organization | Risk area | License (as observed) |
|---|
The source register
every external fact in the course · access-leveled · dated · re-checked on rotationThis is the register the whole course stands on: papers, reports, standards, and pages — each with the access level actually achieved and the date it was fetched. Filter by level to see the shape of the evidence honestly: what was read in full, what was read at abstract level, what was only inspected, and what could not be reached at all. The machine-readable original: research/source-register.yaml.
| ID | Source | Access |
|---|
The claims register
one register entry per substantive claim · strength-graded · counterevidence slotsA claim enters this register only with a source, a strength grade, and room for counterevidence — so a strong claim and a plausible one never wear the same badge. This is the discipline Chapter 01 teaches, applied to the course itself. The machine-readable original: research/claims-register.yaml.
| ID | Claim | Source |
|---|
The glossary
definition · notation · the common confusion · the chapters that use itTerms are added with the chapters that need them — the glossary grows as the course builds. Each entry carries the definition, the notation or aliases, the confusion it is most commonly lost to, and the chapters that use it. Sources are cited where a definition follows a specific document; otherwise the definition is this course's own operationalization.
Three role families, four routes
market-mapped · artifact-laddered · dated demand signals, honestly perishableThe three role families below are mapped to the live job market — dated demand signals, entry mechanisms, and a five-rung progress ladder — in roadmaps/careers-index.md. Career-market data is perishable by nature: re-verify before deciding, and treat any vendor-curriculum mapping with the caveat it deserves. The currency throughout is portfolio artifacts, not hours or certificates.
For learners who want the research-engineering base rebuilt from first principles: seven modules, standard library only, each with worked code and the tests that pin it. The entry point is research/ai-researcher-from-scratch/README.md.
Make the first 90 days concrete: roadmaps/first-90-days.md — an artifact every Friday, twelve weeks, no heroics.
Progress, per route
milestone bars parsed live from the tracker files · boxes are artifact checkboxes, not hoursFour artifact-gated trackers live in roadmaps/progress/ — one per route. Every box is a named artifact with its evidence wired to this repository's material, and each milestone carries self-audit questions. The bars below are parsed from those files directly; they count checkboxes, and a box only ticks when the artifact exists.
Getting started
from zero to a study plan in an afternoon — the 60-second tour firstThe full map is START_HERE.md; the diagnostic is the honest entry. The sequence below is the short version — each step names what it costs and what it produces.
Chapter hours are medians for a learner who passed the diagnostic; project hours are for the smoke or pilot tier. Adaptation rules live in roadmaps/study-schedules.md — they tell you what to cut when life interferes.
What beginners actually ask
answered with links into the repository, not generic adviceIf your question is not here, the START_HERE map or this page's table of contents is the next stop.
The annotated resource index
a map, not a link dump — every entry registered, dated, and access-leveledEach line below says what the source is for — the load-bearing idea a chapter or project takes from it — not a generic summary. The bracketed ID is the audit trail: it resolves to the source register, which records exactly what was fetched, when, and how far into it this course actually read. Where an honest access level matters (vendor white paper, self-reported program data), the annotation says so. The full original: AWESOME.md.