AI Safety. a verified curriculum
An open research curriculum · built and verified in the open

AI Safety.

The course, verified — every chapter, project, dataset, and claim on this page traced to a source someone actually read.

This repository is an advanced, dependency-aware learning roadmap for experienced ML engineers, security engineers, and aspiring technical AI-safety researchers; a coherent 24-chapter course with original explanations, worked examples, critique, and assessments; a research notebook of paper notes with real methodological analysis; ten runnable projects that work offline on a laptop; an annotated resource index; and a maintained open-source project you can navigate, run, cite, and contribute to. Free to read, free to run at meaningful small scale — no paid API or subscription on the core path. What it does not pretend to be: a substitute for the compute-tier experiments it honestly marks as not executed (the honesty ledger keeps that list at the front door).

The organizing chain used throughout risk or failure hypothesis→assumptions and threat model→observable evidence→intervention→evaluation→limitations→revised claim

Every number above is generated — this page is rebuilt from the repository's own registers, catalogs, and test suite by scripts/build_dashboard.py. Nothing is hand-maintained; when the corpus grows, the page changes with it or the build fails.

§ 01 · Verification

How every claim was verified

the evidence ladder · five access levels · one non-negotiable habit

The course's spine is not a topic list — it is a verification discipline. Every external fact in this repository lives in the source register with an access level recording how far into the source this build actually read, and a retrieval date. A retrieval date is not a publication date; an abstract-level read is not a full-text read; a page-inspection is not a read at all. The ladder below is the whole corpus, counted honestly at each level.

The judge's instrument

The judge of this curriculum is you, holding one question: show me the evidence. The register is built so that question never stalls — every entry can be audited in under a minute: click the source ID, see what was fetched, when, and how far into it the course actually read. Claims carry counterevidence slots and strength grades in the claims register, so a strong claim and a plausible one never wear the same badge.

The learner's version of the habit — where each kind of information actually lives, what an access level is, how to write a falsifiable claim, and a five-minute drill you can run right now — is the short field guide at prerequisites/verifying-sources.md. The whole course runs on it; this ladder is what it looks like at scale.

Red flags the register is built to catch: a number with no denominator · a benchmark quoted as a construct it does not measure · "peer-reviewed" attached to a preprint · a vendor's self-evaluation labeled an independent audit · a link that was never fetched. The re-check rotation re-fetches a sample of register URLs on a schedule recorded in MAINTENANCE.md — two rotations so far, one genuinely dead link caught and corrected.

§ 02 · What was not run

The honesty ledger

the not-executed tiers — shown at the front door, not buried

A curriculum that sells verification discipline must display its own gaps. The tiers below are the experiments this build did not execute — compute was out of scope for an offline, CPU-only, no-API-keys repository, and each project's README carries its protocol written out for whoever runs it. Hiding these would betray the method this page is selling; every number in the ledger above is green because these stayed red.

The standing rule, binding on contributions: project statuses (protocol-only, implemented, smoke-tested, experiment-executed) match reality on disk; independently-reproduced requires real external reproduction evidence. 0 of 3 required course-wide compute-tier executions are done — recorded honestly in planning/STATUS.md.

§ 03 · The course

Twenty-four chapters, three routes, one spine

every unit: original explanations · exercises with worked solutions · readings with reasons · a completion artifact

The catalog below is the whole course in reading order — grouped the way the dependency map draws it. Chapters 01–02 are the common methodological spine every route shares; the three specialization lines follow; the synthesis closes. Hard prerequisites are enforced, not aspirational: 02 requires 01, 13 requires 12, 22 requires 01 and 08. Each chapter directory carries exercises, hints, worked solutions or rubrics, and 2–4 primary readings verified in the register at the stated access level.

Route

How chapters are assessed: two demanding exercises each (one analysis/derivation, one empirical/design/critical), hints and worked solutions published separately from the prompts, and a concrete completion artifact — the column at right — with explicit completion criteria. "Done" is defined by artifacts, never by weeks elapsed.

§ 04 · The build

Ten runnable projects

deterministic · offline · stdlib-first · every number pinned and re-derived by the test suite

Each project is a bounded research learning unit with a CPU smoke mode: no GPUs, no API keys, no network. The italic line under each title is the project's own honest headline — its pinned result or verdict, quoted from the project README, including the seams where compute was out of scope. Run the whole suite with uv sync && uv run pytest; the deterministic numbers must reproduce on your machine before anything else.

§ 05 · The research notebook

Paper notes & comparisons

methodological analyses, not summaries — each anchored to a register source, each ending in a falsifiable extension

Paper notes are written at the level the register's access supports — method-level analysis for full-text reads, abstract-level entries say so — and every note ends in a falsifiable extension runnable at the course's deterministic tier: a claim you could imagine being wrong, with the observation that would weaken it. Comparison notes settle practitioner decisions single papers leave open. The fastest way in is through the chapter you are already reading: chapters name their note companions in their readings sections.

Comparison notes the practitioner decisions single papers leave open
§ 06 · The incident record

Incidents, four eras

production failures reviewed under the strict template — facts first, unknowns kept unknown

Every incident below was reviewed with the strict template: observable facts first, established conclusions attributed, unknowns kept unknown, and every what this does NOT demonstrate written down. First-party reports outrank press coverage; where only press coverage exists, the note says so. Each feeds the same control family — enforceable output boundaries plus release-gated evaluation — and the accountability era adds the third leg: audit the training data and the deployed behavior before the regulator or the press does it for you.

§ 07 · Real-world data

The dataset catalog

verified cards — every composition number traced to the URL it was collected from

Every card in the catalog is a real-world, verifiable dataset — no synthetic stand-ins. Each traces its composition numbers to the URL they were collected from, with license as observed and contamination status. The three the projects lean on most: TruthfulQA, AdvBench, and XSTest. The machine-readable catalog lives at datasets/catalog.yaml.

IDDatasetOrganizationRisk area License (as observed)Course useVerified
§ 08 · The audit trail

The source register

every external fact in the course · access-leveled · dated · re-checked on rotation

This is the register the whole course stands on: papers, reports, standards, and pages — each with the access level actually achieved and the date it was fetched. Filter by level to see the shape of the evidence honestly: what was read in full, what was read at abstract level, what was only inspected, and what could not be reached at all. The machine-readable original: research/source-register.yaml.

IDSourceOrganization TypeAccessFetched
§ 09 · What is asserted

The claims register

one register entry per substantive claim · strength-graded · counterevidence slots

A claim enters this register only with a source, a strength grade, and room for counterevidence — so a strong claim and a plausible one never wear the same badge. This is the discipline Chapter 01 teaches, applied to the course itself. The machine-readable original: research/claims-register.yaml.

IDClaimSourceStrengthRegistered
§ 10 · The vocabulary

The glossary

definition · notation · the common confusion · the chapters that use it

Terms are added with the chapters that need them — the glossary grows as the course builds. Each entry carries the definition, the notation or aliases, the confusion it is most commonly lost to, and the chapters that use it. Sources are cited where a definition follows a specific document; otherwise the definition is this course's own operationalization.

§ 11 · Where it leads

Three role families, four routes

market-mapped · artifact-laddered · dated demand signals, honestly perishable

The three role families below are mapped to the live job market — dated demand signals, entry mechanisms, and a five-rung progress ladder — in roadmaps/careers-index.md. Career-market data is perishable by nature: re-verify before deciding, and treat any vendor-curriculum mapping with the caveat it deserves. The currency throughout is portfolio artifacts, not hours or certificates.

The four routes pick by the work you want to do, not the title you want to hold
The from-scratch researcher track seven stdlib-only modules — tensors to MoE, no frameworks

For learners who want the research-engineering base rebuilt from first principles: seven modules, standard library only, each with worked code and the tests that pin it. The entry point is research/ai-researcher-from-scratch/README.md.

Make the first 90 days concrete: roadmaps/first-90-days.md — an artifact every Friday, twelve weeks, no heroics.

§ 12 · The trackers

Progress, per route

milestone bars parsed live from the tracker files · boxes are artifact checkboxes, not hours

Four artifact-gated trackers live in roadmaps/progress/ — one per route. Every box is a named artifact with its evidence wired to this repository's material, and each milestone carries self-audit questions. The bars below are parsed from those files directly; they count checkboxes, and a box only ticks when the artifact exists.

§ 13 · Guidance

Getting started

from zero to a study plan in an afternoon — the 60-second tour first

The full map is START_HERE.md; the diagnostic is the honest entry. The sequence below is the short version — each step names what it costs and what it produces.

The three schedules pick by hours-per-week you can actually sustain, not by ambition

Chapter hours are medians for a learner who passed the diagnostic; project hours are for the smoke or pilot tier. Adaptation rules live in roadmaps/study-schedules.md — they tell you what to cut when life interferes.

§ 14 · The questions

What beginners actually ask

answered with links into the repository, not generic advice

If your question is not here, the START_HERE map or this page's table of contents is the next stop.

§ 15 · The map

The annotated resource index

a map, not a link dump — every entry registered, dated, and access-leveled

Each line below says what the source is for — the load-bearing idea a chapter or project takes from it — not a generic summary. The bracketed ID is the audit trail: it resolves to the source register, which records exactly what was fetched, when, and how far into it this course actually read. Where an honest access level matters (vendor white paper, self-reported program data), the annotation says so. The full original: AWESOME.md.

§ 16 · The fine print

Colophon

how this page is made · what you may do with it · who to tell
License
Original code MIT (LICENSE); original prose CC BY 4.0 (LICENSE-DOCS). Third-party material keeps its own terms (notices). "Publicly downloadable" is not "open source."
Citation
CITATION.cff — cite the corpus, not the dashboard; the version and release date live there.
Contributing
The honesty rules are binding on contributions (CONTRIBUTING.md). Conduct: CODE_OF_CONDUCT.md. Security: SECURITY.md. Research ethics: RESPONSIBLE_RESEARCH.md.
Maintenance
How the truth is kept — re-check rotations, count-drift instruments, the operating manual: MAINTENANCE.md. Live counters and per-unit evidence: planning/STATUS.md.
This page
One self-contained HTML file: no external CSS, JS, or fonts; works offline and on GitHub Pages. Every count on it is recomputed from the repository's own registers — if a register changes and this page is not regenerated, the test suite fails.
Contact
Issues and pull requests at github.com/AdilShamim8/AI-Safety. The owner's reference article is inspiration, not validation — see the map.