Source
Every figure on this site is computed by one of these scripts rather than typed in by hand, and every interactive tool is checked against a second implementation before it ships. Here they all are.
Nothing here is compiled or obfuscated. If you want to know how a number on this site was produced, you can read the line that produced it. The JavaScript is served at its own paths — permalink.js, bpe.js, ngram.js, tokens/app.js.
| File | What it does | Lines |
|---|---|---|
build.sh | The whole build, every step | 76 |
chatcost.py | The chat billing rule, checked against the encoder | 116 |
mlp.py | The neural language model behind /learn/, by hand | 311 |
checkmlp.py | Gradient checks, and browser vs Python agreement | 141 |
attn.py | One attention head, and the induction-head result | 349 |
task.py | The copy task a fixed window cannot do | 50 |
checkattn.py | Gradient checks for the attention head | 123 |
checka11y.py | WCAG contrast ratios, computed from the stylesheet | 140 |
checkstructure.py | Headings, labels and landmarks | 101 |
checklive.py | Served bytes vs generated, and every link reachable | 139 |
checkassets.py | Every script and stylesheet, byte for byte | 115 |
checkcookies.py | What is actually in the browser's cookie store | 68 |
checkrequests.py | Every host a browser really contacted | 117 |
checkdelivery.py | What a reader downloads, and whether it caches | 117 |
checkfigures.py | No number in the prose that is not in the data | 110 |
bpe.py | Byte pair encoding — the reference for /vocabulary/ | 119 |
ngram.py | The n-gram model and sampling knobs behind /predict/ | 175 |
render.py | Generates every page on the site, including this one | 2720 |
precompute.py | Computes the figures on /tokens/ | 147 |
precompute_merges.py | Computes the figures on /vocabulary/ | 66 |
precompute_predict.py | Computes the figures on /predict/ | 80 |
corpora.py | The training texts used throughout | 61 |
verify.py | Checks both shipped tokenizer bundles against the reference | 103 |
makebundle.py | Builds the cl100k browser bundle upstream got wrong | 159 |
checkbpe.py | Browser BPE trainer vs the Python reference | 99 |
checkngram.py | Browser sampler vs the Python reference | 158 |
checkhtml.py | Strict HTML parse, dead links, feed and sitemap | 156 |
checkjs.py | Compiles the site's JavaScript with a real engine | 49 |
checkpermalink.py | Round-trips shareable links through a stubbed DOM | 272 |
checklive.py | Compares served bytes against what was generated | 139 |
cjsload.py | Loads the tokenizer's CommonJS build under QuickJS | 88 |
tokenlib.py | Loads the shipped browser bundle under QuickJS | 82 |