gaige
v0.0.4 · released

the reference receipt, read line by line

the receipt is the product: everything gaige knows about a measurement, committed in one record a stranger can check. this page reads the committed reference receipt whole, field by field, assuming no vocabulary.

what this record is

the record below was generated 2026-07-22 by gaige 0.0.1, measuring fast-detect-gpt on a pinned 200-text corpus. it has been committed, byte-stable, ever since: the receipts page renders it, this site’s front page quotes it, and the raw JSON is one click away. nothing on this page paraphrases; every quoted line is the record’s own.

the corpus block: what was measured on

corpus hc3-mini(n=100,seed=17) · sha256 7d2819d3…
counts human 100 · ai 100
source HC3 via the hf hub · raw sha256 ee231f82…
filters 50-300 words · seed 17
note known-AI side is chatgpt-era text; detectors may score newer model families differently

five lines, and each one is a commitment. the name states the pile and the draw. the hash makes “same corpus” checkable forever. the counts state what each class contributed. the source and raw hash pin even the upstream bytes before filtering. and the note is the pile’s honest edge, recorded where nobody can miss it. the corpus page teaches this block from zero.

the instrument block: what did the measuring

detector fast-detect-gpt (bao et al., ICLR 2024, analytic variant)
model tiiuae/falcon-7b · 4-bit requested
verified linear4bit_modules 128 · resident 4.04 GB
limits max_tokens 1024 · device cuda · no fallback
versions torch 2.13.0 · transformers 4.49.0 · cuda 13.0 · python 3.12.3

the load is verified, not assumed: the receipt records that 128 modules actually loaded in 4-bit and how much memory the model held resident, because a silent full-precision fallback would be a different instrument wearing the same name. the versions matter for the same reason. change any of these and the numbers can move; the fingerprint is how you know they have not.

the result line: the number and its honesty bars

result AUROC 0.9720 95% CI [0.9458, 0.9938] · bootstrap n=1000

AUROC summarizes how well the scorer separates the two classes across all possible thresholds: 1.0 is perfect separation, 0.5 is coin-flipping. the interval beside it is not decoration. it says that with 200 samples, the measurement itself is only known to within about five points, and the receipt prints that width instead of rounding it away.

the threshold lines: two different promises

empirical thr@1%FPR 2.1229 → TPR 86% [79, 92] · thr@5% 1.8319 → TPR 91% [85, 96]
conformal α=.05 → thr 1.8468 · TPR 90% · α=.01 → thr 2.4446 · TPR 76%

the empirical lines say what happened on this pile, in-sample. the conformal lines carry a finite-sample guarantee on the false-positive rate (arXiv 2505.05084 is the method), bought at the price of sensitivity: compare the 1% empirical line’s 86% with the α=.01 conformal line’s 76%. neither family is “the” threshold. thresholds works the whole trade, including the base-rate arithmetic that decides how many flags are wrong.

the refusal line: the honest no

refusal α=.005: needs ≥199 human calibration samples, got 100

one line of the record is a guarantee that does not exist, stated as such. the sentence it carries in full, quoted on the corpus page and collected with every other refusal on refusals, ends: a tighter guarantee than your data supports is not a guarantee. a receipt that only ever said yes would be an advertisement.

the fingerprint and the reproduce line: checkable by a stranger

fingerprint model · quant verified · device · library versions · corpus hash
reproduce gaige run --corpus hc3-mini --n 100 --seed 17 --detector fast-detect-gpt …
replay bit-identical analyze replay against the pinned receipt

these lines are why the record outranks a screenshot. anyone with the command, the pinned corpus, and the fingerprinted environment can regenerate the analysis and compare byte-for-byte; the replay check does exactly that. trust here is not a request. it is a procedure.

the same anatomy, twice the instrument

the committed binoculars receipt has identical anatomy with one difference worth seeing: its instrument block records two models (an observer and a performer), each with its own verified quantization and residency, because a two-model score with a one-model fingerprint would be lying by omission. every receipt gaige emits, whatever the detector, carries this same skeleton: corpus, instrument, result, thresholds, refusals where honesty requires them, and the command that lets you check it all yourself.

where this goes next

this is step 5 of the ground-up track. the receipts page renders the committed records live; false positives takes the threshold lines into the arithmetic of who gets flagged; and the raw JSON behind this page is at data/receipts/20260722-163959-fast-detect-gpt.json, unchanged since the day it was generated.

adjacent: receipts · corpus · thresholds, worked · false positives · binoculars guide