Sizing and TCO

Appendix G · Glossary

This book rations its vocabulary. Every term below arrives in one chapter, because a model has just raised a question that needs it, and never as a definition at the front of a section. The list is short by design: a reader who finishes the book should have gained under twenty words, not a dialect.

Four of the terms name kinds of error. Read them as a group. Measurement uncertainty and parameter uncertainty are what an interval is made of. Scenario uncertainty is why this book runs a model more than once rather than widening its inputs. Structural error is none of those three. The model is wrong in shape rather than in its numbers, and it is ch20 · The missing node.

The last column is not a simplification. It is the sentence to use out loud. Where a term has a plain-English equivalent, this book says the plain one first and names the term second, including to a technical audience, where the effect is not condescension but agreement about what is being discussed.

TermIntroduced inWhat it means hereSaid plainly
distributionch13the bag of values an uncertain quantity could takea range of plausible values
samplech13one value drawn from that bagone guess
percentilech13the value a given fraction of the bag is belowthe value nine tenths are under
intervalch13the gap between two percentileshow wide the answer is
correlationch14the tendency of two inputs to move togetherthey move together
convergencech14the answer ceasing to move between runsit has settled
provenancech03how much somebody is claiming when they write a number downwhere it came from
measured constantch03an empirical number belonging to one implementation at one versiona number somebody measured
ceilingch08a limit past which a chain of multiplications stops describing anythingwhere it breaks
headroomch11the margin a design keeps below a ceiling, and the reason for itthe slack you keep
binding constraintch10the chain that decides the answer, out of several that couldwhichever runs out first
utilisationch06the fraction of a system that is busyhow busy it is
unit economicsch17a cost divided by a denominator you can defendcost per something
structural errorch20a model that is wrong in shape rather than in its numberssomething is missing
measurement uncertaintych03the standard error beside a number somebody measuredhow much the measuring wobbled
parameter uncertaintych13not knowing a value in a model whose shape is rightwe do not know the number
scenario uncertaintych12the world taking a path the model was not run for, which no interval coversit might go differently

Source — bench/outline.py and bench/tables.py

What the repository calls things

Four words appear on every stamped number in the book, and they are the ones a reader is most likely to meet without an introduction. They name what was asked a question:

TARGET_MEANING = {
    "corpus": "a deterministic measurement over a declared corpus with a named codec; "
    "reproducible anywhere, re-derived by CI, and never a rate or a duration",
    "rig": "a throughput or latency figure measured natively on the declared reference machine, "
    "and refused anywhere else",
    "estate": "an observation of a real deployment over a stated window; reproducible by nobody, "
    "checkable by nobody, and therefore held to the strictest disclosure rules in the book",
    "model": "computed from a model file in this repository. No machine and no body of data was "
    "involved, so it is evidence about what the book's own models say and about nothing else — "
    "and its fingerprint covers the whole DSL core, so the claim moves when the method does",
}

Three of those are measurements: something outside this repository was asked a question. A model result is not. It is evidence about what this book’s models say and about nothing else, so its fingerprint covers the whole sampler and every figure derived from it moves when the method does. Keeping it apart from the other three is what stops the distinction going soft.

The node kinds (input, derived, measured, ceiling) and the provenance kinds (fact, vendor_claim, assumption) are in Appendix A, where the fields they carry are quoted alongside them.

Terms this book does not use

None of these is an oversight. Each one has something the book says instead:

Confidence interval. The intervals in this book are percentile intervals of a sampled output: the gap between the fifth and ninety-fifth percentiles of the futures the model produced. The statistical term means something else, a statement about a procedure repeated over experiments, and borrowing it would import a guarantee this method does not offer.

Four things get called an interval in conversation and only one of them appears in these pages. A percentile interval is what this book reports: two percentiles of the values a model produced, and a statement about the model rather than about the world. A confidence interval is a statement about an estimation procedure. A prediction interval is a claim about where a future observation will fall, which would require this book’s models to have a track record they do not have. And the probability a ceiling is breached, the last column of every ceiling table, is none of those three. It is the share of the model’s futures that ended on the wrong side of a declared line, which is why it is reported as a share and never as a range.

Expected value. The mean. In a sizing model it is usually worse than the median: outputs that come from chains of multiplication are skewed, so the mean sits above most of the futures and describes none of them. This book reports the median and says so.

Best case and worst case. Percentiles, named. A “worst case” is whatever the person saying it last thought of; the ninety-fifth percentile is a specific claim about a specific model that somebody can disagree with.

Contingency. Headroom, with a stated reason and a ceiling it is measured against (ch11). A contingency is a number added at the end to feel safer; headroom is a margin below a limit that has a name and a consequence.

Risk, unqualified. Used here only where a ceiling gives it something to mean: how often, across the sampled futures, a design is asked to do something it cannot. That number has a row in a table and a sentence in plain English attached to it.

Overhead, unqualified. Every overhead in both reference models is a named node with a unit and a provenance, because “about twenty per cent overhead” is four different quantities depending on who is saying it.

Estimate. A point estimate wherever the book can say so, which names what it is: one number from one pass through the model with every input at its central value. Not confusing that with the answer is what the whole book is about.

Where each term is introduced

The middle column of the table above links to the chapter that introduces the term and defines it in context. Reading those sections in order is a shorter path through the book than reading the book, and a worse one: every term in that list arrives attached to a model that had just produced a number nobody could defend, and the term is much easier to remember with the number attached.