Chapter 6. The Review Contract
In this section
- Chapter 6. The Review ContractHow to agree the checks before you delegate, tell a good output from a plausible one, find hallucination, inconsistency and bias, recompute the numbers a decision rests on, read citations and abstention, adapt one result for several readers, and review work you did not watch, on Claude or on ChatGPT.
- 6.1 Agree the checks before you delegateWhat to check, what evidence to ask for, what counts as success and when the worker must stop, written down before the work starts, and how deep a review should go.
- 6.2 A good output and a plausible oneWhy a result that reads well can still be wrong, and the two checks that tell the difference: is anything missing, and does each claim match its source.
- 6.3 Hallucination, inconsistency and biasThree different ways a result goes wrong, and the test that finds each one.
- 6.4 Validate the numbers a decision rests onHow to find the figures someone will act on, work them out again from the source files, and check that they agree everywhere they appear.
- 6.5 Citation and abstentionThree checks for every source a result points to, and why an honest answer that the source is silent is good work.
- 6.6 Adapt and compare outputs for the audienceHow one result can be shaped for several readers without changing its facts, and how to compare versions fact by fact.
- 6.7 Review work you did not watchHow to read the record of work done while you were away: what it used, what it did, and what it could not have done.
- 6.8 The same review on today's toolsWhat Anthropic's and OpenAI's own pages, and two open-source tools, offer for checking a worker's results, the gap that changes what you ask for, and what stays with you.
- Lab 6: the checks come firstChapter 6's lab: Brightline's October 30 payment-run package, reviewed for Dave with checks written before it is shown, run against the source files and decided item by item, then adapted for the owner and tested by a fresh second reviewer, each task checked against its own key.
- Check yourselfRecall and practice for the whole chapter: the flashcards, and a final quiz round from all eight concepts.