Fable
See every request for directions, audit, and revision
The caravan hired a clerk who could ask directions for the captain, look through contracts, write replies and call porters. At first the captain only looked at results: did the goods arrive, was the letter answered.
As business grew, failures became hard to trace. Sometimes the clerk took the wrong contract, sometimes they called a porter who had no key, sometimes a courier station delay made an urgent letter miss its time. Looking only at the final receipt, no one could say where it had broken. The captain first thought that simply replacing the clerk with a more diligent one would fix it. After replacing two in a row, the errors changed, but the chaos did not decrease. The problem was hidden in the stages every commission passed through.
The bookkeeper first hung up a success board, writing "how many deals closed today" every day. The numbers jumped up and down, but never told anyone why. The same failed deal could be because the passphrase version changed, because the signpost was outdated, or because the porter lacked warehouse access credentials.
The old accountant switched to a journey log. Each commission, from the moment it entered the door, recorded the original words, the token used, which contract volume was checked, which porter was called, how much lamp oil was spent, how long the wait was, which step was rejected, and how the reply was finally sent. At first the journey log was too coarse, only recording "contract checked, porter called." During review, it was still impossible to tell which volume, which porter, or which key had gone wrong, so the accountant made the recording granularity finer.
In the first review, they found that the clerk had not become stupid; rather, the new contract had been cut into two scrolls, and the key exception clause fell in the latter scroll, while the former scroll looked sufficient to answer.
Later, bells were attached to the itinerary book: if a certain route often timed out, a certain type of contract often missed pages, or a certain porter was frequently rejected, the accounting office could see it early. Sensitive merchants' names were recorded in code to prevent the ledger itself from leaking secrets.
The itinerary book was not left open for everyone to browse freely either. The captain only saw trends and anomalies, the accountant could see details, and outside merchants could only see receipts related to their own commissions. Visibility into the process and privacy protection had to be designed together.
The caravan finally understood that a capable clerk couldn't just be a black box. To improve it, you had to see what it used at each step, how long it waited, how much it spent, and where it went wrong. From then on, the captain looked at results and also at the process. Only steps that can be seen have a chance to be fixed; invisible errors will just come back another day.