Fable
The cargo tag in an estuary caravan that was always moved to the wrong place
The river-mouth caravan had a method it had used for many years. Every morning the accountant handed out cargo tags to carters and buyers; whoever got what went to do that. The small town was not big, and things were not urgent, so this method rarely went wrong.
Later the caravan bought a cargo-sorting copper cabinet that could automatically dispatch carts, assign storage slots, and remind about payments by cargo tag. The manager did not have the accountant approve each order; he just had him sit on a high platform watching the overall board and call a stop when something abnormal appeared.
The first incident was when a batch of fragile porcelain was assigned to a bumpy mountain road. The bronze cabinet dispatched vehicles by shortest distance, and the accountant that day saw only that the total looked good, not noticing the risk on individual cargo tags. By the time the vehicle returned to the city, three boxes of porcelain were already broken.
The shopkeeper first asked the accountant to look more carefully. But with hundreds of goods lists a day, people staring at the overall ledger quickly grow tired, and the truly dangerous anomalies hide among ordinary numbers. Merely placing a person beside the process does not mean the person can intervene in time.
Later the caravan reset the rules: ordinary cloth moved automatically, while fragile goods, valuables, route changes, overtime, and customer complaints lit red lights; the accounting office no longer reviewed every step, but had to handle red lights, spot-check samples, and adjust dispatch boundaries.
Under the new system, the copper cabinet still handles most routine arrangements, while people are responsible for oversight and correction. The shopkeeper understood that a person standing outside the loop is not completely absent, nor is it a gradual move toward hand-signing everything; the key is that the system knows when to call the person back, and whether the person can truly change the outcome.
The accountant later also gained real control levers. He could not only watch the red lights, but also pause a certain type of dispatch, raise the fragile-goods threshold, and require manual confirmation for a given route. If he could only observe, oversight would be mere decoration.
During the caravan retrospective, they distinguished three approaches: a person approving every order, a person not involved at all, and a person standing nearby watching for anomalies and able to intervene. The third is the least labor-intensive and the most easily misunderstood. It requires the system to raise alerts, the person to have authority, and records to explain why intervention occurred. Later, the accountant no longer watched every ordinary cloth bundle but carefully handled every red light. Keeping people out of the loop is meant to free them from trivial approvals, not to leave key risks unowned. The accountant's position rose, but responsibility did not disappear—it shifted from stamping every order to guarding the boundaries. If there are too many red lights, the boundaries are poorly set; if too few, real dangers may be missed.