Fable
Vanke mini exam
The academy once used a single comprehensive exam to assess scholarship. As long as a student answered beautifully on the classics and history, they could get a high score. In the early years, when the county lacked clerks, this way of selecting people was sufficient: if you could write official documents and recite allusions, you could handle most tasks.
Later the academy wanted to select people who could assist all walks of life. Someone who only knew classics and history would misread medical records at a clinic, fail to distinguish clauses at a law firm, miscalculate interest at an accounting office, and only recite terms in a physics class. The head of the academy realized that one good grade could not hide shortcomings in the wider world.
The mountain chief first made the classics and history questions harder. Hard questions distinguished experts from novices within the same subject, but still could not show whether students understood medical theory, arithmetic, ethics, and common sense. Some wrote elegant essays but guessed wildly when they hit an interest-rate problem.
He also had the gentlemen rate "generalists" by impression. Impressions are easily fooled by eloquence; fluent answers do not necessarily mean understanding of professional boundaries; a silent student may be very steady in the arithmetic room. The academy argued for several sessions, and no one was convinced.
The new headmaster opened many small examination halls: law, medicine, arithmetic, history and geography, ethics, artifacts, and common knowledge. Each asked only for basic understanding, so students could not hide their weaknesses behind one strength. The questions were not deep enough to train specialists, but broad enough to reveal the terrain of knowledge.
After the results came out, every student had a horizontal map. Some were strong in humanities and weak in arithmetic; some were average with no standout strengths; some could only memorize common questions and were exposed as soon as the wording changed. The academy also quickly discovered that this map could not replace an on-the-job trial.
So the general exam was placed in early screening, and later it still had to be followed by industry test questions, on-site drills, and safety gates. The mountain chief said broad knowledge should be tested broadly, but a broad score cannot impersonate a real assignment; it only tells you which doors have already been opened and which rooms are still dark.
Later a student came to the headmaster with a horizontal map, saying he had passed every subject and asking whether he could go straight to the county office to take charge. The headmaster had him first handle a real dispute. The student quickly discovered that exams reflect breadth of knowledge, while the job also tests trade-offs, process, and responsibility. The map is useful, but it is not the journey itself.