← Back to Concept Contrast

Concept Contrast Fable

How much is spent on models and how much remains after direct costs are deducted

Conclusion first:Token cost is a direct cost in AI products—the money burned on every model call. Gross margin is the profit space after subtracting all direct costs from revenue, and token cost is only one of them. Focusing on token unit price when discussing profit will ignore the share being eaten by other direct costs.

Token cost is a direct cost in AI products—the money burned on every model call. Gross margin is the profit space after subtracting all direct costs from revenue, and token cost is only one of them. Focusing on token unit price when discussing profit will ignore the share being eaten by other direct costs.

Fable

In the dye works, one watches the dye money, the other watches the profit and loss of the whole vat

At the dye works in the west of the city there were three people, each calculating differently. Old Jia managed dyes—how much indigo cost per catty, by what percentage cinnabar's purchase price had risen, how much material each bolt of cloth used on average. He was very frugal with materials: adding one extra ladle of water to the dye vat saved seven li per bolt. On the month-end report, dye cost dropped by two points, and Old Jia felt he had made a contribution.

Shopkeeper Old Jin looked at the whole vat—how much the white cloth cost to bring in, how much the dye cost, how much the water fee, charcoal money, and porter wages added up to, and how much the dyed cloth could sell for. He drew a line: revenue minus these direct expenses, to see what was left. When Old Jia lowered the dye by two points, Old Jin's line rose a little, but it was neither here nor there.

The key problem arose the year dye prices rose sharply. Old Jia was extremely anxious, calculating that each bolt of cloth would consume forty percent more in dye costs. Old Jin checked and found that dye prices had indeed risen sharply, but they accounted for only a little over ten percent of the total vat cost—the bulk was the purchase price of white cloth and the labor of porters, both of which had actually fallen this year. Old Jia stared at the unit price of dye every day, but what squeezed profits was what he did not look at.

There was another problem in the dye vat that was harder to spot. The seven li of dye Old Jia saved produced cloth with a lighter color, and the defect rate rose from five percent to nine percent. On Old Jia's dye cost report, two points had indeed come down, but when Old Jin calculated the whole vat's profit and loss, he found the discount loss from defects was more than three times the dye savings. Cutting one cost brought a rise in another, invisible on the report.

Old Jin later switched to a different bookkeeping method. Each dye vat had its own cost sheet listing all direct expenses. Dye appeared as just one line on the sheet. Old Jia still managed the dye, but he was also required to watch the line next to it—the defect discount rate. If saving two li on dye raised the defect rate by two li, that vat was not making money.

When young apprentices entered the dye workshop, the first thing Old Jin taught them was not color formulas, but to look through the entire cost table before starting. He said whether your effort to save dye is worthwhile does not depend on how much you cut, but on whether other trades are rising at the same time. Looking at only one line is called managing materials; looking at all lines is called doing the accounts.

At year-end closing, Old Jin plotted each vat's gross margin together with the trend of dye cost in the vat, and pointed it out to the owner: a five-li fluctuation in dye cost affected overall gross margin by less than one point. What really made the gross margin curve jump was the purchase price of white cloth, the porter's route and the defect rate—none of these three things appeared on Old Jia's report.

Token cost

In AI products, the token cost consumed by each model call is one of the direct, usage-priced cost items. It can be optimized, but it usually accounts for a limited share of the overall cost structure.

Gross profit

The profit margin after subtracting all direct costs from revenue, where direct costs include inference costs, infrastructure, basic labor, and so on. It reflects the business's true profitability and pricing effectiveness.

Story Mapping

  • Old Jia manages dyes: a token cost perspective, focused on optimizing the direct cost of a single line
  • Old Jin looks at the profit and loss of the whole vat: a gross margin perspective, the profit margin after combining all direct costs
  • Dye price increases account for just over ten percent: Token cost as a share of overall direct cost may be far lower than expected
  • Saving seven li brings nine li in defective goods discounts: over-optimizing one cost item triggers rebounds in other cost items
  • One full table per vat: Token cost and adjacent cost items must be viewed together
  • The purchase price of white cloth and the porter's route truly move gross margin: the main fluctuations in gross margin often come from non-Token cost items

Translating into cost optimization priorities for AI products

Before optimizing Token costs, first see clearly their true weight in your gross margin structure. Draw a table listing all direct cost items and their share of revenue: model calls, vector storage, infrastructure, manual operations, customer support. Many AI products in their early stage spend 80% of optimization effort on Token costs, but it often accounts for only 15% to 20% of total direct costs. Optimize the item with the highest share first—often manual operations or basic support costs—then come back to Tokens. Also check whether optimizing a single item creates secondary costs: using a cheaper model may raise the error rate, thereby increasing manual review and customer complaint costs. Cost optimization is about the direction all rows move together, not about which row has the smallest number.

京ICP备2026014272号