Photo by Sandip Kalal on Unsplash. Source: https://unsplash.com/photos/a-purple-and-blue-abstract-pattern-on-a-black-background-tcf9V6PDNoA (Unsplash License).

Inference got cheap and the bill still went up. Tokens keep falling in price while the workflows built on them consume far more of them. The gap between unit cost and total cost is now the whole story in AI economics.

  • Tokens are cheap. ~$60 to under $12 per million output tokens, median.
  • Workflows are expensive. Agents burn 15x-1,000x the tokens of a chat, and every step compounds.
  • The model is ~10% of the cost. Process, governance, and integration make up the rest.

Read the full analysis.

The AI Infrastructure report covers where the money actually sits, including the shift from token price to the cost of a whole workflow.

By Ivan Tarin

Ivan Tarin is a Principal Product Marketing Manager at SUSE, where he owns go-to-market strategy and positioning for a seven-product cloud-native portfolio spanning Kubernetes, virtualization, storage, security, and observability. A former full-stack developer who shipped production code for enterprise and public-sector clients including U.S. national laboratories, Ivan translates complex infrastructure and AI technology into messaging that lands with developers, platform teams, and enterprise buyers. He has presented at KubeCon, SUSECON, and AWS Developer Week, and is currently pursuing an MS in Artificial Intelligence at the University of Colorado Boulder.

Leave a Reply

Your email address will not be published. Required fields are marked *

Get the next one before it is old news

Independent analysis of cloud-native infrastructure, Kubernetes and data centre economics. No vendor spin.