On Monday, Decagon CEO Jesse Zhang revealed a provocative new principle, posted beneath the title “Everyone seems to be flawed about open supply AI within the enterprise.” The submit grapples with probably the most fascinating contradictions of right now’s AI economic system: Extra mature AI deployments are switching to lighter fashions, he says, even at his personal firm. However the general spend on costly state-of-the-art fashions has barely budged.
It’s a brand new means to consider the connection between frontier and open supply fashions. In Zhang’s telling, they aren’t opponents, and open supply fashions’ success isn’t coming on the expense of frontier labs. As an alternative, they’re two phases of the identical life cycle, with costly frontier fashions getting used to show out use instances that may be handed alongside to cheaper open supply alternate options as they mature.
As extra mature use instances swap to lighter fashions, new use instances maintain arising — and the general spend on frontier fashions barely goes down.
Zhang doesn’t give a lot knowledge to help the purpose, however the knowledge isn’t onerous to search out. Vercel’s AI gateway dashboard exhibits that, in simply the previous week, DeepSeek has surged into the lead for token volumes, now processing simply over a 3rd of the tokens passing by means of the corporate’s infrastructure. Z.ai — the lab behind the favored GLM-5.2 mannequin — jumped into a good fourth place over the identical interval.
However for those who scroll right down to general token spend, you’ll see Anthropic nonetheless accounts for greater than half of the general AI spend on the platform. On condition that a lot of the current change comes from Anthropic’s personal rising costs, the share has dropped barely over the previous month, however not considerably.
OpenRouter tells an identical story, capturing a a lot bigger (however barely much less enterprise-y) section of the market. DeepSeek V4 Flash is the principle winner on general utilization, processing 5.3 trillion tokens weekly. The preferred frontier mannequin, Opus 4.8, handles simply over 2 trillion. OpenRouter doesn’t rank fashions by whole spend, but it surely registers the common token price for Opus 4.8 as roughly 23x larger than V4 Flash ($1.37 per million tokens, in comparison with simply 6 cents), which might imply Opus was nonetheless most likely capturing the lion’s share of spending.
These figures don’t even seize the most recent arrival, Nvidia’s Nemotron, which is poised to leap to the entrance of the pack by advantage of Nvidia’s robust connections and the mannequin’s personal excessive adaptability.
These figures don’t absolutely show Zhang’s level in regards to the AI life cycles, however they do present frontier labs like Anthropic aren’t struggling an excessive amount of from the rise of open supply — no less than not but. One rationalization is that the market of AI-addressable duties is rising so quick that the highest fashions are in a position to preserve their place simply by dominating early-stage deployments. As Zhang places it, “The frontier labs will maintain proudly owning discovery. Open supply will more and more personal manufacturing.” One other rationalization is likely to be that, whilst purchasers transfer to open supply, many use instances are so troublesome that they’ll’t be solely changed with cheaper alternate options.
Both means, this two-tiered economic system of fashions might develop into a comparatively steady function of the AI economic system.
As lately as final September, I used to be writing in regards to the chance that basis labs would find yourself promoting espresso beans to Starbucks — that’s, serving as commodity inputs whereas the appliance layer reaped the advantages. Some components of that prediction got here true: Vertical AI performs switched to lighter fashions, for one, and the economics of “GPT wrapper” startups have remained principally steady.
However we’re additionally seeing that, token for token, frontier suppliers have been in a position to maintain on to essentially the most fascinating a part of {the marketplace} — the premium token worth. And that doesn’t appear more likely to change any time quickly.
Whenever you buy by means of hyperlinks in our articles, we might earn a small fee. This doesn’t have an effect on our editorial independence.
