Google's Quiet AI Win: The Hidden 70x Subsidy in Your $200 Plan

Transcript

Sam: Okay, here's the thing everyone gets backwards. You've heard that AI is sold below cost — that the meter, the thing that charges you per word, is the giveaway designed to hook you.

Alex: It's the opposite. The meter is one of the better-margin products in software. The thing that's bleeding money — forty to seventy times its price — is the flat two-hundred-dollar plan you thought was the safe choice.

Sam: And which company survives the price war that's coming isn't decided by who has the smartest model. It's decided one layer down, in the silicon — and almost nobody's looking there.

Alex: Welcome back to Dan's AI Intel — the show where we try to make sense of the fastest, most consequential shift any of us is likely to live through. I'm Alex, here with Sam.

Sam: And today we are following the money. Specifically: the price of artificial intelligence, and the fact that it lies to you — in the exact opposite direction from what almost everyone believes.

Alex: This show exists because the AI revolution is moving faster than any one person can track. The idea is to take the questions you can't stop thinking about and actually chase them down — turn the noise into something you understand and can carry around. And this one is a perfect example, because the conventional wisdom here isn't just incomplete. It's inverted.

Sam: So let me set up where we're going, because I genuinely did not see the ending coming. We start with a real number that broke my brain — a two-hundred-dollar subscription that can burn through fourteen thousand dollars of compute. The trigger is simple: everyone says AI is subsidized. And it is. But the moment you ask where the subsidy actually lives, the whole story flips.

Alex: And the question that opens up underneath it is the one that really matters: when the cheap money runs out — and it will — who's left standing? Because two companies can sell you the same thing at the same price and be opposite businesses. One's making money and circling for the kill. The other is praying the music doesn't stop.

Sam: We're going to travel across all of them — OpenAI, Anthropic, Google, DeepSeek, the whole board — and we're going to find that the thing that decides the winner isn't the model at all. It's a tax most people have never heard of, and exactly one company figured out how to dodge it. There's a move almost every other player is making right now that looks smart and is, I think, exactly backwards.

Alex: If you've been enjoying the show, do follow us on Spotify or Apple Podcasts, so the next one finds you. Okay. Let's start with the lie itself.

Sam: Right — so the headline claim. When people say "AI is subsidized," what's the picture in their head? Mine was: every time I type a question, the company is quietly eating part of the cost to keep me hooked. The meter is the loss leader.

Alex: That's the folk belief, and it's wrong. Here's what the people who actually set the prices say. The CEO of OpenAI, Sam Altman — at a press dinner in San Francisco — said, and I'm close to quoting, "We're profitable on inference. If we didn't pay for training, we'd be a very profitable company."

Sam: Inference being… the actual answering of my question. The running of the model.

Alex: Right. Training is building the model once, which costs a fortune. Inference is the part that happens every time you hit enter. And he's saying that part — the meter — makes money. Anthropic's CEO, Dario Amodei, put a number on it. He said the inference has a gross margin "more than fifty percent."

Sam: So the per-question business is more profitable than half. That's… not a loss leader. That's a good business.

Alex: It's a genuinely good business. And now you can feel the puzzle. If the meter makes money, where on earth is all the subsidy everyone keeps talking about? Because the subsidy is real. The companies are losing staggering amounts of money. So if it's not the meter…

Sam: …it's hiding somewhere else. Okay, I want to know where. But hold on — why does this even matter? Like, beyond me feeling smart at a dinner party. Why does the price of a token decide anything big?

Alex: Because the price of a token is the metabolism of this entire race. Think about the scale for a second. One research firm, IDC, pegged AI infrastructure spending at three hundred and eighteen billion dollars in a single year — more than double the year before. They forecast four hundred and eighty-seven billion the next year, on a path past a trillion dollars a year by the end of the decade.

Sam: A trillion. With a T. And — let me make sure I've got the gap right. If they're spending three hundred billion building this out, and the revenue is, what, a fraction of that…

Alex: A fraction. The money going in dwarfs the money coming back, for now.

Sam: Then this is a race against the bank balance, not against each other. Whoever's burning fastest hits zero first, no matter how good their model is.

Alex: That's exactly it, and it's why the price of a token matters so much. The price sets how fast each company burns the money it raised — which sets who runs out first. The smartest model on a given Tuesday doesn't matter if you can't pay the power bill on Wednesday.

Sam: Okay, that reframes it completely. So the sticker price isn't really about what I pay. It's about who's quietly dying.

Alex: That's the whole show, honestly. The sticker price hides the two things that decide the outcome — how much each company bleeds to put that model in front of you, and what it actually costs them to make. Everything from here is us pulling those two numbers out from behind the price tag.

Sam: So you said the subsidy is real but it's in the wrong place. Where is it, actually?

Alex: It's in the flat subscription. The all-you-can-eat monthly plan. And there's this beautiful, brute-force experiment that proves it. A research firm called SemiAnalysis went and bought every consumer tier from OpenAI and Anthropic — the twenty-dollar plans, the two-hundred-dollar plans — and then they just… hammered them.

Sam: Hammered them how?

Alex: They ran real work. Long coding sessions, agent workflows, the heavy stuff — and they kept going until they hit the weekly usage limits. They wanted to find the ceiling. The most a flat plan would ever have to survive. And then they took all the tokens they'd burned and priced them at the company's own published meter rates.

Sam: So they're asking: if you actually used this thing as hard as it lets you, what would it have cost on the meter?

Alex: Exactly. And here's the answer. A two-hundred-dollar ChatGPT Pro plan, run to the max, consumed about seventy times its price in compute. Roughly fourteen thousand dollars.

Sam: Seventy times. So I pay two hundred, and at full tilt I'm using fourteen grand of their compute.

Alex: At full tilt, yes. The Claude Max plan, same price, came out around forty times — about eight thousand dollars. And the break-even is brutal. ChatGPT Pro hits zero margin — the point where they start losing money on you — at about five-point-seven percent of the weekly cap.

Sam: Wait. Five percent? So if I use even a twentieth of what they let me use, I've already tipped them into a loss?

Alex: A developer doing real agent work even a few hours a week is already unprofitable to them. Claude Max gives you a bit more runway — around ten percent of the cap — but it's the same shape. The flat plan is the loss leader. And Altman, again, just said it out loud. Back in January twenty-twenty-five he posted — and this one I do want to quote, because it's so human — "insane thing: we are currently losing money on openai pro subscriptions! people use it much more than we expected." He set the price himself. He said he thought they'd make some money.

Sam: [laughs] I love that. The most powerful man in AI, surprised by his own pricing page. But — okay, why did it get this bad? Like, these are not stupid people. How do you misprice something by seventy times?

Alex: This is the part that actually clicks it into place. They priced the subscription for a 2023 chatbot. Picture what that was: a person types a question, reads a paragraph back, types another. That's a human-paced amount of work. Cheap to serve.

Sam: Right, I'm a slow, squishy human. I can only type so fast.

Alex: And then the product mutated underneath the price. The chatbot became an agent. Instead of you asking one question, the model now goes off and does a whole task — it reads the job, calls a tool, re-reads everything it's accumulated, calls another tool, on and on.

Sam: So it's not one paragraph anymore. It's the model talking to itself for an hour.

Alex: And here's the number that shows how violent that shift is. A study across eight frontier models — by a researcher named Bai and colleagues — found that agent work uses on the order of a thousand times more tokens than ordinary chat. A thousand.

Sam: A thousand times. Not a thousand percent — a thousand times.

Alex: A thousand times. And mostly on the input side, which surprised me. The reading, not the writing.

Sam: Why input, though? I'd have guessed it generates a ton of output.

Alex: Because of how an agent works step to step. Every time it takes an action — calls a tool, gets a result — it has to re-read the entire conversation so far to decide what to do next. So step one reads a little. Step ten re-reads everything from steps one through nine. Step fifty re-reads the whole pile again.

Sam: Oh — so the context it has to re-read keeps growing, and it re-reads the whole thing every single step. It's paying to re-read its own history over and over.

Alex: It snowballs. And it's so dependent on the messy specifics that the same task, run twice, can vary thirty-fold in tokens — thirty times more expensive on an unlucky run than a lucky one, for the identical request. So the flat price sat completely still for two years while the unit of work went from "one reply" to "one entire workflow." That gap — that's the engine of the subsidy. It's not generosity. It's a price tag that forgot to move while the product ran away from it.

Sam: Okay, that's the first big reframe and I already feel like I've been lied to twice. The meter makes money, and the safe-looking flat plan is the bonfire. What's the second lie?

Alex: The second lie is in the price sheet itself, and it scrambles the ranking of the models. Here's the setup: line up two models by their list price per million tokens. One's clearly cheaper per token. Make them both do the exact same job. The cheaper one can hand you the bigger bill.

Sam: That… should not be possible. Cheaper per token, more expensive overall?

Alex: It's possible because the cost of intelligence is no longer the cost of a token. It's the cost of how many tokens the model burns to think. And the reasoning models — the ones that "think" before they answer — generate this huge volume of hidden intermediate tokens. Their scratch work. You never see it, but you pay for it, at the output rate.

Sam: So there's a visible answer, and then there's this invisible iceberg of thinking underneath that's also on my bill.

Alex: That's exactly the right image. And it's so distorting that one research group, Epoch AI, threw reasoning models out of their price comparison entirely. They said these models "generate a much larger number of tokens," so comparing them to other models on price-per-token is just "misleading."

Sam: They couldn't even rank them fairly. Okay, give me the real number. How big is the iceberg?

Alex: There's a benchmark — a fixed set of reasoning problems — where every model got fed about the same thirty-one million prompt tokens. Same questions for everyone. OpenAI has a cheap little model, GPT-4o-mini. It generated nine-point-four million tokens of completion and cleared the whole thing for ten dollars and thirty-one cents.

Sam: Ten bucks for the whole suite. Okay, that's the baseline — hold that number.

Alex: Then they ran OpenAI's o3-mini — a reasoning model. It generated a hundred and eleven million completion tokens. Nearly twelve times as many. And at a higher rate. Final cost: five hundred and twenty-two dollars.

Sam: From ten dollars to five hundred. On the same questions.

Alex: A fifty-fold spread. Same problems, same answers required — the entire difference is how much each model sat there thinking. And just to show it's not one company: DeepSeek's reasoning model logged about ninety-six million tokens on that suite. Anthropic's Claude 3.7 Sonnet, about eleven million. Wildly different thinking habits, wildly different bills, for identical work.

Sam: So "dollars per token" is basically a lie. The honest number is dollars per finished task.

Alex: Dollars per completed task. And the two have come completely apart.

Sam: Okay but here's my cynical question. All that extra thinking — it's worth it, right? You're paying five hundred instead of ten because the answer's way better?

Alex: That is exactly the right question, and the answer is: often, no. There's a teardown from a company called Refuel, doing data extraction. They switched from a plain model to a reasoning model. The output got six-point-seven times longer — and the cost with it. The accuracy improvement?

Sam: …go on.

Alex: Four-point-nine percent.

Sam: Four point nine. So I pay nearly seven times more, and I get a five percent better answer. That's a terrible trade.

Alex: For that task, a terrible trade.

Sam: And I bet that's the trap most companies are walking straight into. They see "reasoning model," they assume smarter is better, they switch everything over — and they don't find out until the invoice that they septupled their bill for a rounding error of accuracy.

Alex: That's precisely the trap, and it's why people who run this in production have learned to budget three to five times the visible answer just for the hidden thinking on heavy jobs — and to be ruthless about which tasks actually need a reasoning model at all. Most don't. It flips the whole intuition: the cheapest model per token is routinely the most expensive per result. And — this is the kicker — it's also why a brand-new frontier model can raise its per-token price and still honestly claim to be cheaper.

Sam: How does raising the price make it cheaper?

Alex: Because if the new model is smart enough to finish in far fewer tokens, the total cost of the task can drop even though each token costs more. OpenAI framed its latest flagship as roughly a twenty percent rise in the cost to complete a task — even though the per-token rate doubled — because it gets there in fewer tokens.

Sam: So the only honest way to know what a model costs… is to run your own actual work through it.

Alex: Your own workload. There is no universal answer to "what does this cost." It depends entirely on what you ask it to do. Which, by the way, is two lies down — and we still haven't found why some of these companies are bleeding so much worse than others.

Sam: So before we go on — let me make sure I've got the two lies straight, because they're both kind of beautiful. Lie one: the meter looks like the giveaway, but it actually makes money — the real subsidy is your flat plan, forty to seventy times underwater. Lie two: the cheap-per-token model is often the expensive-per-job model, once you count the hidden thinking.

Alex: That's it exactly.

Sam: And the thing that's been nagging me through both is the one you keep dangling — why are some of these companies bleeding so much worse than others? They're all selling roughly the same thing.

Alex: Right, and this is the heart of it. The subsidy is not the same depth at every lab — and the difference is the single best predictor of who survives. Let me give you the cleanest way to measure it. Forget the model for a second. Just ask: for every dollar of compute a company spends, how much revenue does it earn back?

Sam: Revenue per compute dollar. So above a dollar, you're making money on the hardware. Below a dollar, you're losing it.

Alex: Above one, the hardware pays for itself before you've even paid an engineer. Below one, you're underwater on day one. So here are two companies people think of as neck and neck. On forward estimates built from leaked cost data, Anthropic earns about a dollar seventy per compute dollar.

Sam: Okay, a dollar seventy. Comfortably above water.

Alex: And OpenAI earns about sixty-eight cents.

Sam: Sixty-eight. So OpenAI is — what — thirty-two cents underwater on every compute dollar, before anyone's even paid?

Alex: Before a single salary. And this gets corroborated by OpenAI's own financials, which leaked and were verified by the Financial Times: thirteen-point-one billion dollars of revenue against around thirty-four billion of cost. An operating loss near twenty-one billion dollars.

Sam: Twenty-one billion. In a year. That is — hang on, that's one of the biggest losses I've ever heard of for a software company.

Alex: It's close to historic. And here's the part that breaks the public story: the company everyone treats as the default king of AI has the weaker unit economics of the two. Meanwhile Anthropic, sitting above that one-dollar line, can actually use price as a weapon — it can cut prices to attack. OpenAI, underwater, can only use price as a shield.

Sam: So when I see them both drop prices, those are not the same move. One's swinging. One's flinching.

Alex: Completely different moves. And it got concrete in mid-2026. It was reported that OpenAI was weighing major API price cuts specifically to fight off Anthropic — in the same stretch that Anthropic's valuation, around nine hundred sixty-five billion, passed OpenAI's, around eight hundred fifty-two billion, for the first time. And Anthropic's coding product, Claude Code, crossed a billion dollars of annualized revenue within months of launching.

Sam: And just so I'm calibrated — are those two roughly the middle of the pack? Or is there worse?

Alex: Oh, there are wilder edges in both directions, and they make the point even sharper. The clearest below-cost case is xAI — Elon Musk's lab, the one that makes Grok. It prices its newest Grok model's output at a fraction of what rivals charge, while reportedly burning something like twenty-eight million dollars a day. By one estimate it recovers about fourteen cents of its fully-loaded cost for every dollar it earns.

Sam: Fourteen cents on the dollar. So it's basically setting money on fire to buy market share.

Alex: That's the aggressive end. And then the opposite edge is genuinely jaw-dropping — DeepSeek, the Chinese lab. During something they called "Open Source Week" they published a real twenty-four-hour snapshot of their inference. About eighty-seven thousand dollars of GPU time — on older H800 chips rented at two dollars an hour — and on that hardware they served six hundred and eight billion input tokens and a hundred and sixty-eight billion output tokens.

Sam: Those are enormous numbers for eighty-seven grand.

Alex: So enormous that when you bill them at DeepSeek's published rate, it implies a theoretical profit margin of five hundred and forty-five percent.

Sam: Five hundred and forty-five percent. That can't be a real margin.

Alex: And to their credit, DeepSeek stamped it "theoretical" themselves — most traffic runs cheaper models, there are off-peak discounts, the web and app are free. SemiAnalysis thinks they actually serve close to cost to grab share. But even if you discount it to nothing, the signal survives: an efficient stack can be wildly profitable at prices something like twenty to fifty times below the American incumbents. DeepSeek's reasoning model lists around fifty-five cents per million input tokens. The comparable OpenAI model — o1 — was around fifteen dollars.

Sam: Fifty-five cents versus fifteen dollars. For the same kind of model.

Alex: And the executives have basically settled the "is inference subsidized" question on the record. We heard Altman — profitable on inference. Amodei, on a podcast, walked through a toy version: imagine a model that cost a hundred million dollars to train, and then earns two hundred million serving customers. The serving part is healthily profitable; it's the training that's the giant hole. Now — one honest caveat, because I don't want to oversell it. OpenAI quotes an internal "compute margin" of about seventy percent, but that number strips out training and free-tier inference. Its actual adjusted gross margin landed nearer thirty-three percent.

Sam: Wait, so which is it — seventy or thirty-three? That's a huge gap.

Alex: Both, depending on what you count. Seventy percent is just the raw cost of serving a paying query. Thirty-three is after you fold in the free users and the cost of building the thing. But here's what doesn't change either way: what's sold below cost is not the paying query on the meter. It's the free tier and the flat subscription wrapped around it.

Sam: Okay, the through-line holds. So back to the why. Why are these companies so far apart in the first place? Is Anthropic just… smarter?

Alex: That's the thing — it's mostly not about talent, and it's not about who has the better model. It comes down to who owns the factory. And to see it you have to go one layer below everything we've been talking about. Below the price sheet, below the model, down to the actual chips.

Sam: The silicon.

Alex: The silicon. So: nearly every frontier lab rents its compute from someone who bought chips from NVIDIA. And NVIDIA earns roughly a seventy-five percent gross margin on those AI servers.

Sam: Seventy-five percent. So three-quarters of what these labs pay for their hardware is just… NVIDIA's profit.

Alex: It's a tax. A tax baked into every single token an NVIDIA-renting lab produces — paid before power, before staff, before training. OpenAI pays it through Microsoft's Azure cloud. xAI pays it directly, on its own NVIDIA fleet.

Sam: Hang on — so even OpenAI, the biggest name in the field, doesn't escape it? It's renting from Microsoft, who bought from NVIDIA, who takes the seventy-five percent?

Alex: Every layer takes its cut before OpenAI sells you a single token. That's the tax everyone's paying.

Sam: Everyone… except. You've got an "except" face.

Alex: Google. Google is the conspicuous exception, and it's the answer to the question most of the coverage just skips, which is — where does Gemini actually sit in all this? Here's what Google did. It designs its own chips. They're called TPUs. It buys the bare silicon from Broadcom at a low margin, and then builds its own boards, its own racks, the whole system itself.

Sam: So Google just… cut NVIDIA out of the loop. It refused to pay the tax.

Alex: It built its own factory. And the numbers SemiAnalysis got from tearing down Google's latest generation are stark. A full Google chip pod costs Google about forty-four percent less to own than a comparable NVIDIA system. It rents to outside customers for about thirty percent less per hour. And once you adjust for performance at realistic usage, the advantage stretches toward sixty-two percent lower cost for a unit of actual useful compute.

Sam: Sixty-two percent cheaper to do the same work. That's not an edge, that's a different sport.

Alex: And you can see it land right on the meter. Google's flagship Gemini lists around two dollars per million input tokens, twelve for output. OpenAI's mainstream flagship is around two-fifty and fifteen — its very newest, GPT-5.5, is higher still, five and thirty. Anthropic's most capable model, five and twenty-five. So a real mixed task on Gemini runs about twenty-eight percent cheaper than the OpenAI equivalent, thirty-seven percent cheaper than Anthropic.

Sam: So the company that owns its factory has the lowest prices. That's not a coincidence, that's cause and effect.

Alex: And there's a subtler reason on top, the under-reported part — Google doesn't even need the tokens to pay for themselves. It runs the assistant ad-free and just absorbs the cost out of its Search business, which prints money. So Google can choose to make its consumer plan a loss leader, while its API still runs near or above cost.

Sam: So everyone else is subsidizing because they're trapped, and Google's subsidizing because it feels like it.

Alex: One is desperation, one is a choice. And honestly the accounting is so favorable to Google it's almost hidden — more than ten billion dollars of Gemini's running costs are tucked under a company-wide AI research line that jumped from about three billion to five-point-four billion in a year. So there's no clean "Gemini margin" you can point to. But every signal points the same way: lowest cost to serve, deepest pockets, least dependent on the subsidy of anyone in the field.

Sam: Okay, is there a single fact that just nails it? Because this is a lot of estimates.

Alex: The most telling proof is who's buying. Anthropic — Google's most direct rival on models, the company making Claude — has committed to renting up to a million of Google's chips. Reported to be worth on the order of forty billion dollars. With a multi-gigawatt follow-on after that.

Sam: Wait. Anthropic — Google's competitor — is paying Google tens of billions of dollars to use Google's chips?

Alex: To escape NVIDIA's margin. When your fiercest competitor would rather pay you forty billion dollars than keep renting NVIDIA, the market has rendered its verdict. Owning the factory wins.

Sam: That is the whole story in one transaction — your biggest rival paying you forty billion dollars to escape the trap you're not in. So is Google the only one who figured this out, or are there others?

Alex: No — and this is the pattern. Amazon runs the exact same playbook with its own chips, called Trainium — which, funnily enough, Anthropic's models also run on. And then Meta plays a different escape: it gives its models, Llama, away as open weights. Free. Which drags the entire price floor down toward just the cost of running it yourself — the cheapest hosted Llama is fifteen to forty cents per million tokens.

Sam: Why would Meta give it away for free? That seems insane next to everyone else burning billions to sell it.

Alex: Because Meta doesn't make money on the tokens. It makes money on the ads its models make better. So it would rather everyone uses a free Meta model and salts the earth for the companies trying to charge. So you end up with three durable escape hatches from a price war you're losing money in. Own the factory — Google, Amazon. Or don't need the revenue at all — Meta. And everybody else…

Sam: …is racing a clock.

Alex: Is racing a clock. That's the asymmetry no price sheet can ever show you. Two products, same shelf, same price — one's a healthy business circling for the kill, the other's underwater praying for a refinance.

Sam: Alright, you've set up something that I think is going to do my head in, so let me say it back. We've got companies losing twenty-one billion dollars a year. And yet you keep telling me the price of AI is collapsing. Those two things should not be able to coexist. Prices crashing AND record losses?

Alex: They sound mutually exclusive, and they're both completely true at the same time. Let me give you both halves, and then the thing that reconciles them, because the reconciliation is maybe the single most important idea in the whole story.

Sam: Go.

Alex: Half one: the cost of a fixed amount of intelligence is falling faster than almost anything in the history of computing. Epoch AI measured the price to hit a certain level of performance — answering PhD-grade science questions — and found it dropping something like forty times a year.

Sam: Forty times a year. Not forty percent. Forty times.

Alex: At the optimistic end, yes. The honest caveat is that some of that is models getting tuned to the tests, and tighter measurements put the real rate nearer three to five times a year. But even three to five times a year is staggering. Altman frames it as a kind of law — he wrote that "the cost to use a given level of AI falls about ten times every twelve months." He pointed out the price from one of their models to the next dropped about a hundred and fifty times.

Sam: Okay so prices in free-fall. That's half one. Half two is the losses.

Alex: Half two: the sellers are losing money at a scale with almost no precedent in software. We said OpenAI — twenty-one billion in operating losses. Projected cumulative losses well past a hundred billion before they ever have a profitable year. And Anthropic, despite the better economics, near a thirty-billion-dollar revenue run-rate, had to cut its own margin forecast toward forty percent because its inference costs on rented cloud ran about twenty-three percent over plan.

Sam: So how? How is the price crashing and the losses ballooning at the same time? Somebody explain this to me like I'm — okay, like I'm smart but baffled.

Alex: It's a hundred-and-fifty-year-old idea called the Jevons paradox. Here's the cleanest version. You make a resource cheaper. People don't use the same amount and pocket the savings. They use so much more of it that total spending actually goes up.

Sam: Give me the analogy, because my brain wants one.

Alex: Okay. Imagine the price of electricity drops by ninety percent. Do you spend less on power? For about a week. Then you buy the bigger TV, you get air conditioning, you leave more lights on, you buy an electric car. Cheaper electricity didn't shrink your bill — it invited a whole new pile of things to plug in, and your bill goes up.

Sam: Oh. So cheaper tokens don't save anyone money. Cheaper tokens just mean everyone runs way more AI.

Alex: They unlock the agents. The economist Torsten Slok at Apollo put it plainly: as tokens get cheaper, companies "don't spend less, they run more AI agents, automate more workflows, generate more code" — and total spending climbs even as the unit cost collapses. And the numbers are wild. Bain found token prices roughly halved in a year, while the volume consumed grew about four hundred and fifty percent.

Sam: Prices cut in half, usage up four hundred and fifty percent. So of course the total bill explodes. And — wait, this connects back to that thousand-times number, doesn't it? The agent that uses a thousand times more tokens than a chat?

Alex: It's the same force, yes. Say more — where are you going with it?

Sam: Well, if making tokens cheaper is what made agents affordable to run in the first place, then the price cut didn't just get absorbed by more usage. It manufactured the more usage. It created the demand that ate it. The cheaper it got, the more reasons appeared to spend.

Alex: That's the paradox in one move, and it's a better way to say it than I had. It's not that demand happened to grow. The price drop unlocked an entirely new way to use the thing — the always-on agent — that simply wasn't viable at the old price. You didn't run a thousand-token agent when tokens were expensive. You do now. So the savings don't reach your wallet; they get reinvested instantly into doing vastly more.

Sam: So cheaper AI doesn't mean a cheaper AI bill. Almost the reverse.

Alex: Almost the reverse. Enterprise spending on this stuff went from about eleven and a half billion to roughly thirty-seven billion in a single year — even as per-token prices fell more than ninety percent. That's the shape of every Jevons story: the unit gets cheaper, the appetite grows faster, the total climbs. Price per unit in free-fall, total spend through the roof.

Sam: Okay. So the obvious move now — the thing I'd do — is just take today's subsidized price, line it up against the "true cost," and read off how big the gap is. Right? That tells me how much trouble everyone's in.

Alex: That's the move everyone wants to make, and it fails. Because "true cost" isn't a fixed floor you can measure the gap to. True cost is itself in free-fall. It's a moving target. Let me build it from the bottom.

Sam: From the chip up.

Alex: From the chip up. Start with renting one NVIDIA chip — the H100, the workhorse. The same chip rents for under two dollars an hour on a spot marketplace, around two-fifty to three-fifty on a mid-tier provider like Lambda or RunPod, and up to roughly ten dollars an hour on the priciest hyperscaler setups.

Sam: Hold on, the identical chip is two dollars in one place and ten in another? A five-times range for the same hardware?

Alex: Same silicon. Five-fold range. Depends entirely on who you rent it from. And that's just the top of the fraction. The rental rate is the numerator. The real action is the denominator: how many useful tokens you actually squeeze out of that chip-hour.

Sam: And let me guess — that number's all over the place too.

Alex: It's often catastrophic. A widely cited figure puts average enterprise chip usage near five percent.

Sam: Five percent utilization. So ninety-five percent of the time, the thing they're paying for is just… sitting there. Idling.

Alex: One analysis called it "essentially a donation to the cloud provider." Ninety-five cents of every dollar you spend on silicon, gone, for nothing. And remember, a modern AI cluster is something like sixty to seventy percent hardware by cost — so every idle moment is real capital depreciating in the rack.

Sam: And I assume the fix is just… keep the chip busy.

Alex: That's the whole game. There's a technique — continuous batching — where instead of running one request at a time, you pack many through the chip together, so it's never sitting idle waiting. Do that well and utilization jumps from the low twenties into the seventies. That alone cuts cost per token three to four-fold.

Sam: So two companies could rent the exact same chip, and the one who packs it well pays a quarter of what the sloppy one pays — for the identical hardware.

Alex: For the identical hardware. The skill is invisible and it's enormous.

Sam: So the "true cost" of a token isn't really about the model at all. It's about how full the building is when the model runs.

Alex: That's the punchline. It's a property of the data center, not the model. And then the floor drops again, because the chips keep getting better. NVIDIA's Blackwell generation cut cost per token roughly ten times versus the chips before it. The souped-up version pushes that toward twenty-five, thirty-five times. And at the start of 2026 NVIDIA claimed its next platform — Vera Rubin — would cut inference cost another ten times on top of Blackwell when it ships later in the year.

Sam: So every layer I look at, the cost is sliding out from under me. The rental rate, the utilization, the chip generation.

Alex: All of it, at once. And for the ones who run efficiently, the serve costs are already startlingly low — SemiAnalysis measured DeepSeek's reasoning model on a current system at about fifty-four cents per million output tokens, at full interactive speed.

Sam: Fifty-four cents. So "how much more would it cost to pay the true price" — there just isn't one answer.

Alex: There's a range, and it's enormous. For a heavy power user maxing a flat plan, the gap is huge — that forty-to-seventy-times we started with. But for an efficiently-run metered workload, the gap can be near zero, or even favorable — because the API is the part the leading labs already price above cost. The subsidy is concentrated exactly where it's most visible: your flat consumer plan. And it's thinnest on the metered bill. The whole thing inverts the folk wisdom one more time.

Sam: So the question everyone actually wants answered: when does the music stop? When do the subsidies end and we all pay full freight?

Alex: Predicting the exact date is a fool's errand. But the order of events is completely legible — and the first moves are already on the board. There are three repricings coming. And one of them runs in the opposite direction to what everyone expects.

Sam: Okay, give me all three.

Alex: One: the flat consumer and developer plans migrate toward usage-based pricing. This isn't a forecast anymore — it's happening. Anthropic put weekly rate limits on Claude. GitHub Copilot ended its flat plan and moved to metered "AI credits" — to a revolt, by the way, nine hundred fifty-eight downvotes against twenty-four upvotes on its own announcement.

Sam: [laughs] People were thrilled.

Alex: Furious. A coding tool called Cursor switched its twenty-dollar plan to a metered credit pool, watched people's bills explode, and the CEO had to publicly apologize — "we didn't handle this pricing rollout well and we're sorry" — but he didn't reverse it. And the sharpest case is Anthropic again: it announced that programmatic usage of its Agent SDK — a subsidy it openly pegged at fifteen to thirty times relative to its own API pricing — would move to a capped credit pool at full rates.

Sam: Fifteen to thirty times. So they admitted that one out loud.

Alex: They named the number. And then — facing backlash, a looming IPO, and a class-action lawsuit claiming the Max plan delivered far less than advertised — they paused the change on the very day it was supposed to take effect. Told users "nothing changes for now." As of late June, that pause still holds.

Sam: So the giveaway doesn't vanish overnight. It gets a meter, or a lower cap, or a price hike for the heaviest users. And the backlash every single time tells you something, right? People didn't just buy a tool — they built their whole workflow on top of a price that was always quietly temporary.

Alex: That's the human cost underneath all the economics. The flat plan felt like a promise. And what these companies are discovering is that taking the meter away is easy and putting it back is a betrayal — even when the math was never going to hold.

Sam: It's the seventy-times subsidy from the start of the episode, coming due. The bill was always there. It just had someone else's name on it for a while.

Alex: Beautifully put. And whose name it lands on next is exactly the fight. Now — repricing two. And here the conventional wisdom is just wrong. People assume all API prices are grinding down toward true cost. They're not. The market has split in two. The budget and mid-tier models do race toward zero — dragged down by free open-weight models like Meta's Llama. But the newest frontier models have real pricing power. OpenAI's latest flagship launched at double its predecessor's per-token rate. Input and output.

Sam: Double. So at the very top, prices are going up, not down.

Alex: Up. On the argument we talked about earlier — that it's smart and efficient enough to be cheaper per task even at a higher per-token price. So "API prices falling to true cost" describes the bottom of the market. At the top, the frontier is being priced up by how much value it delivers.

Sam: Okay and the third?

Alex: The third is the hinge the whole forecast turns on. "True cost" itself keeps falling. So the gap doesn't close because prices jump up to meet a fixed cost. It closes because cost falls toward prices while prices fall toward cost — and the company that runs out of money before the two lines meet loses, no matter how cheap its sticker looked. Altman has said both halves of this weeks apart. "Intelligence too cheap to meter," at one event. And then "people buy it from us on a meter," at another.

Sam: Those completely contradict each other. Too cheap to meter, and also, here's your meter.

Alex: And yet they're both true at once — that's the whole trick of this.

Sam: Oh, I think I see it. It's the difference between the price of one token and the size of the bill. One token gets so cheap it's practically free — too cheap to bother metering. But you're running agents that chew through billions of them. So they absolutely will meter you — not because each token is expensive, but because the pile is enormous.

Alex: That's exactly the resolution. The per-unit price falls toward zero; the meter stays, because the bill is the volume. It's the electricity story again — each kilowatt-hour is cheap, but you still get an electricity bill, because you use so many. Intelligence is becoming a utility. And nobody gives away a utility for free forever.

Sam: So "too cheap to meter" and "we'll meter you" aren't a contradiction. They're a sequence. Cheap per unit, metered in bulk. Okay. I came in thinking AI was subsidized in this vague, simple way, and I'm leaving with a completely rearranged head. Can we land the plane? What are the two or three things to actually walk away with?

Alex: Yeah. Three things. First — and this is the one that should change how you read this entire space — two AI products at the same price are not two companies in the same position. One can be selling above cost and using price to attack; the other underwater, praying the music plays long enough to refinance. And the deciding difference is one layer down: does the company own its silicon, like Google and Amazon, or does it rent NVIDIA's seventy-five percent margin like nearly everyone else?

Sam: Ask who owns the chips. That's the one a price sheet can never show you.

Alex: Second: the subsidy is not where you thought. The meter makes money. The flat subscription is the loss leader — that forty-to-seventy-times giveaway to its heaviest users. So treat any flat-rate plan you depend on as temporary. Assume the meter is coming. Only the date is open.

Sam: And measure the model by the job, not the token.

Alex: That's the third. The cost of intelligence is dollars per completed task, not dollars per token — so the verbose "cheap" model is often the expensive one, and the pricey frontier model is sometimes the bargain. The only way to know is to run your own work through it. And underneath all of it, the cost floor is falling out from under everyone at once — the same deflation that's making small, efficient models good enough to run on hardware you already own, which is a thread we pulled in our episode on Apple's contrarian, efficiency-first bet.

Sam: So the survivors won't be whoever shows the lowest sticker today. It really comes back to those three escape hatches, doesn't it — own the factory like Google and Amazon, give it away like Meta, or get above that one-dollar line on your own. And everyone outside those three is just hoping the deflation reaches them before the money runs out.

Alex: That's the whole map. And it's why "who has the best model this quarter" turns out to be almost the wrong question. The model lead changes hands every few months — but the chip strategy is a decade-long bet you can't reverse in a hurry. The benchmark is the headline; the supply chain is the story.

Sam: So I should basically stop reading the leaderboards and start reading the balance sheets.

Alex: Honestly, yeah. The survivors will be whoever's already above one dollar per compute dollar — and on the right side of the silicon — when the subsidies switch off. So watch the unit economics. Not the price sheet.

Sam: That's a genuinely different way to look at the whole industry. I hope you all come away from this seeing a bit more clearly where this is heading — because it's a fast-moving, genuinely complex picture, with a brutally short shelf life on what we think we know, and that's exactly what makes it worth following closely.

Alex: And a quick note, for full transparency: this show is AI-generated. Dan builds a custom stack of AI tools to chase the questions he can't stop thinking about — it started out made with NotebookLM, and it's now produced with his own engine — mainly so he can learn this stuff himself, and he publishes it for anyone who'd like to follow along.

Sam: If you've enjoyed this one, please do give us a follow — it genuinely helps the next person find the show.

Alex: And one more thing, from Dan directly: he'd genuinely love to hear from you — what you'd want more of, what you'd change, what landed and what didn't. You can write to him at podcast@connectiveshift.com. He's looking forward to it. Thanks for listening — we'll see you next time.