📣

Advertisement

Google Ad - 970×90 Leaderboard  TOP_LEADERBOARD_4

AI Infrastructure Costs Are Climbing and Passing to Consumers

Photo: TechCrunch

Article

AI Infrastructure Costs Are Climbing and Passing to Consumers

Recent AI news shows energy, chips, and model deployment costs are rising, with implications for US consumers and tech firms.

Arjun NairSeptember 3, 20266 min read
📣

Advertisement

Google Ad - 970×90 Leaderboard  TOP_LEADERBOARD_4

The Thread: AI’s Growing Pains Are Real and Expensive

The stories from the past two days share a single, quiet thread: the material cost of artificial intelligence is rising just as quickly as its capabilities. From Google’s new, harder-working model with unchanged pricing to Amazon’s new anti-scam feature that leverages AI, and from Fervo’s 400-megawatt geothermal deal with Google to Broadcom’s strong but cautious earnings, one pattern emerges. AI’s next phase is not purely a software story - it is a story about power, chips, deployment complexity, and consumer trust. And for US companies and consumers, these costs will be felt in prices, reliability, and security.

Powering the Boom: Geothermal for Data Centers

The most direct signal comes from the energy side. As TechCrunch reported, Fervo has signed a deal to supply Google with 400 megawatts of enhanced geothermal power, with an option to expand to 1 gigawatt - enough to run a very large AI data center in Utah. That is not a minor footnote; it is a marker of how much electricity modern AI workloads demand. Data centers are the physical engine room of AI, and the US grid is not growing fast enough to power them on conventional sources alone.

The fact that Google is turning to enhanced geothermal - a relatively young technology - indicates that AI’s energy appetite is changing procurement strategies at the largest US tech firms. It also means that the cost of electricity, and the infrastructure to deliver it, will become an input cost for AI services. For US consumers, this is not an abstract concern. AI-powered products - from search to assistants to cloud services - depend on cheap, reliable power. If that power is harder to source, the price of those services will eventually rise, or the services will be limited to regions where power is abundant. The Fervo deal also points to a broader trend: tech companies are becoming direct investors in energy infrastructure, not just customers of utilities.

Chips: The Cost of Customization

The second cost center is silicon. Broadcom beat expectations on earnings and revenue in its third-quarter report, as SiliconANGLE noted, and hinted at more business with leading AI labs. The chipmaker’s stock dipped after its current-quarter forecast trailed Wall Street’s estimates. The key word here is "custom chips." AI labs are increasingly moving away from off-the-shelf GPUs to custom accelerators designed for specific workloads. That customization is expensive - both to design and to manufacture.

Broadcom’s strong third quarter but cautious fourth-quarter outlook suggests that the AI chip market is not a straight line upward. There is a limit to how fast even the most AI-hungry companies can absorb new hardware. The short-term dip in Broadcom’s stock after a beat is a reminder that Wall Street expects growth, but the underlying costs of custom chip development are rising. For US technology companies, this means that AI hardware will not get cheaper on a predictable curve. The days of exponential performance gains per dollar may be flattening. For US consumers, the cost of AI will be embedded in the price of everything from smartphones to cloud subscriptions, because the chips inside them are becoming more specialized and less commodity-like.

Models: More Work, Same Price - For Now

Google’s new Gemini 3.8 Flash model, as The Verge reported, "works harder" than its predecessor by performing more reasoning steps and calling tools iteratively. It launched just weeks after 3.7 Flash and retains the same introductory pricing - $0.75 per million input tokens and $3.75 per million output tokens. That is a notable pricing decision. The model does more, but the per-token cost is unchanged. That suggests Google is absorbing the additional compute cost in the short term, likely to gain market share in developer tools.

But that pricing is introductory, and the word "introductory" carries weight. If the model genuinely requires more compute per request, that will show up in Google’s infrastructure costs. Either the company will eventually raise prices, or it will find efficiencies in inference and hardware. The "works harder" language is also a signal to developers: you can get better performance, but it may not come free forever. For US businesses building on Gemini, this is a cautionary note. The current price is a teaser, not a floor. For consumers, the cost is indirect but real - more capable AI assistants and search features will raise the cost of running Google’s services, which could translate into higher subscription fees or more advertising in free products.

Advertisement

📣

728x90

MID_CONTENT_2

Consumer Trust: AI as a Shield Against Itself

The least obvious but most consumer-facing story is Amazon’s new feature, which The Verge covered. Amazon is using its AI assistant, Alexa for Shopping, to help users determine whether emails, text messages, or phone calls actually came from the company. The assistant will compare the message against known Amazon communication patterns and flag likely impersonations. This is AI being used to counteract a type of fraud that has escalated with the rise of generative AI - scammers can now create convincing fake Amazon messages more easily.

This feature is not about raw performance or cost; it is about trust. And trust is a cost in its own right. US consumers are bombarded with phishing attempts, and a significant portion of those impersonate major retailers. Amazon’s move is a defensive investment - it is using AI to protect its brand and its customers. But the feature also has a price. Every time a user asks Alexa to verify a message, it requires inference compute, and that compute is not free. Amazon is likely subsidizing this feature to retain customer loyalty, but the underlying expense will be folded into the cost of its retail and cloud operations.

The irony is that AI is being used to fight a problem that AI itself has worsened. Generative models can produce fake emails that are nearly indistinguishable from real ones. Amazon’s solution is a sophisticated classifier that leverages its own data. For US consumers, this is a welcome safety net, but it is also a reminder that AI is a double-edged sword. The same technology that powers productivity tools can power sophisticated scams, and the countermeasures are not free.

A Single Balance Sheet

When these stories are viewed together, a coherent picture forms. AI is moving from a research phase to an industrial phase, and that transition carries a physical and financial weight. Every AI query requires electricity, silicon, and software. The electricity is scarce, the silicon is customized, and the software is becoming more computationally hungry. Consumers are seeing the benefits - better models, fraud protection - but they are also seeing the costs in the form of subscription price increases, or in the subtle ways that companies pass on infrastructure expenses.

The US market is uniquely positioned in this moment. American companies like Google, Amazon, and Broadcom are leading the AI infrastructure buildout. But the US also faces a tight electricity grid, a semiconductor manufacturing ecosystem that is still catching up to demand, and a consumer base that is increasingly wary of AI-enabled fraud. The companies that manage these constraints well will thrive; those that do not will see margins shrink.

What to Watch

The immediate question is whether Google’s introductory pricing on Gemini 3.8 Flash will hold. If the model is truly more compute-intensive, the price will rise, and that will signal the end of the era of dropping AI costs. Similarly, keep an eye on Broadcom’s next-quarter guidance - if its cautious forecast becomes a trend, it will indicate that even the most AI-exposed chipmaker is hitting limits. And watch how many other major tech firms follow Google into direct power purchase agreements. If Fervo’s deal with Google expands to the full 1 gigawatt, as TechCrunch notes is possible, that will confirm that energy is the new battleground for AI. Finally, for US consumers, Amazon’s anti-scam feature is a test case. If it proves popular, other retailers will copy it, and the cost of those AI verifications will be passed on - either in higher prices or in more ads. The thread is clear: AI’s next wave will be measured not only in benchmarks, but in kilowatts, wafers, and confidence.

More on this beat: AI on TechManNews.

Advertisement

📣

728x90

IN_ARTICLE_5

#AI costs#data center energy#custom AI chips#Gemini pricing#consumer AI trust

Newsletter

Get Tech News in Your Inbox

The latest AI, gadgets, software and startup stories from TechManNews, delivered every morning - free.