Get all your news in one place.
100's of premium titles.
One app.
Start reading
International Business Times
International Business Times
Merin Rebecca Thomas

AI Boom Hits a Wall As Computing Power Runs Short And Costs Surge: Report

Data Center

The artificial intelligence industry is increasingly running into a constraint that is no longer theoretical: there simply is not enough computing capacity to match demand.

A recent investigation by the Wall Street Journal highlights how major AI companies are already rationing access to their systems as infrastructure tightens across the sector. What was once a frictionless scaling story is now becoming a story of allocation, limits and trade-offs.

The pressure is most visible in how AI products are being used. Instead of simple chatbot queries, companies are rolling out "agentic" systems that perform complex multi-step tasks such as writing software, analyzing data and managing workflows. These tools consume significantly more compute per request, accelerating strain on underlying infrastructure.

Industry research from the International Energy Agency(IEA) has warned that global data center electricity demand could rise sharply this decade, with AI identified as one of the key drivers. This growing energy requirement is now intersecting with a physical constraint: chips, electricity, and data center capacity are not scaling at the same speed as AI demand.

The primary constraint is a global shortage of high-performance GPUs, largely produced by Nvidia. These chips power both training and deployment of large AI models, and demand has surged across cloud providers and AI startups simultaneously. The result has been rising costs, longer procurement cycles and increasingly competitive access to compute resources.

Infrastructure constraints are now shaping corporate behavior across the industry. According to the WSJ, AI companies such as Anthropic have introduced tighter usage limits on tools like Claude during peak periods as demand spikes overwhelm available capacity. Developers have reported hitting caps more quickly, while enterprise customers are increasingly sensitive to service interruptions.

The strain is also affecting the cloud ecosystem. CoreWeave, a major AI-focused infrastructure provider, has raised prices and shifted toward longer-term contracts as demand for GPU capacity continues to exceed supply. Similar dynamics have been noted across the broader cloud market, where access to high-end compute is increasingly treated as a scarce, pre-allocated resource rather than an on-demand utility, according to a MarketWatch report.

Even the largest AI companies are being forced into internal trade-offs. OpenAI has faced rising pressure as usage of its systems has surged across consumer and enterprise products, with compute allocation decisions increasingly shaping which products scale and which are delayed, another MarketWatch story noted.

Beyond chips, the physical infrastructure required to support AI is also under strain. Data centers take years to build, while power grid capacity in many regions is already fully allocated. Analysts at firms such as McKinsey and infrastructure consultancies have repeatedly warned that electricity and interconnection delays are becoming a binding constraint on hyperscale AI expansion.

In parallel, GPU availability itself has tightened significantly. Industry analysis from sources such as Clarifai and Spheron has pointed to extended lead times and rising rental costs for high-end chips, with demand consistently outpacing supply.

Service reliability is showing strain under these pressures, with AI APIs experiencing more variability than mature cloud platforms that typically target near-perfect uptime, according to industry uptime data and recent outage reporting.

The broader picture, reflected across reporting from the Wall Street Journal, MarketWatch and industry infrastructure analysis, is that AI is entering a phase where growth is no longer limited by demand or innovation, but by compute availability itself.

Sign up to read this article
Read news from 100's of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.