NVIDIA and the $1T AI Buildout for the Agent Era

Their new combined architecture can deliver up to 35x higher inference throughput per megawatt and up to 10x more...

Mar 22, 2026

What I Read This Week: a summary of the content that I consumed this past week…

Caught My Eye…

1) NVIDIA and the $1T AI Buildout for the Agent Era

On March 16, 2026, at NVIDIA’s GTC keynote, Jensen Huang said, “I believe that computing demand has increased by 1 million times in the last 2 years… the inference inflection has arrived.” He now sees at least $1 trillion in revenue from Blackwell and Rubin between 2025 and 2027, up from the $500B forecast last year.

NVIDIA’s Vera Rubin platform integrates seven specialized chips into a unified rack, delivering 10x the inference efficiency and 4x the training performance of the Blackwell generation. This architecture features the purpose-built Vera CPU, which accelerates agentic AI and reinforcement learning workflows with twice the efficiency of traditional rack-scale processors.

NVIDIA also used GTC to show how its stack is shifting from model training toward low-latency inference and autonomous software systems. The new Groq 3 LPX rack, built around 256 LPUs, is designed to sit alongside Vera Rubin and handle the latency-sensitive parts of inference. The combined architecture can deliver up to 35x higher inference throughput per megawatt and up to 10x more revenue opportunity for trillion-parameter models.

On the software side, the company introduced NemoClaw, a new stack for the OpenClaw ecosystem. This will let users install Nemotron models and OpenShell in a single command. Privacy and security within an isolated sandbox will enable self-evolving, autonomous AI agents. Jensen described a future where NVIDIA would grow to 75,000 employees working alongside 7.5 million AI agents.

2) The Data Center Boom Hits a Power Bottleneck

At the end of 2025, the US disclosed data center pipeline reached 241 GW, an increase of 159% from the beginning of the year. But only a third of projects in the data center pipeline are under active development. Wood Mackenzie’s Q4 2025 data shows developers added 25 GW of new capacity last quarter, half the pace of Q3.

“Utilities just don’t necessarily have either the grid capacity or the generating capacity to be able to build it fast enough to accommodate these new large energy demand centers… It’s a bend in the trajectory that we’re now seeing companies realizing that they need to focus on projects at hand, rather than just endlessly adding new ones.” - Ben Hertz-Shargel, Global Head of Grid Edge for Wood Mackenzie

Overall, per-megawatt costs declined, but rack power densification has resulted in cost per square foot rising. This shows the industry’s shift toward more energy-dense facilities for efficiency and inference latency. Texas continues to maintain its lead in total pipeline capacity, while New Mexico, Indiana, and Wyoming saw the largest proportional growth due to their access to natural gas.

Reuters reports that hyperscalers are expected to spend roughly $650 billion in 2026, up over $200 billion since 2025. So in nominal terms, CapEx is hitting record highs, but it is becoming harder to expand at the same pace. The constraint has shifted from capital availability to the ability to secure energy, navigate interconnection rules, and deliver projects on time.

“Hyperscalers are increasingly partnering with developers and signing multi-gigawatt portfolios rather than single-asset PPAs” - Caroline Mead, SVP of Power Marketing at developer ⁠Engie North America

3) Crypto Gets Defined, and Equities Get Tokenized

On March 17, the U.S. Securities and Exchange Commission (SEC), issued an interpretative release clarifying how federal securities laws apply to crypto assets, with the help of the CFTC. The courts can deviate from it if they don’t like its rationale, but the SEC will follow up shortly with a proposed rule. The guidance introduces a formal taxonomy that separates crypto into five categories:

Digital commodities: Not Securities
Digital collectibles: Not Securities
Digital tools: Not Securities
Stablecoins: Not Securities
Digital securities: Securities

The release also outlines how assets can transition into or out of “investment contract” status and provides specific guidance on activities such as airdrops, staking, mining, and asset wrapping.

On March 18, the SEC approved Nasdaq’s proposal to support tokenized versions of traditional securities through a pilot program with the Depository Trust Company (DTC). Initial eligibility includes Russell 1000 stocks and major index ETFs. The structure preserves the existing market with tokenized shares being fungible with their traditional counterparts. They carry the same ticker and CUSIP and provide identical rights, including dividends and voting.