...
NVIDIA H200 shipments delayed to Q3  · BREAKING: Microsoft confirms 3GW data centre expansion in Asia-Pacific ·  AWS announces new sovereign cloud regions in India and UAE  · Arm-based servers now 24% of hyperscale deployments ·  EU AI Act enforcement enters phase two  · Global data centre investment hits $612B in 2026 ·  TSMC Arizona yields improve to 68% on 3nm process  · OpenAI valuation reaches $400B after latest funding round ·  NVIDIA H200 shipments delayed to Q3  · BREAKING: Microsoft confirms 3GW data centre expansion in Asia-Pacific ·  AWS announces new sovereign cloud regions in India and UAE  · Arm-based servers now 24% of hyperscale deployments ·  EU AI Act enforcement enters phase two  · Global data centre investment hits $612B in 2026
NVIDIA H200 shipments delayed to Q3  · BREAKING: Microsoft confirms 3GW data centre expansion in Asia-Pacific ·  AWS announces new sovereign cloud regions in India and UAE  · Arm-based servers now 24% of hyperscale deployments ·  EU AI Act enforcement enters phase two  · Global data centre investment hits $612B in 2026 ·  TSMC Arizona yields improve to 68% on 3nm process  · OpenAI valuation reaches $400B after latest funding round ·  NVIDIA H200 shipments delayed to Q3  · BREAKING: Microsoft confirms 3GW data centre expansion in Asia-Pacific ·  AWS announces new sovereign cloud regions in India and UAE  · Arm-based servers now 24% of hyperscale deployments ·  EU AI Act enforcement enters phase two  · Global data centre investment hits $612B in 2026

Google Cloud Next 2026 Reveals TPUs Built for Memory Scale

At the 2026 edition of Google Cloud Next 2026, Google Cloud presented a coordinated shift in how enterprises will build,

Share
TPU memory breakthrough

At the 2026 edition of Google Cloud Next 2026, Google Cloud presented a coordinated shift in how enterprises will build, deploy, and scale artificial intelligence. The company introduced its “Agentic Enterprise” stack, positioning intelligent agents as the new operational layer across workflows, data systems, and applications. At the beginning of the press conference, Sundar Pichai reiterated the significant increase in capital expenditure in a pre-recorded video, emphasizing a sharp rise in investment compared to previous years. As of April, 75% of the tech giant’s new code is AI-generated (and reviewed and approved by engineers), a significant increase from 50% in the fall of last year. This shift reflects a deeper structural change, where enterprises are no longer experimenting with AI tools but reorganizing production systems around autonomous intelligence.

The Rise of the Agentic Enterprise Stack

Building on Vertex AI, Google Cloud launched the Gemini Enterprise agent platform as a unified environment for developing and managing intelligent agents. The platform consolidates model selection, model creation, and agent deployment, while introducing operational layers such as scheduling, DevOps integration, and governance controls. However, its strategic significance lies in how it connects fragmented enterprise systems into a single execution fabric. Agents can now move across datasets, applications, and workflows without manual orchestration, reducing friction between insight and action.

Additionally, Google introduced the “Knowledge Catalog,” a system designed specifically for AI agents rather than human developers. Traditional data catalogs emphasize schema discovery, but this new system captures business semantics, relationships, and contextual meaning. As a result, agents can interpret unstructured data, map complex relationships, and reduce hallucinations. Through “Smart Storage,” data is automatically tagged, embedded, and enriched at ingestion, enabling agents to locate and process information instantly. Together, these systems redefine data readiness for AI-native enterprises.

The infrastructure layer received equal emphasis, particularly with the unveiling of the eighth-generation Tensor Processing Unit. Google split the architecture into TPU 8t for training and TPU 8i for inference, signaling a more specialized approach to compute design. According to Amin Vahdat, a single TPU 8t cluster can scale up to 9,600 chips, supported by 2PB of shared high-bandwidth memory. This architecture delivers 121 ExaFlops of computing power, allowing large-scale models to operate within a unified memory environment rather than fragmented clusters. Inter-chip connectivity bandwidth has doubled, improving synchronization across workloads.

TPU 8t: Scaling Compute Beyond Traditional Limits

The TPU 8t also integrates advanced Reliability, Availability, and Serviceability features, including real-time telemetry monitoring across tens of thousands of chips and automatic fault detection that bypasses damaged interconnect links without interrupting execution. Optical Circuit Switching technology enables dynamic reconfiguration of network topology around failures without human intervention. Overall, the computational performance of the TPU 8t array has nearly tripled compared to the previous generation, with up to twice the performance-per-watt improvement, indicating a shift toward both scale and efficiency.

The TPU 8i addresses a different but equally critical constraint: the memory wall. This bottleneck occurs when processors cannot access data quickly enough, leading to idle compute cycles and latency delays. To solve this, the TPU 8i integrates 288GB of high-bandwidth memory and 384MB of on-chip SRAM, which is three times that of the previous generation. This design allows active model datasets to remain within the chip, minimizing data movement and improving response times. Furthermore, the TPU 8i adopts a hierarchical Boardfly network topology, where groups of interconnected chips scale into larger clusters using both copper connections and Optical Circuit Switching.

TPU 8i: Breaking the Memory Wall

In this structure, communication between any two chips requires no more than seven hops, significantly reducing latency. Compared to the previous generation, the TPU 8i achieves an 80% improvement in cost-performance ratio, enabling enterprises to serve nearly twice as many users at the same cost. Both TPU systems run on Google’s Axion ARM CPU platform and are supported by fourth-generation liquid cooling, underscoring the growing importance of thermal efficiency in high-density AI infrastructure. Google Cloud extended its innovation beyond compute and data into cross-cloud interoperability and enterprise intelligence. The Cross-Cloud Lakehouse allows agents to access and operate on data stored across platforms such as Amazon Web Services and Microsoft Azure as if it were native to Google Cloud. This eliminates data silos and enables seamless analytics across distributed environments.

Based on these capabilities, Google introduced an advanced research agent capable of analyzing both structured and unstructured data to answer complex business questions. Tasks that previously required weeks of manual effort can now be executed with high precision in significantly less time. Meanwhile, security remains a priority. Following the company’s $32 billion acquisition of Wiz, Google Cloud launched the “Google Cloud Anti-Fraud Defense Platform,” designed to identify and verify bots, real users, and proxy traffic. This reflects a broader recognition that as AI systems scale, so do the risks associated with automated interactions.

TPU Architecture Targets Scale, Memory, and Efficiency

Finally, Google Workspace has entered a new phase as an AI-native productivity suite. Positioned against traditional office platforms, it now integrates intelligent capabilities directly into everyday workflows. Gmail introduces a smart inbox assistant, while Google Chat connects conversations with enterprise data to automate actions such as scheduling meetings, generating documents, and creating presentations aligned with corporate branding. Google also ‘excitedly announced’ that, to help businesses immediately embrace a new era of productivity, the company has launched a ‘Rapid Enterprise Migration’ feature. It is now five times faster to migrate an entire organization’s working environment from Microsoft 365 to Google Workspace. Consequently, the announcements at Google Cloud Next 2026 point to a broader industry transition, where infrastructure, software, and workflows converge into a unified AI-driven system, reshaping how enterprises operate at scale.

[simple-author-box]

More from AI Infrastructure

The next contest in artificial intelligence infrastructure is moving beyond who can secure the

Artificial intelligence is often measured through GPU performance, model size, training time, and inference

South Africa’s improving electricity position is creating a deceptively simple narrative for technology infrastructure

COMPUTE WEEKLY

The briefing that 40,000+ tech leaders read every Monday. Sharp, fast, essential.

Great! We’ve received your information.

Building an AI Startup Without Owning GPUs

Not owning GPUs has become the default, deliberate strategy for building an AI company — not a compromise founders accept reluctantly. H100 rental rates fell 64-75% in fifteen months, a dense ecosystem of neoclouds and inference-as-a-service providers now lets startups skip infrastructure entirely, and credit programs can fund a company’s first year before a founder writes a check
Most Read

Why Infrastructure Planning Now Starts With Availability A data center project can have a

A property can look enormous from the site entrance and still offer almost no

As rack power rises toward the megawatt range, the physical footprint of power-delivery equipment

A data center project can look complete long before it delivers usable capacity. The

AI infrastructure now affects capital planning, operating costs, asset values, and business growth. A

Disruptor Spotlight

Cerebras Systems

The chip that makes Nvidia nervous. Cerebras’ Wafer Scale Engine is rewriting the rules of AI inference at scale.
Faster
0 x
YoY Revenue
0 x
Transistors
0 T
Market Pulse
MSFT
+1.02%
NVDA
+0.66%
AMZN
-0.078%
AMD
-6.95%
TSMC
-2.98%
Indicative only · Not financial advice
Upcoming Events
SEP
The AI Infrastructure Race (India)
WEBINAR · ONLINE
The AI Infrastructure Race: Won on Power, Land and Trust — Not Capital
MAY
0
AI Infrastructure Summit
DUBAI · IN PERSON
MEA’s premier AI infrastructure event.
JUN
0 0
Compute Forecast Summit
SINGAPORE · IN PERSON
Our flagship APAC event. Early bird open.
Latest Moves
Live
ecolab
Ecolab Deepens Cooling Strategy With $4.75B CoolIT Acquisition
Ecolab is making one of its biggest moves yet into AI infrastructure after completing its $4.75 billion acquisition of liquid cooling specialist CoolIT Systems
Pure DC AVK Europe data center microgrid Dublin 110MW AI infrastructure Ireland 2026
Pure DC and AVK Deploy Europe’s First 110 MW Data Center Microgrid in Dublin
The Pure DC Dublin microgrid has made history as Europe’s first large-scale on-site data center microgrid, launched in partnership with power solutions provider AVK at Pure DC’s campus in Ireland.
Pace Digitek
Pace Digitek Partners With MEGMEET to Expand AI Data Center Power Business
India’s AI infrastructure ecosystem continues to mature as domestic technology manufacturers move beyond traditional telecommunications and industrial markets toward high-growth digital infrastructure opportunities
Follow Compute Forecast
11K followers
1200 followers
Companies to Watch
CW
CoreWeave
Neo Cloud · $19B · IPO Watch
CB
Cerebras Systems
AI Hardware · $4.25B · Pre-IPO
G42
G42
Sovereign AI · Abu Dhabi
H
Humain
Saudi AI · $40B Fund
Latest Podcast
AI Capex, Cloud Margins & the Nuclear Bet
48 MIN · 25 APR 2026

Google Cloud Next 2026 Reveals TPUs Built for Memory Scale

At the 2026 edition of Google Cloud Next 2026, Google Cloud presented a coordinated shift in how enterprises will build,

Share
TPU memory breakthrough
47
847 SHARES

0
SHARES

[simple-author-box]

More from AI Infrastructure

Why Infrastructure Planning Now Starts With Availability A data center project can have a

A property can look enormous from the site entrance and still offer almost no

As rack power rises toward the megawatt range, the physical footprint of power-delivery equipment

A data center project can look complete long before it delivers usable capacity. The

COMPUTE WEEKLY

The briefing that 40,000+ tech leaders read every Monday. Sharp, fast, essential.

Great! We’ve received your information.

Global AI Infrastructure Outlook 2026

The briefing that 40,000+ tech leaders read every Monday. Sharp, fast, essential.
Download Free
Most Read

Why Infrastructure Planning Now Starts With Availability A data center project can have a

A property can look enormous from the site entrance and still offer almost no

As rack power rises toward the megawatt range, the physical footprint of power-delivery equipment

A data center project can look complete long before it delivers usable capacity. The

AI infrastructure now affects capital planning, operating costs, asset values, and business growth. A

Disruptor Spotlight

Cerebras Systems

The chip that makes Nvidia nervous. Cerebras’ Wafer Scale Engine is rewriting the rules of AI inference at scale.
Faster
0 x
YoY Revenue
0 x
Transistors
0 T
Market Pulse
NVDA
$924.60
+2.4%
MSFT
$421.30
+1.1%
AMZN
$192.80
-0.6%
NVDA
$924.60
+2.4%
NVDA
$924.60
+2.4%
Indicative only · Not financial advice
Upcoming Events
MAY
0 0
DCD Global — London
LONDON · IN PERSON
World’s largest DC event. CF is media partner.
MAY
0
AI Infrastructure Summit
DUBAI · IN PERSON
MEA’s premier AI infrastructure event.
JUN
0 0

Compute Forecast Summit

SINGAPORE · IN PERSON
Our flagship APAC event. Early bird open.
Latest Moves
  • Live
Sam Altman
OpenAI appoints new Chief Infrastructure Officer to lead $100B DC programme
27 APR · OPENAI
Sam Altman
OpenAI appoints new Chief Infrastructure Officer to lead $100B DC programme
27 APR · OPENAI
Sam Altman
OpenAI appoints new Chief Infrastructure Officer to lead $100B DC programme
27 APR · OPENAI
Follow Compute Forecast
18.4K followers
12.1K followers
9.3K subscribers
41 episodes
Companies to Watch
CW
CoreWeave
Neo Cloud · $19B · IPO Watch
CB
Cerebras Systems
AI Hardware · $4.25B · Pre-IPO
G42
G42
Sovereign AI · Abu Dhabi
CW
Humain
Saudi AI · $40B Fund
Latest Podcast
AI Capex, Cloud Margins & the Nuclear Bet
48 MIN · 25 APR 2026
Scroll to Top
Seraphinite AcceleratorOptimized by Seraphinite Accelerator
Turns on site high speed to be attractive for people and search engines.