NVIDIA H200 shipments delayed to Q3  · BREAKING: Microsoft confirms 3GW data centre expansion in Asia-Pacific ·  AWS announces new sovereign cloud regions in India and UAE  · Arm-based servers now 24% of hyperscale deployments ·  EU AI Act enforcement enters phase two  · Global data centre investment hits $612B in 2026 ·  TSMC Arizona yields improve to 68% on 3nm process  · OpenAI valuation reaches $400B after latest funding round ·  NVIDIA H200 shipments delayed to Q3  · BREAKING: Microsoft confirms 3GW data centre expansion in Asia-Pacific ·  AWS announces new sovereign cloud regions in India and UAE  · Arm-based servers now 24% of hyperscale deployments ·  EU AI Act enforcement enters phase two  · Global data centre investment hits $612B in 2026
NVIDIA H200 shipments delayed to Q3  · BREAKING: Microsoft confirms 3GW data centre expansion in Asia-Pacific ·  AWS announces new sovereign cloud regions in India and UAE  · Arm-based servers now 24% of hyperscale deployments ·  EU AI Act enforcement enters phase two  · Global data centre investment hits $612B in 2026 ·  TSMC Arizona yields improve to 68% on 3nm process  · OpenAI valuation reaches $400B after latest funding round ·  NVIDIA H200 shipments delayed to Q3  · BREAKING: Microsoft confirms 3GW data centre expansion in Asia-Pacific ·  AWS announces new sovereign cloud regions in India and UAE  · Arm-based servers now 24% of hyperscale deployments ·  EU AI Act enforcement enters phase two  · Global data centre investment hits $612B in 2026

OpenAI and Broadcom Inference Chip Signals Deeper Push Into Custom AI Infrastructure

OpenAI is expanding beyond frontier models and into silicon design after it partnered with Broadcom to develop a custom inference

Share
OpenAI

OpenAI is expanding beyond frontier models and into silicon design after it partnered with Broadcom to develop a custom inference processor, marking one of its biggest infrastructure moves yet. The companies introduced Jalapeño, calling it the first AI accelerator within a multi-generation compute platform and underscoring OpenAI’s ambition to control more of the technology stack powering future artificial intelligence services. Rather than relying exclusively on third-party accelerators, the company is positioning proprietary hardware as a strategic lever to improve inference efficiency while supporting the massive compute requirements that the AI industry will face over the next decade. The announcement also reflects a broader industry shift as leading AI developers increasingly invest in vertically integrated infrastructure to optimize performance, reduce costs and scale deployments.

Jalapeño Designed Around Large Language Model Inference

OpenAI architected Jalapeño using insights from developing and operating frontier large language models, while Broadcom transformed those specifications into manufacturable silicon. Celestica joined the collaboration as the board, rack and system integration partner, creating an end-to-end hardware platform instead of delivering a standalone processor. The partners say they engineered the accelerator specifically for inference workloads, where responsiveness, networking efficiency and power consumption increasingly determine the economics of large AI deployments. Consequently, the project represents more than another AI chip launch, it highlights an effort to redesign infrastructure around the operational demands of production-scale language models.

The company also expects Jalapeño to deliver higher performance per watt than current alternatives, an increasingly important metric as hyperscale operators prepare facilities that will consume hundreds of megawatts and eventually gigawatts of electricity. Higher inference efficiency could lower operating costs while allowing AI providers to serve more requests within the same power envelope. “The world is moving to a compute-powered economy,” Greg Brockman, President and Co-Founder of OpenAI, said in a press release. “Jalapeño is part of our long-term full-stack infrastructure strategy to make compute more abundant, resulting in AI which is faster, more reliable, more affordable for people and businesses, and can be used to solve more important problems. By designing more of the stack ourselves, we can serve more intelligence with greater efficiency and keep pushing advanced AI toward broader access.”

Broadcom Eyes Multi-Generation AI Silicon Roadmap

For Broadcom, the partnership extends its strategy of co-developing custom AI silicon with hyperscale customers instead of competing directly in the merchant accelerator market. The company said Jalapeño represents only the first step in a broader hardware roadmap that will support next-generation AI infrastructure across multiple deployment cycles. AI companies continue driving demand for custom accelerators as they seek alternatives that better match their proprietary software stacks and operational requirements. Broadcom combines its manufacturing expertise with OpenAI’s model-level optimization to shorten development cycles and improve hardware utilization.

“Our collaboration with OpenAI represents a fundamental commitment to scaling the physical infrastructure required for the next decade of AI,” Hock Tan, President and CEO of Broadcom, added. “This is just the beginning of a multi-generation roadmap. By co-developing our industry-leading silicon directly with OpenAI, we are enabling the deployment of gigawatt scale data centers with Microsoft and other partners beginning in 2026.” The companies also revealed that Jalapeño progressed from initial design to manufacturing tape-out in just nine months. According to OpenAI, its own AI models assisted portions of the engineering workflow, accelerating design optimization tasks that traditionally require significant manual effort. The milestone illustrates how engineers increasingly apply AI to semiconductor development, creating a feedback loop where advanced models help build the hardware that will run future generations of those same models. Faster design cycles could become a competitive advantage as AI infrastructure evolves at unprecedented speed.

Custom Silicon Supports OpenAI’s Full-Stack Strategy

OpenAI’s hardware leadership emphasized that Jalapeño was engineered around the practical behavior of frontier AI workloads instead of adapting existing processor architectures. The company optimized memory movement, networking characteristics, serving patterns and computational kernels to maximize inference throughput while approaching the hardware’s theoretical performance limits. Those architectural decisions reflect OpenAI’s growing emphasis on building infrastructure tailored specifically to its production environment rather than depending entirely on generalized accelerators.

“Jalapeño was designed from the ground up for LLM inference using detailed insights from our close collaboration with OpenAI researchers,” said Richard Ho, who leads OpenAI’s hardware program. “We optimized the architecture around the kernels, memory movement, networking, and serving patterns that matter most for frontier AI models. Based on early testing, Jalapeño will efficiently execute our most important workloads close to the hardware’s theoretical limits.” The processor is expected to accelerate inference-intensive applications across OpenAI’s ecosystem, including faster ChatGPT responses and more efficient execution of Codex workloads. Those gains become strategically important as AI adoption shifts from experimentation toward production environments that demand predictable latency, lower operating costs and sustained scalability. Custom silicon also gives OpenAI greater control over hardware-software optimization, reducing dependence on external product roadmaps while strengthening its long-term infrastructure strategy.

Gigawatt AI Data Centers Become the Next Competitive Battleground

OpenAI and Broadcom plan to begin deploying Jalapeño inside gigawatt-scale data centers toward the end of 2026 before expanding availability over subsequent years. The announcement aligns with the industry’s rapid transition toward increasingly power-intensive AI campuses designed to support frontier inference at unprecedented scale. If deployment proceeds as planned, Jalapeño will become one of several custom AI accelerators entering a market historically dominated by NVIDIA’s platforms. Whether the processor ultimately challenges NVIDIA’s GB300 NVL72 platform will depend on real-world performance, software ecosystem maturity and production scale once commercial deployments begin. However, the launch demonstrates that the competitive landscape is evolving beyond standalone chips toward tightly integrated hardware, networking and software platforms. For AI infrastructure providers, success may increasingly depend on controlling the full compute stack rather than optimizing individual components alone.

[simple-author-box]

More from AI Infrastructure

CtrlS draws fresh backing for its next build-out CtrlS Datacenters has secured ₹250 crore

Terranova has begun construction on Campus Campinas, a major hyperscale development outside São Paulo

Starcloud has raised $250 million in a Series A extension, giving the space-computing startup

COMPUTE WEEKLY

The briefing that 40,000+ tech leaders read every Monday. Sharp, fast, essential.

Great! We’ve received your information.

Building an AI Startup Without Owning GPUs

Not owning GPUs has become the default, deliberate strategy for building an AI company — not a compromise founders accept reluctantly. H100 rental rates fell 64-75% in fifteen months, a dense ecosystem of neoclouds and inference-as-a-service providers now lets startups skip infrastructure entirely, and credit programs can fund a company’s first year before a founder writes a check
Most Read

Demand is broadening across enterprise workloads APAC’s infrastructure story is changing in ways that

AI infrastructure decisions increasingly influence what enterprises can build, test, and deliver. They also

Why Infrastructure Planning Now Starts With Availability A data center project can have a

A property can look enormous from the site entrance and still offer almost no

As rack power rises toward the megawatt range, the physical footprint of power-delivery equipment

Disruptor Spotlight

Cerebras Systems

The chip that makes Nvidia nervous. Cerebras’ Wafer Scale Engine is rewriting the rules of AI inference at scale.
Faster
0 x
YoY Revenue
0 x
Transistors
0 T
Market Pulse
MSFT
+1.02%
NVDA
+0.66%
AMZN
-0.078%
AMD
-6.95%
TSMC
-2.98%
Indicative only · Not financial advice
Upcoming Events
SEP
The AI Infrastructure Race (India)
WEBINAR · ONLINE
The AI Infrastructure Race: Won on Power, Land and Trust — Not Capital
MAY
0
AI Infrastructure Summit
DUBAI · IN PERSON
MEA’s premier AI infrastructure event.
JUN
0 0
Compute Forecast Summit
SINGAPORE · IN PERSON
Our flagship APAC event. Early bird open.
Latest Moves
Live
ecolab
Ecolab Deepens Cooling Strategy With $4.75B CoolIT Acquisition
Ecolab is making one of its biggest moves yet into AI infrastructure after completing its $4.75 billion acquisition of liquid cooling specialist CoolIT Systems
Pure DC AVK Europe data center microgrid Dublin 110MW AI infrastructure Ireland 2026
Pure DC and AVK Deploy Europe’s First 110 MW Data Center Microgrid in Dublin
The Pure DC Dublin microgrid has made history as Europe’s first large-scale on-site data center microgrid, launched in partnership with power solutions provider AVK at Pure DC’s campus in Ireland.
Pace Digitek
Pace Digitek Partners With MEGMEET to Expand AI Data Center Power Business
India’s AI infrastructure ecosystem continues to mature as domestic technology manufacturers move beyond traditional telecommunications and industrial markets toward high-growth digital infrastructure opportunities
Follow Compute Forecast
11K followers
1200 followers
Companies to Watch
CW
CoreWeave
Neo Cloud · $19B · IPO Watch
CB
Cerebras Systems
AI Hardware · $4.25B · Pre-IPO
G42
G42
Sovereign AI · Abu Dhabi
H
Humain
Saudi AI · $40B Fund
Latest Podcast
AI Capex, Cloud Margins & the Nuclear Bet
48 MIN · 25 APR 2026

OpenAI and Broadcom Inference Chip Signals Deeper Push Into Custom AI Infrastructure

OpenAI is expanding beyond frontier models and into silicon design after it partnered with Broadcom to develop a custom inference

Share
OpenAI
35
847 SHARES

0
SHARES

[simple-author-box]

More from AI Infrastructure

Demand is broadening across enterprise workloads APAC’s infrastructure story is changing in ways that

AI infrastructure decisions increasingly influence what enterprises can build, test, and deliver. They also

Why Infrastructure Planning Now Starts With Availability A data center project can have a

A property can look enormous from the site entrance and still offer almost no

COMPUTE WEEKLY

The briefing that 40,000+ tech leaders read every Monday. Sharp, fast, essential.

Great! We’ve received your information.

Global AI Infrastructure Outlook 2026

The briefing that 40,000+ tech leaders read every Monday. Sharp, fast, essential.
Download Free
Most Read

Demand is broadening across enterprise workloads APAC’s infrastructure story is changing in ways that

AI infrastructure decisions increasingly influence what enterprises can build, test, and deliver. They also

Why Infrastructure Planning Now Starts With Availability A data center project can have a

A property can look enormous from the site entrance and still offer almost no

As rack power rises toward the megawatt range, the physical footprint of power-delivery equipment

Disruptor Spotlight

Cerebras Systems

The chip that makes Nvidia nervous. Cerebras’ Wafer Scale Engine is rewriting the rules of AI inference at scale.
Faster
0 x
YoY Revenue
0 x
Transistors
0 T
Market Pulse
NVDA
$924.60
+2.4%
MSFT
$421.30
+1.1%
AMZN
$192.80
-0.6%
NVDA
$924.60
+2.4%
NVDA
$924.60
+2.4%
Indicative only · Not financial advice
Upcoming Events
MAY
0 0
DCD Global — London
LONDON · IN PERSON
World’s largest DC event. CF is media partner.
MAY
0
AI Infrastructure Summit
DUBAI · IN PERSON
MEA’s premier AI infrastructure event.
JUN
0 0

Compute Forecast Summit

SINGAPORE · IN PERSON
Our flagship APAC event. Early bird open.
Latest Moves
  • Live
Sam Altman
OpenAI appoints new Chief Infrastructure Officer to lead $100B DC programme
27 APR · OPENAI
Sam Altman
OpenAI appoints new Chief Infrastructure Officer to lead $100B DC programme
27 APR · OPENAI
Sam Altman
OpenAI appoints new Chief Infrastructure Officer to lead $100B DC programme
27 APR · OPENAI
Follow Compute Forecast
18.4K followers
12.1K followers
9.3K subscribers
41 episodes
Companies to Watch
CW
CoreWeave
Neo Cloud · $19B · IPO Watch
CB
Cerebras Systems
AI Hardware · $4.25B · Pre-IPO
G42
G42
Sovereign AI · Abu Dhabi
CW
Humain
Saudi AI · $40B Fund
Latest Podcast
AI Capex, Cloud Margins & the Nuclear Bet
48 MIN · 25 APR 2026
Scroll to Top