Photo by Tyler on Unsplash. Source: https://unsplash.com/photos/a-rack-of-electronic-equipment-in-a-dark-room-OnI_TNcIv9U (Unsplash License).

Executive Summary

Enterprise AI spending is shifting from training to serving, and the bill compounds on whoever runs inference. That shift redraws the line between public cloud and the data center. Vendors now compete over control of the tokens, not the models.

Broadcom launched VMware AI Factory, a software-defined base for a private AI cloud that runs bare metal through inference in one environment. An AI Gateway governs models across on-premises and cloud, with certified servers from Dell, Cisco, Lenovo, and Supermicro, plus MetalSoft automating provisioning of mixed hardware. The pitch is tokenomics, meaning faster time to first model and predictable cost per unit of AI work. The subtext is licensing. After pushing customers to subscriptions, Broadcom needs VMware Cloud Foundation to be where AI runs. Watch whether an ordinary admin can reach a governed model without a team of specialists.

What Broadcom actually announced

Broadcom announced VMware AI Factory, a software-defined foundation for what it calls the VMware Private AI Cloud. The pitch is simple. Run production AI inside your own data center, on infrastructure you already manage, with a single environment that spans bare metal all the way to inference.

The bundle leans on the strongest card Broadcom still holds. That is the instinct many enterprises already have to keep sensitive data and expensive compute under their own control. AI Factory brings models to that data instead of sending the data to a public cloud to meet the model.

The plumbing includes an AI Gateway that gives one interface for model governance across on-premises and cloud, so a team can reach locally hosted and external models the same way. It adds observability into token throughput, latency, and compute and memory use. Broadcom also lined up certified server hardware from Dell, Cisco, Lenovo, and Supermicro, and a partnership with MetalSoft to automate provisioning of mixed bare-metal hardware.

Why this is a tokenomics play, not just a product launch

The wording Broadcom used is the tell. It talks about controlling AI tokenomics and getting a faster time to first model. That is the language of cost per unit of AI work, not the language of feature lists.

That framing lands at a real tension. Enterprise AI spending is shifting from training to serving, and inference is where the bills compound. Every team running models in production is watching cost per token and cost per completed task. Broadcom is selling the idea that a private cloud you already own can undercut the public cloud for the workloads where data cannot leave and latency has to stay low.

It is also a defensive move as much as an offensive one. Broadcom bought VMware and moved it to subscription licensing, which pushed a wave of customers to look at alternatives. Now it needs VMware to be the place where the next wave of spending happens. AI is that wave. If VCF is not where AI runs, VCF becomes a tax on legacy workloads and slowly fades.

There is an operational angle too. Most enterprises already run a virtualization estate and a storage layer and a network. Pushing AI onto that same footprint means reusing skills and controls the team already has, instead of standing up a separate AI stack with its own tooling and its own people. For a lot of organizations, that reuse is the difference between an AI pilot that stalls and one that ships.

What to watch before you believe it

Private AI clouds have a habit of looking great on a launch stage and stalling in procurement. The hard questions are licensing, hardware availability, model support, and whether the operational experience is genuinely unified or a bundle of loosely connected products. Broadcom has promised a single consistent environment. The proof is whether an ordinary enterprise admin can get from bare metal to a running, governed model without a team of specialists.

There is also a strategic question for everyone evaluating this. Broadcom is asking customers to make their AI platform the same vendor whose licensing changes already caused friction. That is a bigger wager than a single product decision. It is a bet that the value of keeping AI in-house outweighs the risk of deepening a relationship with a vendor many teams are still unhappy with.

The direction is clear either way. Private cloud is no longer just where legacy apps live. Broadcom wants it to be where AI lives too, and it is willing to spend on hardware partnerships and automation to make that real. Whether customers follow is the open question.

Related reading. The Cost of AI Is Finally Falling. The Cost of Using It Is Not.. Gartner Says Half of Enterprises Are Ready to Leave VMware. The DHI Market Is the Reason.. The Next Big AI Win Is Cutting Power Per Workload, Not Adding More Chips. The 2026 State of Enterprise Infrastructure.

By Ivan Tarin

Ivan Tarin is a Principal Product Marketing Manager at SUSE, where he owns go-to-market strategy and positioning for a seven-product cloud-native portfolio spanning Kubernetes, virtualization, storage, security, and observability. A former full-stack developer who shipped production code for enterprise and public-sector clients including U.S. national laboratories, Ivan translates complex infrastructure and AI technology into messaging that lands with developers, platform teams, and enterprise buyers. He has presented at KubeCon, SUSECON, and AWS Developer Week, and is currently pursuing an MS in Artificial Intelligence at the University of Colorado Boulder.

2 thoughts on “Broadcom Wants VMware to Be Where Your AI Runs. Inside Your Own Walls.”

Leave a Reply

Your email address will not be published. Required fields are marked *

Get the next one before it is old news

Independent analysis of cloud-native infrastructure, Kubernetes and data centre economics. No vendor spin.