Executive Summary
Enterprise AI spending is shifting from training to serving, and the bill compounds on whoever runs inference. That shift redraws the line between public cloud and the data center. Vendors now compete over control of the tokens, not the models.
Broadcom launched VMware AI Factory, a software-defined base for a private AI cloud that runs bare metal through inference in one environment. An AI Gateway governs models across on-premises and cloud, with certified servers from Dell, Cisco, Lenovo, and Supermicro, plus MetalSoft automating provisioning of mixed hardware. The pitch is tokenomics, meaning faster time to first model and predictable cost per unit of AI work. The subtext is licensing. After pushing customers to subscriptions, Broadcom needs VMware Cloud Foundation to be where AI runs. Watch whether an ordinary admin can reach a governed model without a team of specialists.
What Broadcom actually announced
Broadcom announced VMware AI Factory, a software-defined foundation for what it calls the VMware Private AI Cloud. The pitch is simple. Run production AI inside your own data center, on infrastructure you already manage, with a single environment that spans bare metal all the way to inference.
The bundle leans on the strongest card Broadcom still holds. That is the instinct many enterprises already have to keep sensitive data and expensive compute under their own control. AI Factory brings models to that data instead of sending the data to a public cloud to meet the model.
The plumbing includes an AI Gateway that gives one interface for model governance across on-premises and cloud, so a team can reach locally hosted and external models the same way. It adds observability into token throughput, latency, and compute and memory use. Broadcom also lined up certified server hardware from Dell, Cisco, Lenovo, and Supermicro, and a partnership with MetalSoft to automate provisioning of mixed bare-metal hardware.
Why this is a tokenomics play, not just a product launch
The wording Broadcom used is the tell. It talks about controlling AI tokenomics and getting a faster time to first model. That is the language of cost per unit of AI work, not the language of feature lists.
That framing lands at a real tension. Enterprise AI spending is shifting from training to serving, and inference is where the bills compound. Every team running models in production is watching cost per token and cost per completed task. Broadcom is selling the idea that a private cloud you already own can undercut the public cloud for the workloads where data cannot leave and latency has to stay low.
It is also a defensive move as much as an offensive one. Broadcom bought VMware and moved it to subscription licensing, which pushed a wave of customers to look at alternatives. Now it needs VMware to be the place where the next wave of spending happens. AI is that wave. If VCF is not where AI runs, VCF becomes a tax on legacy workloads and slowly fades.
There is an operational angle too. Most enterprises already run a virtualization estate and a storage layer and a network. Pushing AI onto that same footprint means reusing skills and controls the team already has, instead of standing up a separate AI stack with its own tooling and its own people. For a lot of organizations, that reuse is the difference between an AI pilot that stalls and one that ships.
What to watch before you believe it
Private AI clouds have a habit of looking great on a launch stage and stalling in procurement. The hard questions are licensing, hardware availability, model support, and whether the operational experience is genuinely unified or a bundle of loosely connected products. Broadcom has promised a single consistent environment. The proof is whether an ordinary enterprise admin can get from bare metal to a running, governed model without a team of specialists.
There is also a strategic question for everyone evaluating this. Broadcom is asking customers to make their AI platform the same vendor whose licensing changes already caused friction. That is a bigger wager than a single product decision. It is a bet that the value of keeping AI in-house outweighs the risk of deepening a relationship with a vendor many teams are still unhappy with.
The direction is clear either way. Private cloud is no longer just where legacy apps live. Broadcom wants it to be where AI lives too, and it is willing to spend on hardware partnerships and automation to make that real. Whether customers follow is the open question.
Related reading. The Cost of AI Is Finally Falling. The Cost of Using It Is Not.. Gartner Says Half of Enterprises Are Ready to Leave VMware. The DHI Market Is the Reason.. The Next Big AI Win Is Cutting Power Per Workload, Not Adding More Chips. The 2026 State of Enterprise Infrastructure.
Get the next one before it is old news
Independent analysis of cloud-native infrastructure, Kubernetes and data centre economics. No vendor spin.

[…] What to watch before you believe the private AI cloud promise. Read the full piece. […]
[…] reading. Broadcom Wants VMware to Be Where Your AI Runs. Inside Your Own Walls.. The Next Big AI Win Is Cutting Power Per Workload, Not Adding More Chips. The Gartner Magic […]