SemiAnalysis says Moonshot AI’s Kimi K3 could deepen demand for NVIDIA infrastructure

SemiAnalysis says Moonshot AI’s Kimi K3 could deepen demand for NVIDIA infrastructure

N
News Editor
2026-07-18 01:03:18
A SemiAnalysis report argues that Moonshot AI’s release of Kimi K3, while highlighting China’s progress in advanced AI models, does not weaken demand for high-end chips. Instead, the report says the model’s scale, deployment requirements and infrastructure needs could reinforce NVIDIA’s position in large-scale compute systems. Kimi K3 is described as having 2.8 trillion total parameters, making it one of the largest open models globally by parameter count. Although it uses a Mixture of Experts architecture to reduce inference cost by activating only part of the model at a time, the hardware threshold remains high. According to Moonshot AI, enterprises that want to deploy Kimi K3 on their own need a supernode equipped with at least 64 accelerators. SemiAnalysis also points to the importance of interconnect and memory performance for trillion-parameter models, citing NVIDIA’s NVLink and InfiniBand as key advantages in large clusters. The report adds that China’s rapid progress may push U.S. tech companies including Microsoft, Google and Meta to keep increasing capital spending on compute infrastructure and next-generation models, leaving NVIDIA as a major beneficiary of the broader AI compute race.
Moonshot AIKimi K3NVIDIAAI computeGPUSemiAnalysisLLM infrastructure

SemiAnalysis said in a research report that Moonshot AI’s Kimi K3, despite showing strong competitiveness, still appears to benefit NVIDIA from an infrastructure perspective. The report said the model’s high-end performance and open-source strategy do not reduce global demand for advanced chips. Instead, they strengthen NVIDIA’s standing in the compute market.

Its main argument is that training and deploying models of this size carries an extremely high technical threshold, with requirements for underlying hardware and network interconnect rising sharply. SemiAnalysis also said China’s fast progress in AI is likely to pressure leading U.S. technology companies to step up capital spending to preserve their lead. In that framing, Kimi K3 is not only a software breakthrough but also a catalyst for broader global buildouts of compute infrastructure.

Kimi K3’s scale keeps hardware requirements high

SemiAnalysis said Kimi K3 has 2.8 trillion total parameters, making it one of the world’s largest open models by parameter count. The model uses a Mixture of Experts, or MoE, architecture, so only a portion of its parameters is activated during each inference run to cut compute costs. Even so, the overall hardware bar remains demanding.

Moonshot AI said enterprise users that want to deploy Kimi K3 themselves would need a supernode with at least 64 accelerators to run it smoothly. For companies aiming to put the open model into production, that means buying large numbers of high-end graphics processing units, or GPUs, creating potential demand for NVIDIA hardware.

Interconnect and memory demand add to NVIDIA’s edge

The report said that once model parameters reach the trillion scale, raw compute power on a single chip is no longer the only factor that matters. Data transfer efficiency between servers becomes just as important. SemiAnalysis said handling contexts as long as 1 million tokens requires very large memory bandwidth and very low latency.

Against that backdrop, NVIDIA’s NVLink interconnect and InfiniBand networking stack retain a performance advantage in building large clusters, according to the report. For data centers that need to run Kimi K3 reliably, adopting NVIDIA’s full system architecture remains the most dependable way to keep data movement from becoming a bottleneck. The report added that demand for HBM and DRAM also continues to rise.

China’s progress could keep pressure on U.S. tech spending

SemiAnalysis said Kimi K3’s performance in long-horizon coding and agent tasks is approaching that of leading U.S. AI labs. From a broader economic angle, the report argued that Chinese AI companies offering advanced models at very low inference cost could increase competitive pressure on major U.S. technology groups.

It specifically named Microsoft, Google and Meta, saying those companies are unlikely to cut investment if they want to avoid falling behind. Instead, they may have to expand capital spending on compute infrastructure and push ahead with next-generation models, including GPT-5-level systems.

In SemiAnalysis’s view, that global compute arms race leaves NVIDIA as one of the main beneficiaries.

This article was originally published by Bit.Fan. For more cryptocurrency news and market insights, visit www.bit.fan.
300

Disclaimer:

The market information, project data, and third-party content displayed on this platform are for industry information sharing only and do not constitute any form of investment advice or return commitment.

Cryptocurrency trading carries high risks. Users should fully assess their risk tolerance and make independent decisions. All profits, losses, and legal responsibilities are borne by the users themselves.