Nvidia said it has expanded its NVLink Fusion platform with NVHBM, a next-generation high-bandwidth memory technology aimed at improving AI infrastructure efficiency. According to the company’s blog, NVHBM integrates the memory controller into the HBM base die. Compared with standard HBM4E, the design can deliver up to 30% more memory bandwidth, cut HBM power consumption by 15%, and free up as much as 25% of die area for XPU compute chips.
Amazon’s Annapurna Labs will be the first partner to adopt NVHBM as part of a broader collaboration with Nvidia around NVLink Fusion. The two companies said they will use the technology together with NVLink scale-up architecture to improve the performance and efficiency of AI workloads.
Nvidia also said NVHBM will be offered as a standard implementation and validated by multiple memory suppliers. The company said the approach is intended to help hyperscalers and AI-native companies deploy semi-custom AI infrastructure faster and with lower risk.
Nvidia has expanded its NVLink Fusion platform with NVHBM, a next-generation high-bandwidth memory technology designed for AI infrastructure.
According to the NVIDIA Blog, NVHBM integrates the memory controller into the HBM base die. Compared with standard HBM4E, the technology can provide up to 30% more memory bandwidth, reduce HBM power consumption by 15%, and free up as much as 25% of die area for XPU compute dies.
Annapurna Labs is the first partner
Annapurna Labs, an Amazon subsidiary, will be the first partner to adopt NVHBM. Nvidia said the move is part of a broader collaboration between the two companies on NVLink Fusion.
The companies said they will use the technology alongside NVLink scale-up architecture to improve the performance and efficiency of AI workloads.
Standard implementation for semi-custom AI systems
Nvidia said NVHBM will be made available as a standard implementation and validated by multiple memory suppliers. The company said the goal is to help hyperscalers and AI-native companies deploy semi-custom AI infrastructure faster and with lower risk.
This article was originally published by Bit.Fan. For more cryptocurrency news and market insights, visit www.bit.fan. Disclaimer:
The market information, project data, and third-party content displayed on this platform are for industry information sharing only and do not constitute any form of investment advice or return commitment.
Cryptocurrency trading carries high risks. Users should fully assess their risk tolerance and make independent decisions. All profits, losses, and legal responsibilities are borne by the users themselves.
