Share This Article
Ted Hisokawa Nov 18, 2024 19:20
NVIDIA's H200 NVL GPU offers enhanced performance for AI and HPC applications, suitable for enterprise servers with lower-power, air-cooled rack designs, providing increased efficiency and configurability.
NVIDIA has introduced the H200 NVL PCIe GPU, a new addition to its Hopper architecture, aimed at improving AI and high-performance computing (HPC) applications for enterprise servers. Unveiled at the Supercomputing 2024 conference, the H200 NVL offers a lower-power, air-cooled design that is ideal for data centers with flexible configurations, according to NVIDIA.
The H200 NVL GPU is designed to accommodate the needs of data centers with enterprise racks that are 20kW and below, which predominantly use air cooling. This makes it a crucial component for providing granularity in node deployment, allowing organizations to optimize their computing power efficiently. The GPU offers a 1.5x increase in memory and a 1.2x increase in bandwidth over its predecessor, the NVIDIA H100 NVL, enabling faster AI model fine-tuning and inference performance.
Complementing the hardware capabilities of H200 NVL is NVIDIA’s NVLink technology, which offers GPU-to-GPU communication speeds seven times faster than the fifth-generation PCIe. This advancement is particularly beneficial for high-demand tasks such as large language model inference and fine-tuning.
Enterprises across various sectors are already leveraging the H200 NVL for diverse applications. Dropbox uses NVIDIA’s accelerated computing to enhance its AI and machine learning capabilities, while the University of New Mexico applies it in research areas such as genomics and climate modeling. These use cases underscore the GPU’s potential to drive efficiency and innovation in AI and HPC workloads.
Major technology companies, including Dell Technologies, Hewlett Packard Enterprise, Lenovo, and Supermicro, are expected to support the H200 NVL in a variety of configurations. NVIDIA’s global systems partners will begin offering platforms featuring the H200 NVL in December. Additionally, NVIDIA is developing an Enterprise Reference Architecture to assist partners and customers in deploying high-performance AI infrastructure at scale.
For further details, visit the official NVIDIA blog here.
11/20/2024 8:38:18 AM
11/20/2024 8:30:00 AM
11/20/2024 8:24:15 AM
11/20/2024 8:16:53 AM
11/20/2024 8:16:19 AM
Email us at info@blockchain.news
Welcome to your premier source for the latest in AI, cryptocurrency, blockchain, and AI search tools—driving tomorrow’s innovations today.
Disclaimer: Blockchain.news provides content for informational purposes only. In no event shall blockchain.news be responsible for any direct, indirect, incidental, or consequential damages arising from the use of, or inability to use, the information provided. This includes, but is not limited to, any loss or damage resulting from decisions made based on the content. Readers should conduct their own research and consult professionals before making financial decisions.