NVIDIA HGX H200

Take advantage of the industry’s fastest and most flexible infrastructure. Optimize, train, and deploy with a cloud infrastructure optimized for multi-node operations that supports every step of your ML journey.

GenAI runs on Genesis Cloud and NVIDIA HGXTM H200

Specifically designed to maximize performance with 3.2 Tbps InfiniBand and multi-node GPU support.

Here is an example of a possible node configuration:

8x NVIDIA H200 SXM5 Tensor Core GPU 80 GB
2x 4th Gen Intel® Xeon® 8480+ CPUs
2 TB DDR5 System RAM
3.2 Tbps GPUDirect® InfiniBand Networking
4x 7.68 TB NVMe SSD (30.72 TB in total)
200 Gbps Ethernet Networking
Highlights

Experience next-level
performance

The NVIDIA H200 is the first GPU to offer 141 GB of HBM3e memory at 4.8 TB/s — that’s nearly double the capacity of the NVIDIA H100 Tensor Core GPU with 1.4X more memory bandwidth. The H200’s larger and faster memory accelerates generative AI and LLMs, while advancing scientific computing for HPC workloads

1.9 x

Faster LLama2 70B inference

1.6 x

Faster GPT-3 175B inference

110 x

Faster High-Performance Computing

NVIDIA Preferred Partner

We enable large GenAI and ML workloads

Our benefits

AI-ready with Genesis Cloud

Arrow
Certified data centers in secure sites across Europe
Arrow
Efficiently sustainable, powered by green energy
Arrow
Elastic scaling for varying inference needs
Arrow
Storage and network designed for speed and reliability
Arrow
Enterprise-grade features with advanced security protocols
Arrow
Tailored assistance from our dedicated team

Technical Specifications

Specification
NVIDIA H200 Tensor Core GPU
Form factor
NVIDIA H200 SXM
FP64
34 teraFLOPS
FP64 Tensor Core
67 teraFLOPS
FP32
67 teraFLOPS
TF32 Tensor Core
989 teraFLOPS
BFLOAT16 Tensor Core
1,979 teraFLOPS
FP16 Tensor Core
1,979 teraFLOPS
FP8 Tensor Core
3,958 teraFLOPS
INT8 Tensor Core
3,958 TOPS
GPU Memory
141GB
GPU Memory Bandwidth
4.8TB/s
Decodersectivity
7 NVDEC / 7 JPEG
Confidential Computing
Supported
Max thermal design power (TDP)
Up to 700W (configurable)
Multi-Instance GPUs
Up to 7 MIGs @16.5GB each
Interconnect
NVLink: 900GB/s / PCIe Gen5: 128GB/s
Committed to your success

Working with us is a partnership

With Genesis Cloud as a partner, you’re using state-of-the-art technology and we also stand by your side with direct access to our expert solution architects, infrastructure and machine learning engineers.

Join the success

"Through the partnership with Genesis Cloud, we are offering the easiest, simplest, and lowest cost to scale MLOps. Now, teams using ClearML can automatically spin up and spin down compute instances based on user load with Genesis Cloud’s 100% green energy solution, delivering the lowest cost to train in the market while maintaining our commitment to sustainability."

Moses Guttmann | ClearML
Co-founder & CEO

"Partnering with Genesis Cloud has enabled us at Photoroom to achieve unprecedented performance to train our models. By leveraging Genesis Cloud’s top-of-the-line infrastructure, we have significantly enhanced our computational capabilities. This partnership not only ensures top-tier performance but also aligns with our commitment to sustainability, as Genesis Cloud operates with 100% green energy. The fast support and quick resolution of issues by Genesis Cloud’s team have been instrumental in making this powerful solution a reality."

Eliot Andres | PhotoRoom
Co-Founder & CTO

"As VAST continues to expand our global presence in Europe and beyond, our partnership with Genesis Cloud allows us to serve our joint customers with flexible, high performance infrastructure solutions and services for their growing AI and inference pipelines."

Jeff Denworth | VAST Data
Co-founder

"Through the partnership with Genesis Cloud, we are offering the easiest, simplest, and lowest cost to scale MLOps. Now, teams using ClearML can automatically spin up and spin down compute instances based on user load with Genesis Cloud’s 100% green energy solution, delivering the lowest cost to train in the market while maintaining our commitment to sustainability."

Moses Guttmann | ClearML
Co-founder & CEO

"Partnering with Genesis Cloud has enabled us at Photoroom to achieve unprecedented performance to train our models. By leveraging Genesis Cloud’s top-of-the-line infrastructure, we have significantly enhanced our computational capabilities. This partnership not only ensures top-tier performance but also aligns with our commitment to sustainability, as Genesis Cloud operates with 100% green energy. The fast support and quick resolution of issues by Genesis Cloud’s team have been instrumental in making this powerful solution a reality."

Eliot Andres | PhotoRoom
Co-Founder & CTO

"As VAST continues to expand our global presence in Europe and beyond, our partnership with Genesis Cloud allows us to serve our joint customers with flexible, high performance infrastructure solutions and services for their growing AI and inference pipelines."

Jeff Denworth | VAST Data
Co-founder

"Through the partnership with Genesis Cloud, we are offering the easiest, simplest, and lowest cost to scale MLOps. Now, teams using ClearML can automatically spin up and spin down compute instances based on user load with Genesis Cloud’s 100% green energy solution, delivering the lowest cost to train in the market while maintaining our commitment to sustainability."

Moses Guttmann | ClearML
Co-founder & CEO

"Partnering with Genesis Cloud has enabled us at Photoroom to achieve unprecedented performance to train our models. By leveraging Genesis Cloud’s top-of-the-line infrastructure, we have significantly enhanced our computational capabilities. This partnership not only ensures top-tier performance but also aligns with our commitment to sustainability, as Genesis Cloud operates with 100% green energy. The fast support and quick resolution of issues by Genesis Cloud’s team have been instrumental in making this powerful solution a reality."

Eliot Andres | PhotoRoom
Co-Founder & CTO

"As VAST continues to expand our global presence in Europe and beyond, our partnership with Genesis Cloud allows us to serve our joint customers with flexible, high performance infrastructure solutions and services for their growing AI and inference pipelines."

Jeff Denworth | VAST Data
Co-founder
Reserve your instances now!
Unleash the power of GenAI for your company with Genesis Cloud and NVIDIA HGX H200 Instances.
Arrow