Hardware Specifications
| GPU Configuration | Value |
|---|---|
| GPU Type | H100 |
| GPU Interconnect | SXM5 |
| GPU Model Name | NVIDIA H100 80GB HBM3 |
| Driver Version | 565.57.01 |
| GPU VRAM | 320 GB |
| Power Limit (W) | 700.00 |
| GPU Temperature (°C) | 26 |
| GPU Clock Speed (MHz) | 1980 |
| Memory Clock Speed (MHz) | 2619 |
| Pstate | P0 |
| CPU Configuration | Value |
|---|---|
| Model Name | Intel(R) Xeon(R) Platinum 8470 |
| Vendor ID | GenuineIntel |
| CPUs | 104 |
| CPU Clock Speed | 3999.86 |
| Threads Per Core | 2 |
| Cores Per Socket | 52 |
| Sockets | 1 |
| Memory | Value |
|---|---|
| Total | 456Gb |
Disks Specifications
| Storage | Value |
|---|---|
| Total | 2355.20 GB |
Available Disks
| Property | Value |
|---|---|
| Disk 1 | |
| Model | vda |
| Size | 2.3Tb |
| Type | HDD |
| Mount Point | Unmounted |
Software Specifications
| Software | Value |
|---|---|
| OS | Ubuntu |
| OS Version | 24.04.2 LTS (Noble Numbat) |
| Cuda Driver | 12.7 |
| Docker Version | 28.1.0 |
| Python Version | Python 3.12.3 |
Benchmarks
| Benchmark | Value |
|---|---|
| ffmpeg | 1325ms |
| Coremark (Iterations per sec) | 26072.220 |
| llama2Inference (Tokens per sec) | 70.12 |
| Tensorflow Mnist Training | 1.737 |