Hardware Specifications
| GPU Configuration | Value |
|---|---|
| GPU Type | L40S |
| GPU Interconnect | PCIE |
| GPU Model Name | NVIDIA L40S |
| Driver Version | 550.107.02 |
| GPU VRAM | 96 GB |
| Power Limit (W) | 350.00 |
| GPU Temperature (°C) | 26 |
| GPU Clock Speed (MHz) | 210 |
| Memory Clock Speed (MHz) | 405 |
| Pstate | P8 |
| CPU Configuration | Value |
|---|---|
| Model Name | AMD EPYC 7413 24-Core Processor |
| Vendor ID | AuthenticAMD |
| CPUs | 16 |
| CPU Clock Speed | 5299.99 |
| Threads Per Core | 1 |
| Cores Per Socket | 16 |
| Sockets | 1 |
| Memory | Value |
|---|---|
| Total | 188Gb |
Disks Specifications
| Storage | Value |
|---|---|
| Total | 3435.30 GB |
Available Disks
| Property | Value |
|---|---|
| Disk 1 | |
| Model | sda |
| Size | 465.7Gb |
| Type | HDD |
| Mount Point | Unmounted |
| Disk 2 | |
| Model | sdb |
| Size | 2.9Tb |
| Type | HDD |
| Mount Point | /scratch |
Software Specifications
| Software | Value |
|---|---|
| OS | Ubuntu |
| OS Version | 22.04.5 LTS (Jammy Jellyfish) |
| Cuda Driver | 12.4 |
| Docker Version | 27.3.1 |
| Python Version | Python 3.10.12 |
Benchmarks
| Benchmark | Value |
|---|---|
| ffmpeg | 81ms |
| Coremark (Iterations per sec) | 33497.097 |
| llama2Inference (Tokens per sec) | 46.87 |
| Tensorflow Mnist Training | 2.894 |