Explore Boost Run's L40S cloud instance specifications and benchmarks. Compare hardware configurations and performance metrics to optimize your AI and ML workloads.
LLM Benchmark Comparison
Compare performance metrics between different language models
Hardware Specifications
| GPU Configuration | Value |
|---|---|
| GPU Type | L40S |
| GPU Interconnect | PCIE |
| GPU Model Name | NVIDIA L40S |
| Driver Version | 550.127.05 |
| GPU VRAM | 384 GB |
| Power Limit (W) | 350.00 |
| GPU Temperature (°C) | 21 |
| GPU Clock Speed (MHz) | 210 |
| Memory Clock Speed (MHz) | 405 |
| Pstate | P8 |
| CPU Configuration | Value |
|---|---|
| Model Name | AMD EPYC 9354 32-Core Processor |
| Vendor ID | AuthenticAMD |
| CPUs | 128 |
| CPU Clock Speed | 6490.87 |
| Threads Per Core | 2 |
| Cores Per Socket | 32 |
| Sockets | 2 |
| Memory | Value |
|---|---|
| Total | 1.5Tb |
Disks Specifications
| Storage | Value |
|---|---|
| Total | 32153.60 GB |
Available Disks
| Property | Value |
|---|---|
| Disk 1 | |
| Model | nvme4n1 |
| Size | 1.7Tb |
| Type | SSD |
| Mount Point | Unmounted |
| Disk 2 | |
| Model | nvme1n1 |
| Size | 7Tb |
| Type | SSD |
| Mount Point | Unmounted |
| Disk 3 | |
| Model | nvme0n1 |
| Size | 7Tb |
| Type | SSD |
| Mount Point | Unmounted |
| Disk 4 | |
| Model | nvme3n1 |
| Size | 7Tb |
| Type | SSD |
| Mount Point | Unmounted |
| Disk 5 | |
| Model | nvme5n1 |
| Size | 1.7Tb |
| Type | SSD |
| Mount Point | Unmounted |
| Disk 6 | |
| Model | nvme2n1 |
| Size | 7Tb |
| Type | SSD |
| Mount Point | Unmounted |
Software Specifications
| Software | Value |
|---|---|
| OS | Ubuntu |
| OS Version | 22.04.5 LTS (Jammy Jellyfish) |
| Cuda Driver | 12.4 |
| Docker Version | 27.5.1 |
| Python Version | Python 3.10.12 |
Benchmarks
| Benchmark | Value |
|---|---|
| ffmpeg | 53ms |
| Coremark (Iterations per sec) | 27814.477 |
| llama2Inference (Tokens per sec) | 49.64 |
| Tensorflow Mnist Training | 2.424 |