Explore Lambda's A100_80G cloud instance specifications and benchmarks. Compare hardware configurations and performance metrics to optimize your AI and ML workloads.
LLM Benchmark Comparison
Hardware Specifications
| GPU Configuration | Value |
|---|---|
| GPU Type | A100_80G |
| GPU Interconnect | SXM4 |
| GPU Model Name | NVIDIA A100-SXM4-80GB |
| Driver Version | 535.129.03 |
| GPU VRAM | 640 |
| Power Limit (W) | 400.00 |
| GPU Temperature (°C) | 35 |
| GPU Clock Speed (MHz) | 210 |
| Memory Clock Speed (MHz) | 1593 |
| Pstate | P0 |
| CPU Configuration | Value |
|---|---|
| Model Name | AMD EPYC 7J13 64-Core Processor |
| Vendor ID | AuthenticAMD |
| CPUs | 240 |
| CPU Clock Speed | 4899.99 |
| Threads Per Core | 1 |
| Cores Per Socket | 1 |
| Sockets | 240 |
| Memory | Value |
|---|---|
| Total | 1.7Tb |
Disks Specifications
| Storage | Value |
|---|---|
| Total | 19968.00GB |
Available Disks
| Property | Value |
|---|---|
| Disk 1 | |
| Model | vda |
| Size | 19.5Tb |
| Type | HDD |
| Mount Point | Unmounted |
Software Specifications
| Software | Value |
|---|---|
| OS | Ubuntu |
| OS Version | 22.04.3 LTS (Jammy Jellyfish) |
| Cuda Driver | 12.2 |
| Docker Version | 24.0.7 |
| Python Version | Python 3.10.12 |
Benchmarks
powered by
| Benchmark | Value |
|---|---|
| ffmpeg | 168 |
| Coremark (Itterations per sec) | 29254.736 |
| llama2Inference (Tokens per sec) | 41.07 |
| Tensorflow Mnist Training | 2.459 |
Nvidia-smi output
Nvidia-smi topo -m outpu