Explore Oblivus's A100_80G cloud instance specifications and benchmarks. Compare hardware configurations and performance metrics to optimize your AI and ML workloads.
LLM Benchmark Comparison
Hardware Specifications
GPU Configuration | Value |
---|---|
GPU Type | A100_80G |
GPU Interconnect | PCIE |
GPU Model Name | NVIDIA A100 80GB PCIe |
Driver Version | 535.104.12 |
GPU VRAM | 160 |
Power Limit (W) | 300.00 |
GPU Temperature (°C) | 42 |
GPU Clock Speed (MHz) | 210 |
Memory Clock Speed (MHz) | 1512 |
Pstate | P0 |
CPU Configuration | Value |
---|---|
Model Name | AMD EPYC 7763 64-Core Processor |
Vendor ID | AuthenticAMD |
CPUs | 60 |
CPU Clock Speed | 4890.81 |
Threads Per Core | 1 |
Cores Per Socket | 30 |
Sockets | 2 |
Memory | Value |
---|---|
Total | 236Gb |
Disks Specifications
Storage | Value |
---|---|
Total | 1636.00GB |
Available Disks
Property | Value |
---|---|
Disk 1 | |
Model | vda |
Size | 100Gb |
Type | HDD |
Mount Point | Unmounted |
Disk 2 | |
Model | vdb |
Size | 1.5Tb |
Type | HDD |
Mount Point | /mnt |
Software Specifications
Software | Value |
---|---|
OS | Ubuntu |
OS Version | 22.04.3 LTS (Jammy Jellyfish) |
Cuda Driver | 12.2 |
Docker Version | 24.0.6 |
Python Version | Python 3.10.12 |
Benchmarks
powered byBenchmark | Value |
---|---|
ffmpeg | 87 |
Coremark (Itterations per sec) | 32281.495 |
llama2Inference (Tokens per sec) | 49.63 |
Tensorflow Mnist Training | 2.336 |
Nvidia-smi output
Nvidia-smi topo -m outpu