hyperstack logo

Hyperstack

L40x8

| 384GB VRAMs | n3-L40x8

Explore Hyperstack's L40 cloud instance specifications and benchmarks. Compare hardware configurations and performance metrics to optimize your AI and ML workloads.

LLM Benchmark Comparison

Hardware Specifications

GPU ConfigurationValue
GPU TypeL40
GPU InterconnectPCIE
GPU Model NameNVIDIA L40
Driver Version535.183.06
GPU VRAM384
Power Limit (W)300.00
GPU Temperature (°C)44
GPU Clock Speed (MHz)210
Memory Clock Speed (MHz)405
PstateP8
CPU ConfigurationValue
Model NameAMD EPYC 7763 64-Core Processor
Vendor IDAuthenticAMD
CPUs252
CPU Clock Speed4890.81
Threads Per Core1
Cores Per Socket126
Sockets2
MemoryValue
Total456Gb

Disks Specifications

StorageValue
Total6551.20GB

Available Disks

PropertyValue
Disk 1
Modelvda
Size100Gb
TypeHDD
Mount PointUnmounted
Disk 2
Modelvdb
Size6.3Tb
TypeHDD
Mount Point/ephemeral

Software Specifications

SoftwareValue
OSUbuntu
OS Version22.04.5 LTS (Jammy Jellyfish)
Cuda Driver12.2
Docker Version27.3.1
Python VersionPython 3.10.12

Benchmarks

BenchmarkValue
ffmpeg54
Coremark (Itterations per sec)32242.463
llama2Inference (Tokens per sec)46.10
Tensorflow Mnist Training2.327

Nvidia-smi output

Nvidia-smi topo -m outpu

Launch instance

CloudHyperstack
GPU TypeL40
Shadeform Instance TypeL40x8
Cloud Instance Typen3-L40x8
Spin Up Time8-10 mins
Hourly Price$8.00

By clicking launch you agree to our Terms of Service.

Feedback

© Shadeform, Inc