lambdalabs logo

Lambda

H100

| 80GB VRAMs | gpu_1x_h100_pcie

Explore Lambda's H100 cloud instance specifications and benchmarks. Compare hardware configurations and performance metrics to optimize your AI and ML workloads.

LLM Benchmark Comparison

Hardware Specifications

GPU ConfigurationValue
GPU TypeH100
GPU InterconnectPCIE
GPU Model NameNVIDIA H100 PCIe
Driver Version535.129.03
GPU VRAM80
Power Limit (W)350.00
GPU Temperature (°C)30
GPU Clock Speed (MHz)345
Memory Clock Speed (MHz)1593
PstateP0
CPU ConfigurationValue
Model NameIntel(R) Xeon(R) Platinum 8480+
Vendor IDGenuineIntel
CPUs26
CPU Clock Speed4000.00
Threads Per Core1
Cores Per Socket1
Sockets26
MemoryValue
Total221Gb

Disks Specifications

StorageValue
Total1024.00GB

Available Disks

PropertyValue
Disk 1
Modelvda
Size1Tb
TypeHDD
Mount PointUnmounted

Software Specifications

SoftwareValue
OSUbuntu
OS Version22.04.3 LTS (Jammy Jellyfish)
Cuda Driver12.2
Docker Version24.0.7
Python VersionPython 3.10.12

Benchmarks

BenchmarkValue
ffmpeg232
Coremark (Itterations per sec)35030.360
llama2Inference (Tokens per sec)73.96
Tensorflow Mnist Training4.281

Nvidia-smi output

Nvidia-smi topo -m outpu

Launch instance

CloudLambda
GPU TypeH100
Shadeform Instance TypeH100
Cloud Instance Typegpu 1x h100 pcie
Spin Up Time5-10 mins
Hourly Price$2.49

By clicking launch you agree to our Terms of Service.

Feedback

© Shadeform, Inc