lambdalabs logo

Lambda

H100

| 80GB VRAMs | gpu_1x_h100_pcie

Explore Lambda's H100 cloud instance specifications and benchmarks. Compare hardware configurations and performance metrics to optimize your AI and ML workloads.

LLM Benchmark Comparison

Hardware Specifications

GPU ConfigurationValue
GPU TypeH100
GPU InterconnectPCIE
GPU Model NameNVIDIA H100 PCIe
Driver Version550.127.05
GPU VRAM80
Power Limit (W)350.00
GPU Temperature (°C)35
GPU Clock Speed (MHz)345
Memory Clock Speed (MHz)1593
PstateP0
CPU ConfigurationValue
Model NameIntel(R) Xeon(R) Platinum 8480+
Vendor IDGenuineIntel
CPUs26
CPU Clock Speed4000.00
Threads Per Core1
Cores Per Socket1
Sockets26
MemoryValue
Total221Gb

Disks Specifications

StorageValue
Total1452.00GB

Available Disks

PropertyValue
Disk 1
Modelvda
Size1Tb
TypeHDD
Mount PointUnmounted
Disk 2
Modelvdb
Size428K
TypeHDD
Mount PointUnmounted

Software Specifications

SoftwareValue
OSUbuntu
OS Version22.04.5 LTS (Jammy Jellyfish)
Cuda Driver12.4
Docker Version27.4.0
Python VersionPython 3.10.12

Benchmarks

powered byLLM Benchmark Logo
BenchmarkValue
ffmpeg669
Coremark (Itterations per sec)34718.204
llama2Inference (Tokens per sec)72.13
Tensorflow Mnist Training12.062

Launch instance

CloudLambda
GPU TypeH100
Shadeform Instance TypeH100
Cloud Instance Typegpu 1x h100 pcie
Spin Up Time5-10 mins
Hourly Price$2.49

By clicking launch you agree to our Terms of Service.

Feedback

© Shadeform, Inc