RTX A4000
Entry inference, 7-13B models
16 GB VRAM8 vCPU64 GB RAM1 TB NVMe  |
16 GB |
8 vCPU |
64 GB |
1 TB NVMe |
   |
$61.99/mo
Cheapest competitor $89.00
|
Deploy RTX A4000 |
RTX 4090Popular
Best price per token
24 GB VRAM8 vCPU64 GB RAM1 TB NVMe   |
24 GB |
8 vCPU |
64 GB |
1 TB NVMe |
    |
$84.99/mo
Cheapest competitor $121.50
|
Deploy RTX 4090 |
RTX 5090
Fast inference, image and video
32 GB VRAM12 vCPU96 GB RAM2 TB NVMe  |
32 GB |
12 vCPU |
96 GB |
2 TB NVMe |
   |
$134.99/mo
Cheapest competitor $193.00
|
Deploy RTX 5090 |
RTX 6000 Ada
48 GB, 32B at 8-bit
48 GB VRAMEPYC 7302P 16c128 GB RAM2 × 1.92 TB NVMe |
48 GB |
EPYC 7302P · 16c |
128 GB |
2 × 1.92 TB NVMe |
  |
$306.99/mo
Cheapest competitor $439.00
|
Deploy RTX 6000 Ada |
A100 80 GB
Training and fine-tuning
80 GB VRAM16 vCPU128 GB RAM3.84 TB NVMe  |
80 GB |
16 vCPU |
128 GB |
3.84 TB NVMe |
   |
$355.99/mo
Cheapest competitor $509.00
|
Deploy A100 80 GB |
L40S
Inference at scale
48 GB VRAMEPYC 7443P 24c256 GB RAM2 × 1.92 TB NVMe |
48 GB |
EPYC 7443P · 24c |
256 GB |
2 × 1.92 TB NVMe |
  |
$418.99/mo
Cheapest competitor $599.00
|
Deploy L40S |
2 × RTX 5090
64 GB of VRAM in one box
64 GB VRAMEPYC 9354 32c256 GB RAM2 × 1.92 TB NVMe |
64 GB |
EPYC 9354 · 32c |
256 GB |
2 × 1.92 TB NVMe |
  |
$558.99/mo
Cheapest competitor $799.00
|
Deploy 2 × RTX 5090 |
H100 80 GB
Frontier training, SXM5
80 GB VRAM24 vCPU192 GB RAM2 TB NVMe  |
80 GB |
24 vCPU |
192 GB |
2 TB NVMe |
   |
$581.99/mo
Cheapest competitor $832.50
|
Deploy H100 80 GB |
2 × H100
160 GB HBM3, NVLink
160 GB VRAM48 vCPU384 GB RAM4 TB NVMe |
160 GB |
48 vCPU |
384 GB |
4 TB NVMe |
  |
$1,096.99/mo
Cheapest competitor $1,567.50
|
Deploy 2 × H100 |
4 × H100Cluster
320 GB HBM3, NVLink
320 GB VRAM96 vCPU768 GB RAM30 TB NVMe |
320 GB |
96 vCPU |
768 GB |
30 TB NVMe |
  |
$2,348.99/mo
Cheapest competitor $3,356.00
|
Deploy 4 × H100 |