A40 GPUs now available
July 24, 2023
You can now run Replicate models on NVIDIA A40 GPUs. In terms of price and performance, the A40 sits between our T4 and A100 hardware. For many models, the A40 Large can be 80-90% as fast as A100s but almost half the price.
The A40 GPU is currently available in two configurations, each with the same GPU but attached to a machine with different amounts of CPU and RAM:
| Hardware | Price | GPU | CPU | GPU RAM | RAM |
|---|---|---|---|---|---|
| Nvidia A40 GPU | $0.0013 per second ($0.078 per minute) | 1x | 4x | 48GB | 16GB |
| Nvidia A40 (Large) GPU | $0.0016 per second ($0.096 per minute) | 1x | 10x | 48GB | 72GB |
To choose which GPU type is used to run your model, see the Hardware dropdown on your model's settings page:
To compare price and performance of all available GPUs, see our pricing page.