Model hardware
Table of contents
Whether your model is public or private, or running as a deployment, you can change the hardware it runs on.
To compare hardware pricing and performance, see the pricing page.
Edit model hardware on the web
To change the hardware for a public or private model on the web, do the following:
- Go to your model page
- Click the Settings tab
- Scroll down to the Hardware section and chooose your desired hardware
- Click the Save button
Edit model hardware using the API
There is not currently an API to change the hardware for public or private models.
If this feature is important to you, please let us know by contacting support@replicate.com.
Edit deployment hardware on the web
If you’re running a deployment, you can change its hardware configuration using the web or the API.
To change the hardware for a deployment on the web, do the following:
- Go to replicate.com/deployments
- Click the deployment you want to edit
- Click the Settings tab
- Choose your desired hardware
- Click the Save button
Edit deployment hardware using the API
To change the hardware for a deployment using the API, use the Update a deployment endpoint:
curl -s \
-X PATCH \
-H "Authorization: Bearer $REPLICATE_API_TOKEN" \
-H "Content-Type: application/json" \
-d '{"min_instances": 3, "max_instances": 10, "hardware": "gpu-t4"}' \
https://api.replicate.com/v1/deployments/acme/my-app-image-generator
Hardware for fine-tunes
Fine-tuned models based on SDXL or Flux with fast booting use the hardware set by the base model they were trained from.
If you would like to change the hardware for a fine-tuned version with fast booting, you can make a deployment.