Model hardware

Whether your model is public or private, or running as a deployment, you can change the hardware it runs on.

To compare hardware pricing and performance, see the pricing page.

Edit model hardware on the web

To change the hardware for a public or private model on the web, do the following:

1. Go to your model page
2. Click the Settings tab
3. Scroll down to the Hardware section and chooose your desired hardware
4. Click the Save button

Edit model hardware using the API

There is not currently an API to change the hardware for public or private models.

If this feature is important to you, please let us know by contacting support@replicate.com.

Edit deployment hardware on the web

If you're running a deployment, you can change its hardware configuration using the web or the API.

To change the hardware for a deployment on the web, do the following:

1. Go to replicate.com/deployments
2. Click the deployment you want to edit
3. Click the Settings tab
4. Choose your desired hardware
5. Click the Save button

Edit deployment hardware using the API

To change the hardware for a deployment using the API, use the Update a deployment endpoint:

curl -s \
  -X PATCH \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"min_instances": 3, "max_instances": 10, "hardware": "gpu-t4"}' \
  https://api.replicate.com/v1/deployments/acme/my-app-image-generator

Hardware for fine-tunes

Fine-tuned models based on SDXL or Flux with fast booting use the hardware set by the base model they were trained from.

If you would like to change the hardware for a version with fast booting, you can make a deployment.