Build a website with Next.jsBuild a Discord bot with PythonBuild an app with SwiftUIPush your own modelPush a Diffusers modelPush a Transformers modelPush a model using GitHub ActionsDeploy a custom modelFine-tune a language modelGet a GPU machine
Home / Topics / Models

Model hardware


Whether your model is public or private, or running as a deployment, you can change the hardware it runs on.

To compare hardware pricing and performance, see the pricing page.

Edit model hardware on the web

To change the hardware for a public or private model on the web, do the following:

  1. Go to your model page
  2. Click the Settings tab
  3. Scroll down to the Hardware section and chooose your desired hardware
  4. Click the Save button

Edit model hardware using the API

There is not currently an API to change the hardware for public or private models.

If this feature is important to you, please let us know by contacting support@replicate.com.

Edit deployment hardware on the web

If you're running a deployment, you can change its hardware configuration using the web or the API.

To change the hardware for a deployment on the web, do the following:

  1. Go to replicate.com/deployments
  2. Click the deployment you want to edit
  3. Click the Settings tab
  4. Choose your desired hardware
  5. Click the Save button

Edit deployment hardware using the API

To change the hardware for a deployment using the API, use the Update a deployment endpoint:

curl -s \
  -X PATCH \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"min_instances": 3, "max_instances": 10, "hardware": "gpu-t4"}' \
  https://api.replicate.com/v1/deployments/acme/my-app-image-generator
Tip
If your model is public, keep in mind that other people may be using it, and changing the hardware it runs on may affect the performance and price of the model for them. If your public model is very popular, consider leaving it running on the existing hardware and creating a deployment for your own private use.

Hardware for fine-tunes

Fine-tuned models based on SDXL or Flux with fast booting use the hardware set by the base model they were trained from.

If you would like to change the hardware for a version with fast booting, you can make a deployment.