API for creating models

Posted

Replicate’s API now has an endpoint for creating models.

You can use it to automate the creation of models, including fine-tunes of SDXL and Llama 2.

cURL usage

Here’s an example that uses cURL to create a model with a given owner, name, visibility, and hardware:

curl -s -X POST -H "Authorization: Token $REPLICATE_API_TOKEN" \
    -d '{"owner": "my-username", "name": "my-new-model", "visibility": "public", "hardware": "gpu-a40-large"}' \
    https://api.replicate.com/v1/models 

The response is a JSON object of the created model:

{
  "url": "https://replicate.com/my-username/my-new-model",
  "owner": "my-username",
  "name": "my-new-model",
  "description": null,
  "visibility": "public",
  "github_url": null,
  "paper_url": null,
  "license_url": null,
  "run_count": 0,
  "cover_image_url": null,
  "default_example": null,
  "latest_version": null
}

To see all the hardware available for your model to run, consult our endpoint for listing hardware.

curl -s -H "Authorization: Token $REPLICATE_API_TOKEN" \
    https://api.replicate.com/v1/hardware 
[
  { "name": "CPU", "sku": "cpu" },
  { "name": "Nvidia T4 GPU", "sku": "gpu-t4" },
  { "name": "Nvidia A40 GPU", "sku": "gpu-a40-small" },
  { "name": "Nvidia A40 (Large) GPU", "sku": "gpu-a40-large" }
]

To compare the price and specifications of these hardware types, check out the pricing page.

JavaScript usage

We’ve added this new operation to the Replicate JavaScript client:

npm install replicate@latest

Then:

import Replicate from "replicate";
const replicate = new Replicate();

// create a new model
const model = await replicate.models.create(
    "my-username", 
    "my-new-model", 
    {
        visibility: "public",
        hardware: "gpu-a40-large"
    }
);
console.log(model)

Python usage

We’ve added this new operation to the Replicate Python client:

pip install --upgrade replicate

Then:

import replicate

model = replicate.models.create(
    owner="my-username",
    name="my-new-model",
    visibility="public",
    hardware="gpu-a40-large",
)
print(model)

Elixir usage

We’ve added this new operation to the Replicate Elixir client:

mix deps.update replicate

Then:

iex> {:ok, model} =
            Replicate.Models.create(
                owner: "your-username",
                name: "my-model",
                visibility: "public",
                hardware: "gpu-a40-large"
            )

API docs

Check out the HTTP API reference for more detailed documentation about this new endpoint.