zust-ai/zust-diffusion:f2977520 | Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

zust-ai /zust-diffusion:f2977520

Playground API

Input

is_heartbeat

boolean

Check if Server Alive

Default: false

with_detail

boolean

Detailed Output

Default: false

pipe_type

string

Shift + Return to add a new line

SAM, photoshift, zust_fashion, zust_xl, upscale, enhance, cleanup

Default: "zust_xl"

photoshift_cleanup_background

boolean

PhotoShift (Clean source image subject)

Default: true

photoshift_scene

string

Shift + Return to add a new line

{"image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png"}{"image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png"}

Photoshift subject image

Default: "{\"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\"}"

photoshift_subject

string

Shift + Return to add a new line

[{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_raw2.png"}][{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_raw2.png"}]

Photoshift subject image?

Default: "[{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_raw2.png\"}]"

photoshift_noise

number

Add noise to masked area

Default: 0.65

photoshift_reference

number

IP-Adapter reference scale

Default: 0.35

photoshift_prompt_strength

number

BLIP Caption strength

Default: 1

tags

string

Shift + Return to add a new line

Product Tags (jewellery, topdown)

Default: ""

width

integer

Width

Default: 1024

height

integer

height

Default: 1024

prompt

string

Shift + Return to add a new line

a handbag on a sofa in a sunlit living room with a bookshelf, plush rug, and a framed painting on the walla handbag on a sofa in a sunlit living room with a bookshelf, plush rug, and a framed painting on the wall

Prompt

Default: "a handbag on a sofa in a sunlit living room with a bookshelf, plush rug, and a framed painting on the wall"

negative_prompt

string

Shift + Return to add a new line

Negative Prompt

Default: ""

subjects

string

Shift + Return to add a new line

[{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_product/handbag_square.png"}][{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_product/handbag_square.png"}]

Subject positions & URLs

Default: "[{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_product/handbag_square.png\"}]"

is_premium

boolean

Is this a pro user?

Default: false

fashion_subject

string

Shift + Return to add a new line

{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq.png"}{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq.png"}

Subject positions & URLs

Default: "{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq.png\"}"

fashion_mask

string

Shift + Return to add a new line

{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq_mask.png"}{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq_mask.png"}

Fashihon pose

Default: "{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq_mask.png\"}"

enhance_subject

string

Shift + Return to add a new line

[{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/enhance_sub.png"}][{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/enhance_sub.png"}]

Subject data (this shouldn't change)

Default: "[{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/enhance_sub.png\"}]"

enhance_scene

string

Shift + Return to add a new line

{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/scene_to_be_enhanced.png"}{"left": 0, "top": 0, "scale": 0.0009765625, "image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/scene_to_be_enhanced.png"}

Scene to be enhanced

Default: "{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/scene_to_be_enhanced.png\"}"

enhance_reference

number

IP-Adapter strength of scene. If 0 no Reference

Default: 0.25

enhance_noise

number

Noise to be added in the scene

Default: 0.5

enhance_prompt

string

Shift + Return to add a new line

Enhanced Prompt

Default: ""

enhance_negative_prompt

string

Shift + Return to add a new line

Negative Prompt

Default: ""

upscale_url

string

Shift + Return to add a new line

{"image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png"}{"image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png"}

Upscale the Image

Default: "{\"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\"}"

upscale_by

integer

Upscaling factor

Default: 2

sam_url

string

Shift + Return to add a new line

{"image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png"}{"image_url": "https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png"}

Get SAM Embeddings

Default: "{\"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\"}"

pikeya

string

Shift + Return to add a new line

Request Type

Default: ""

Run this model in Node.js with one line of code:

npx create-replicate --model=zust-ai/zust-diffusion

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";
import fs from "node:fs";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run zust-ai/zust-diffusion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "zust-ai/zust-diffusion:f297752062c6bcf5023523c7f62aa0231d8d30a503e44ed4112fda8db6b48ab5",
  {
    input: {
      tags: "",
      width: 1024,
      height: 1024,
      pikeya: "",
      prompt: "a handbag on a sofa in a sunlit living room with a bookshelf, plush rug, and a framed painting on the wall",
      sam_url: "{\"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\"}",
      subjects: "[{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_product/handbag_square.png\"}]",
      pipe_type: "zust_xl",
      is_premium: false,
      upscale_by: 2,
      upscale_url: "{\"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\"}",
      with_detail: false,
      fashion_mask: "{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq_mask.png\"}",
      is_heartbeat: false,
      enhance_noise: 0.5,
      enhance_scene: "{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/scene_to_be_enhanced.png\"}",
      enhance_prompt: "",
      enhance_subject: "[{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/enhance_sub.png\"}]",
      fashion_subject: "{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq.png\"}",
      negative_prompt: "",
      photoshift_noise: 0.65,
      photoshift_scene: "{\"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\"}",
      enhance_reference: 0.25,
      photoshift_subject: "[{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_raw2.png\"}]",
      photoshift_reference: 0.35,
      enhance_negative_prompt: "",
      photoshift_prompt_strength: 1,
      photoshift_cleanup_background: true
    }
  }
);

// To access the file URL:
console.log(output[0].url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output[0]);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run zust-ai/zust-diffusion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "zust-ai/zust-diffusion:f297752062c6bcf5023523c7f62aa0231d8d30a503e44ed4112fda8db6b48ab5",
    input={
        "tags": "",
        "width": 1024,
        "height": 1024,
        "pikeya": "",
        "prompt": "a handbag on a sofa in a sunlit living room with a bookshelf, plush rug, and a framed painting on the wall",
        "sam_url": "{\"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\"}",
        "subjects": "[{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_product/handbag_square.png\"}]",
        "pipe_type": "zust_xl",
        "is_premium": False,
        "upscale_by": 2,
        "upscale_url": "{\"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\"}",
        "with_detail": False,
        "fashion_mask": "{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq_mask.png\"}",
        "is_heartbeat": False,
        "enhance_noise": 0.5,
        "enhance_scene": "{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/scene_to_be_enhanced.png\"}",
        "enhance_prompt": "",
        "enhance_subject": "[{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/enhance_sub.png\"}]",
        "fashion_subject": "{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq.png\"}",
        "negative_prompt": "",
        "photoshift_noise": 0.65,
        "photoshift_scene": "{\"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\"}",
        "enhance_reference": 0.25,
        "photoshift_subject": "[{\"left\": 0, \"top\": 0, \"scale\": 0.0009765625, \"image_url\": \"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_raw2.png\"}]",
        "photoshift_reference": 0.35,
        "enhance_negative_prompt": "",
        "photoshift_prompt_strength": 1,
        "photoshift_cleanup_background": True
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run zust-ai/zust-diffusion using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "zust-ai/zust-diffusion:f297752062c6bcf5023523c7f62aa0231d8d30a503e44ed4112fda8db6b48ab5",
    "input": {
      "tags": "",
      "width": 1024,
      "height": 1024,
      "pikeya": "",
      "prompt": "a handbag on a sofa in a sunlit living room with a bookshelf, plush rug, and a framed painting on the wall",
      "sam_url": "{\\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\\"}",
      "subjects": "[{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_product/handbag_square.png\\"}]",
      "pipe_type": "zust_xl",
      "is_premium": false,
      "upscale_by": 2,
      "upscale_url": "{\\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\\"}",
      "with_detail": false,
      "fashion_mask": "{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq_mask.png\\"}",
      "is_heartbeat": false,
      "enhance_noise": 0.5,
      "enhance_scene": "{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/scene_to_be_enhanced.png\\"}",
      "enhance_prompt": "",
      "enhance_subject": "[{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/enhance_sub.png\\"}]",
      "fashion_subject": "{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq.png\\"}",
      "negative_prompt": "",
      "photoshift_noise": 0.65,
      "photoshift_scene": "{\\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\\"}",
      "enhance_reference": 0.25,
      "photoshift_subject": "[{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_raw2.png\\"}]",
      "photoshift_reference": 0.35,
      "enhance_negative_prompt": "",
      "photoshift_prompt_strength": 1,
      "photoshift_cleanup_background": true
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

You can run this model locally using Cog. First, install Cog:

brew install cog

If you don’t have Homebrew, there are other installation options available.

Run this to download the model and run it in your local environment:

cog predict r8.im/zust-ai/zust-diffusion@sha256:f297752062c6bcf5023523c7f62aa0231d8d30a503e44ed4112fda8db6b48ab5 \
  -i 'tags=""' \
  -i 'width=1024' \
  -i 'height=1024' \
  -i 'pikeya=""' \
  -i 'prompt="a handbag on a sofa in a sunlit living room with a bookshelf, plush rug, and a framed painting on the wall"' \
  -i $'sam_url="{\\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\\"}"' \
  -i $'subjects="[{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_product/handbag_square.png\\"}]"' \
  -i 'pipe_type="zust_xl"' \
  -i 'is_premium=false' \
  -i 'upscale_by=2' \
  -i $'upscale_url="{\\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\\"}"' \
  -i 'with_detail=false' \
  -i $'fashion_mask="{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq_mask.png\\"}"' \
  -i 'is_heartbeat=false' \
  -i 'enhance_noise=0.5' \
  -i $'enhance_scene="{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/scene_to_be_enhanced.png\\"}"' \
  -i 'enhance_prompt=""' \
  -i $'enhance_subject="[{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/enhance_sub.png\\"}]"' \
  -i $'fashion_subject="{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq.png\\"}"' \
  -i 'negative_prompt=""' \
  -i 'photoshift_noise=0.65' \
  -i $'photoshift_scene="{\\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\\"}"' \
  -i 'enhance_reference=0.25' \
  -i $'photoshift_subject="[{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_raw2.png\\"}]"' \
  -i 'photoshift_reference=0.35' \
  -i 'enhance_negative_prompt=""' \
  -i 'photoshift_prompt_strength=1' \
  -i 'photoshift_cleanup_background=true'

To learn more, take a look at the Cog documentation.

Run this to download the model and run it in your local environment:

docker run -d -p 5000:5000 --gpus=all r8.im/zust-ai/zust-diffusion@sha256:f297752062c6bcf5023523c7f62aa0231d8d30a503e44ed4112fda8db6b48ab5
curl -s -X POST \
  -H "Content-Type: application/json" \
  -d $'{
    "input": {
      "tags": "",
      "width": 1024,
      "height": 1024,
      "pikeya": "",
      "prompt": "a handbag on a sofa in a sunlit living room with a bookshelf, plush rug, and a framed painting on the wall",
      "sam_url": "{\\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\\"}",
      "subjects": "[{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_product/handbag_square.png\\"}]",
      "pipe_type": "zust_xl",
      "is_premium": false,
      "upscale_by": 2,
      "upscale_url": "{\\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\\"}",
      "with_detail": false,
      "fashion_mask": "{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq_mask.png\\"}",
      "is_heartbeat": false,
      "enhance_noise": 0.5,
      "enhance_scene": "{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/scene_to_be_enhanced.png\\"}",
      "enhance_prompt": "",
      "enhance_subject": "[{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/enhance/enhance_sub.png\\"}]",
      "fashion_subject": "{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/zust_fashion/fashion_sq.png\\"}",
      "negative_prompt": "",
      "photoshift_noise": 0.65,
      "photoshift_scene": "{\\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_scene2.png\\"}",
      "enhance_reference": 0.25,
      "photoshift_subject": "[{\\"left\\": 0, \\"top\\": 0, \\"scale\\": 0.0009765625, \\"image_url\\": \\"https://raw.githubusercontent.com/zust-ai/product-ai-training/main/test/ps/perfume_raw2.png\\"}]",
      "photoshift_reference": 0.35,
      "enhance_negative_prompt": "",
      "photoshift_prompt_strength": 1,
      "photoshift_cleanup_background": true
    }
  }' \
  http://localhost:5000/predictions

To learn more, take a look at the Cog documentation.

Output

No output yet! Press "Submit" to start a prediction.