datacte/proteus-v0.1 | Run with an API on Replicate

ProteusV0.1 uses OpenDalleV1.1 as a base and further refines prompt adherence and stylistic capabilities to a measurable degree

Cold

Public

6.7K runs

L40S

License

GitHub

Playground API Examples README Versions

Input

prompt

string

Shift + Return to add a new line

high quality pixel art, a pixel art silhouette of an anime space-themed girl in a space-punk steampunk style, lying in her bed by the window of a spaceship, smoking, with a rustic feel. The image should embody epic portraiture and double exposure, featuring an isolated landscape visible through the window. The colors should primarily be dynamic and action-packed, with a strong use of negative space. The entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. Silhouettehigh quality pixel art, a pixel art silhouette of an anime space-themed girl in a space-punk steampunk style, lying in her bed by the window of a spaceship, smoking, with a rustic feel. The image should embody epic portraiture and double exposure, featuring an isolated landscape visible through the window. The colors should primarily be dynamic and action-packed, with a strong use of negative space. The entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. Silhouette

Input prompt

Default: "black fluffy gorgeous dangerous cat animal creature, large orange eyes, big fluffy ears, piercing gaze, full moon, dark ambiance, best quality, extremely detailed"

negative_prompt

string

Shift + Return to add a new line

Negative Input prompt

Default: "worst quality, low quality"

image

file

Input image for img2img or inpaint mode

mask

file

Input mask for inpaint mode. Black areas will be preserved, white areas will be inpainted.

width

integer

Width of output image

Default: 1024

height

integer

Height of output image

Default: 1024

num_outputs

integer

(minimum: 1, maximum: 4)

Number of images to output.

Default: 1

scheduler

string

scheduler

Default: "KarrasDPM"

num_inference_steps

integer

(minimum: 1, maximum: 100)

Number of denoising steps. 20 to 35 steps for more detail, 20 steps for faster results.

Default: 20

guidance_scale

number

(minimum: 1, maximum: 50)

Scale for classifier-free guidance. Recommended 7-8

Default: 7.5

prompt_strength

number

(minimum: 0, maximum: 1)

Prompt strength when using img2img / inpaint. 1.0 corresponds to full destruction of information in image

Default: 0.8

seed

integer

Random seed. Leave blank to randomize the seed

apply_watermark

boolean

Applies a watermark to enable determining if an image is generated in downstream applications. If you have other provisions for generating or deploying images safely, you can use this to disable watermarking.

Default: true

disable_safety_checker

boolean

Disable safety checker for generated images. This feature is only available through the API. See https://replicate.com/docs/how-does-replicate-work#safety

Default: false

Run this model in Node.js with one line of code:

npx create-replicate --model=datacte/proteus-v0.1

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";
import fs from "node:fs";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run datacte/proteus-v0.1 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "datacte/proteus-v0.1:4cdc699d5bfc17e774e9ad11696075d68dc38dec1dbcbfba85c2bb040d3c5cfe",
  {
    input: {
      width: 1024,
      height: 1024,
      prompt: "high quality pixel art, a pixel art silhouette of an anime space-themed girl in a space-punk steampunk style, lying in her bed by the window of a spaceship, smoking, with a rustic feel. The image should embody epic portraiture and double exposure, featuring an isolated landscape visible through the window. The colors should primarily be dynamic and action-packed, with a strong use of negative space. The entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. Silhouette",
      scheduler: "KarrasDPM",
      num_outputs: 1,
      guidance_scale: 7.5,
      apply_watermark: true,
      negative_prompt: "worst quality, low quality",
      prompt_strength: 0.8,
      num_inference_steps: 20
    }
  }
);

// To access the file URL:
console.log(output[0].url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output[0]);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run datacte/proteus-v0.1 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "datacte/proteus-v0.1:4cdc699d5bfc17e774e9ad11696075d68dc38dec1dbcbfba85c2bb040d3c5cfe",
    input={
        "width": 1024,
        "height": 1024,
        "prompt": "high quality pixel art, a pixel art silhouette of an anime space-themed girl in a space-punk steampunk style, lying in her bed by the window of a spaceship, smoking, with a rustic feel. The image should embody epic portraiture and double exposure, featuring an isolated landscape visible through the window. The colors should primarily be dynamic and action-packed, with a strong use of negative space. The entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. Silhouette",
        "scheduler": "KarrasDPM",
        "num_outputs": 1,
        "guidance_scale": 7.5,
        "apply_watermark": True,
        "negative_prompt": "worst quality, low quality",
        "prompt_strength": 0.8,
        "num_inference_steps": 20
    }
)

# To access the file URL:
print(output[0].url())
#=> "http://example.com"

# To write the file to disk:
with open("my-image.png", "wb") as file:
    file.write(output[0].read())

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run datacte/proteus-v0.1 using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "datacte/proteus-v0.1:4cdc699d5bfc17e774e9ad11696075d68dc38dec1dbcbfba85c2bb040d3c5cfe",
    "input": {
      "width": 1024,
      "height": 1024,
      "prompt": "high quality pixel art, a pixel art silhouette of an anime space-themed girl in a space-punk steampunk style, lying in her bed by the window of a spaceship, smoking, with a rustic feel. The image should embody epic portraiture and double exposure, featuring an isolated landscape visible through the window. The colors should primarily be dynamic and action-packed, with a strong use of negative space. The entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. Silhouette",
      "scheduler": "KarrasDPM",
      "num_outputs": 1,
      "guidance_scale": 7.5,
      "apply_watermark": true,
      "negative_prompt": "worst quality, low quality",
      "prompt_strength": 0.8,
      "num_inference_steps": 20
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

{
  "completed_at": "2024-01-16T21:49:15.474250Z",
  "created_at": "2024-01-16T21:49:09.531205Z",
  "data_removed": false,
  "error": null,
  "id": "666jautb5b724hmlv6z7ab3ugq",
  "input": {
    "width": 1024,
    "height": 1024,
    "prompt": "high quality pixel art, a pixel art silhouette of an anime space-themed girl in a space-punk steampunk style, lying in her bed by the window of a spaceship, smoking, with a rustic feel. The image should embody epic portraiture and double exposure, featuring an isolated landscape visible through the window. The colors should primarily be dynamic and action-packed, with a strong use of negative space. The entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. Silhouette",
    "scheduler": "KarrasDPM",
    "num_outputs": 1,
    "guidance_scale": 7.5,
    "apply_watermark": true,
    "negative_prompt": "worst quality, low quality",
    "prompt_strength": 0.8,
    "num_inference_steps": 20
  },
  "logs": "Using seed: 4262439189\nPrompt: high quality pixel art, a pixel art silhouette of an anime space-themed girl in a space-punk steampunk style, lying in her bed by the window of a spaceship, smoking, with a rustic feel. The image should embody epic portraiture and double exposure, featuring an isolated landscape visible through the window. The colors should primarily be dynamic and action-packed, with a strong use of negative space. The entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. Silhouette\ntxt2img mode\nThe following part of your input was truncated because CLIP can only handle sequences up to 77 tokens: ['a strong use of negative space. the entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. silhouette']\nThe following part of your input was truncated because CLIP can only handle sequences up to 77 tokens: ['a strong use of negative space. the entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. silhouette']\n  0%|          | 0/20 [00:00<?, ?it/s]\n  5%|▌         | 1/20 [00:00<00:03,  5.04it/s]\n 15%|█▌        | 3/20 [00:00<00:02,  6.25it/s]\n 20%|██        | 4/20 [00:00<00:02,  5.76it/s]\n 25%|██▌       | 5/20 [00:00<00:02,  5.47it/s]\n 30%|███       | 6/20 [00:01<00:02,  5.26it/s]\n 35%|███▌      | 7/20 [00:01<00:02,  5.18it/s]\n 40%|████      | 8/20 [00:01<00:02,  5.12it/s]\n 45%|████▌     | 9/20 [00:01<00:02,  5.08it/s]\n 50%|█████     | 10/20 [00:01<00:01,  5.05it/s]\n 55%|█████▌    | 11/20 [00:02<00:01,  5.02it/s]\n 60%|██████    | 12/20 [00:02<00:01,  5.01it/s]\n 65%|██████▌   | 13/20 [00:02<00:01,  5.01it/s]\n 70%|███████   | 14/20 [00:02<00:01,  5.00it/s]\n 75%|███████▌  | 15/20 [00:02<00:01,  4.99it/s]\n 80%|████████  | 16/20 [00:03<00:00,  4.98it/s]\n 85%|████████▌ | 17/20 [00:03<00:00,  4.98it/s]\n 90%|█████████ | 18/20 [00:03<00:00,  4.98it/s]\n 95%|█████████▌| 19/20 [00:03<00:00,  4.98it/s]\n100%|██████████| 20/20 [00:03<00:00,  4.98it/s]\n100%|██████████| 20/20 [00:03<00:00,  5.12it/s]",
  "metrics": {
    "predict_time": 5.906359,
    "total_time": 5.943045
  },
  "output": [
    "https://replicate.delivery/pbxt/uOo0acFwvGJeYiQs2cKNfMTgUPBBC1CfSTfeSsaMJihR7VpRC/out-0.png"
  ],
  "started_at": "2024-01-16T21:49:09.567891Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/666jautb5b724hmlv6z7ab3ugq",
    "cancel": "https://api.replicate.com/v1/predictions/666jautb5b724hmlv6z7ab3ugq/cancel"
  },
  "version": "4cdc699d5bfc17e774e9ad11696075d68dc38dec1dbcbfba85c2bb040d3c5cfe"
}

Generated in

5.9 seconds

Tweak it Iterate in playgroundReport View full prediction

Using seed: 4262439189
Prompt: high quality pixel art, a pixel art silhouette of an anime space-themed girl in a space-punk steampunk style, lying in her bed by the window of a spaceship, smoking, with a rustic feel. The image should embody epic portraiture and double exposure, featuring an isolated landscape visible through the window. The colors should primarily be dynamic and action-packed, with a strong use of negative space. The entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. Silhouette
txt2img mode
The following part of your input was truncated because CLIP can only handle sequences up to 77 tokens: ['a strong use of negative space. the entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. silhouette']
The following part of your input was truncated because CLIP can only handle sequences up to 77 tokens: ['a strong use of negative space. the entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. silhouette']
  0%|          | 0/20 [00:00<?, ?it/s]
  5%|▌         | 1/20 [00:00<00:03,  5.04it/s]
 15%|█▌        | 3/20 [00:00<00:02,  6.25it/s]
 20%|██        | 4/20 [00:00<00:02,  5.76it/s]
 25%|██▌       | 5/20 [00:00<00:02,  5.47it/s]
 30%|███       | 6/20 [00:01<00:02,  5.26it/s]
 35%|███▌      | 7/20 [00:01<00:02,  5.18it/s]
 40%|████      | 8/20 [00:01<00:02,  5.12it/s]
 45%|████▌     | 9/20 [00:01<00:02,  5.08it/s]
 50%|█████     | 10/20 [00:01<00:01,  5.05it/s]
 55%|█████▌    | 11/20 [00:02<00:01,  5.02it/s]
 60%|██████    | 12/20 [00:02<00:01,  5.01it/s]
 65%|██████▌   | 13/20 [00:02<00:01,  5.01it/s]
 70%|███████   | 14/20 [00:02<00:01,  5.00it/s]
 75%|███████▌  | 15/20 [00:02<00:01,  4.99it/s]
 80%|████████  | 16/20 [00:03<00:00,  4.98it/s]
 85%|████████▌ | 17/20 [00:03<00:00,  4.98it/s]
 90%|█████████ | 18/20 [00:03<00:00,  4.98it/s]
 95%|█████████▌| 19/20 [00:03<00:00,  4.98it/s]
100%|██████████| 20/20 [00:03<00:00,  4.98it/s]
100%|██████████| 20/20 [00:03<00:00,  5.12it/s]

Examples

View more examples

Run time and cost

This model costs approximately $0.021 to run on Replicate, or 47 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia L40S GPU hardware. Predictions typically complete within 22 seconds. The predict time for this model varies significantly based on the inputs.

Readme

Cog implementation of dataautogpt3/Proteus-v0.1

ProteusV0.1

ProteusV0.1 is currently my best model to date.

ProteusV0.1 uses OpenDalleV1.1 as a substantial base to work from in terms of an untuned base model. It further refines said prompt adherence and stylistic capabilities to a measurable degree. tuned on 10k unique examples of high-quality captioned images generated from dalle3 and then further refined using 220k GPTV captioned non-copyright stock images with some anime through in here and there.

ProteusV0.1 has a noticeable improvement in facial features and skin detailing. while still keeping similar or slightly improved levels of surrealism, anime, and cartoonish styles.

Settings for ProteusV0.1

Use these settings for the best results with ProteusV0.1:

CFG Scale: Use a CFG scale of 8 to 7

Steps: 20 to 35 steps for more detail, 20 steps for faster results.

Sampler: DPM 2M++

Scheduler: Karras

please also consider using these keep words to improve your prompts: best quality, HD, aesthetic,