wcarle/text2video-zero-openjourney:2bf28cac | Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

wcarle /text2video-zero-openjourney:2bf28cac

Playground API

Input

prompt

string

Shift + Return to add a new line

Input prompt.

Default: "a cat"

negative_prompt

string

Shift + Return to add a new line

Negative prompt.

Default: ""

seed

string

Shift + Return to add a new line

Leave blank to randomize the seed.

chunk_size

integer

(minimum: 1, maximum: 10)

Chunk size: Number of frames processed at once. Reduce for lower memory usage.

Default: 8

motion_field_strength_x

integer

(minimum: -20, maximum: 20)

Global Translation $\delta_{x}$

Default: 12

motion_field_strength_y

integer

(minimum: -20, maximum: 20)

Global Translation $\delta_{y}$

Default: 12

integer

(minimum: 1, maximum: 50)

Timestep t0: Perform DDPM steps from t0 to t1. The larger the gap between t0 and t1, the more variance between the frames. Ensure t0 < t1

Default: 44

integer

(minimum: 1, maximum: 50)

Timestep t1: Perform DDPM steps from t0 to t1. The larger the gap between t0 and t1, the more variance between the frames. Ensure t0 < t1

Default: 47

merging_ratio

number

(minimum: 0, maximum: 0.9)

Ratio of how many tokens are merged. The higher the more compression (less memory and faster inference).

Default: 0

resolution

integer

Resolution of the video (square)

Default: 512

video_length

integer

Number of frames in the video

Default: 8

fps

integer

(minimum: 5, maximum: 60)

Frame rate for the video.

Default: 15

Run this model in Node.js with one line of code:

npx create-replicate --model=wcarle/text2video-zero-openjourney

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";
import fs from "node:fs";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run wcarle/text2video-zero-openjourney using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "wcarle/text2video-zero-openjourney:2bf28cacd1f02765bd557294ec53f743b42be123675773c810bb3e0f8e3ce6f6",
  {
    input: {
      t0: 44,
      t1: 47,
      fps: 15,
      prompt: "a cat",
      chunk_size: 8,
      resolution: 512,
      video_length: 8,
      merging_ratio: 0,
      negative_prompt: "",
      motion_field_strength_x: 12,
      motion_field_strength_y: 12
    }
  }
);

// To access the file URL:
console.log(output.url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run wcarle/text2video-zero-openjourney using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "wcarle/text2video-zero-openjourney:2bf28cacd1f02765bd557294ec53f743b42be123675773c810bb3e0f8e3ce6f6",
    input={
        "t0": 44,
        "t1": 47,
        "fps": 15,
        "prompt": "a cat",
        "chunk_size": 8,
        "resolution": 512,
        "video_length": 8,
        "merging_ratio": 0,
        "negative_prompt": "",
        "motion_field_strength_x": 12,
        "motion_field_strength_y": 12
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run wcarle/text2video-zero-openjourney using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "wcarle/text2video-zero-openjourney:2bf28cacd1f02765bd557294ec53f743b42be123675773c810bb3e0f8e3ce6f6",
    "input": {
      "t0": 44,
      "t1": 47,
      "fps": 15,
      "prompt": "a cat",
      "chunk_size": 8,
      "resolution": 512,
      "video_length": 8,
      "merging_ratio": 0,
      "negative_prompt": "",
      "motion_field_strength_x": 12,
      "motion_field_strength_y": 12
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

No output yet! Press "Submit" to start a prediction.