voodoohop/flux-dance:857fcca1 – Run with an API on Replicate

Version

You're looking at a specific version of this model. Jump to the model overview.

voodoohop /flux-dance:857fcca1

Input

style_suffix

string

Shift + Return to add a new line

angular, academic art, cubism, an abstract drawing by Svetoslav Roerich, abstract illusionism, concept art, angular, broken-stained-glass, concrete poetry, anton semono. black and white, granular, abstract, hand drawings, grainy, dmysticism, sacred symbology, blueprintangular, academic art, cubism, an abstract drawing by Svetoslav Roerich, abstract illusionism, concept art, angular, broken-stained-glass, concrete poetry, anton semono. black and white, granular, abstract, hand drawings, grainy, dmysticism, sacred symbology, blueprint

Style suffix to append to each prompt

Default: "angular, academic art, cubism, an abstract drawing by Svetoslav Roerich, abstract illusionism, concept art, angular, broken-stained-glass, concrete poetry, anton semono. black and white, granular, abstract, hand drawings, grainy, dmysticism, sacred symbology, blueprint"

narrative

string

Shift + Return to add a new line

Silhouettes of valleys 
Silhouettes of hillsSilhouettes of valleys 
Silhouettes of hills

Narrative prompts, one per line. Each line defines a prompt for a certain time in the sequence.

Default: "Silhouettes of valleys \nSilhouettes of hills"

audio_file

file

Audio file to drive interpolation (optional)

width

integer

Width of the generated image

Default: 512

height

integer

Height of the generated image

Default: 512

seed

integer

Random seed

Default: 42

interpolation_steps

integer

Number of interpolation steps between seeds (ignored if audio_file is provided)

Default: 4

variation_strength

number

Controls how much the audio amplitude affects the image variation (0-1)

Default: 0.3

audio_smoothing

number

Smoothing factor for audio (0-1, higher = more smoothing)

Default: 0.8

audio_loudness_type

string

Type of audio loudness measurement to use

Default: "peak"

fps

integer

Frames per second for the video

Default: 10

output_format

string

Format of the output image

Default: "png"

interpolate_prompts

boolean

Interpolate between prompts instead of switching between them

Default: true

model_name

string

Which model to use for generation

Default: "flux"

guidance_scale

number

(minimum: 1, maximum: 20)

Guidance scale for Stable Diffusion model (higher = more adherence to prompt, ignored for FLUX)

Default: 7.5

Run this model in Node.js with one line of code:

npx create-replicate --model=voodoohop/flux-dance

or set up a project from scratch

Install Replicate’s Node.js client library:

npm install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run voodoohop/flux-dance using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "voodoohop/flux-dance:857fcca1bf0704ac58e0bc628dd433d200f531487d8e5bcf3f11de73591147e9",
  {
    input: {
      fps: 10,
      seed: 42,
      width: 512,
      height: 512,
      narrative: "Silhouettes of valleys \nSilhouettes of hills",
      model_name: "flux",
      style_suffix: "angular, academic art, cubism, an abstract drawing by Svetoslav Roerich, abstract illusionism, concept art, angular, broken-stained-glass, concrete poetry, anton semono. black and white, granular, abstract, hand drawings, grainy, dmysticism, sacred symbology, blueprint",
      output_format: "png",
      guidance_scale: 7.5,
      audio_smoothing: 0.8,
      variation_strength: 0.3,
      audio_loudness_type: "peak",
      interpolate_prompts: true,
      interpolation_steps: 4
    }
  }
);
console.log(output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Import the client:

import replicate

Run voodoohop/flux-dance using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "voodoohop/flux-dance:857fcca1bf0704ac58e0bc628dd433d200f531487d8e5bcf3f11de73591147e9",
    input={
        "fps": 10,
        "seed": 42,
        "width": 512,
        "height": 512,
        "narrative": "Silhouettes of valleys \nSilhouettes of hills",
        "model_name": "flux",
        "style_suffix": "angular, academic art, cubism, an abstract drawing by Svetoslav Roerich, abstract illusionism, concept art, angular, broken-stained-glass, concrete poetry, anton semono. black and white, granular, abstract, hand drawings, grainy, dmysticism, sacred symbology, blueprint",
        "output_format": "png",
        "guidance_scale": 7.5,
        "audio_smoothing": 0.8,
        "variation_strength": 0.3,
        "audio_loudness_type": "peak",
        "interpolate_prompts": True,
        "interpolation_steps": 4
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Set the REPLICATE_API_TOKEN environment variable:

export REPLICATE_API_TOKEN=<paste-your-token-here>

Find your API token in your account settings.

Run voodoohop/flux-dance using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "857fcca1bf0704ac58e0bc628dd433d200f531487d8e5bcf3f11de73591147e9",
    "input": {
      "fps": 10,
      "seed": 42,
      "width": 512,
      "height": 512,
      "narrative": "Silhouettes of valleys \\nSilhouettes of hills",
      "model_name": "flux",
      "style_suffix": "angular, academic art, cubism, an abstract drawing by Svetoslav Roerich, abstract illusionism, concept art, angular, broken-stained-glass, concrete poetry, anton semono. black and white, granular, abstract, hand drawings, grainy, dmysticism, sacred symbology, blueprint",
      "output_format": "png",
      "guidance_scale": 7.5,
      "audio_smoothing": 0.8,
      "variation_strength": 0.3,
      "audio_loudness_type": "peak",
      "interpolate_prompts": true,
      "interpolation_steps": 4
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

You can run this model locally using Cog. First, install Cog:

brew install cog

If you don’t have Homebrew, there are other installation options available.

Run this to download the model and run it in your local environment:

cog predict r8.im/voodoohop/flux-dance@sha256:857fcca1bf0704ac58e0bc628dd433d200f531487d8e5bcf3f11de73591147e9 \
  -i 'fps=10' \
  -i 'seed=42' \
  -i 'width=512' \
  -i 'height=512' \
  -i $'narrative="Silhouettes of valleys \\nSilhouettes of hills"' \
  -i 'model_name="flux"' \
  -i 'style_suffix="angular, academic art, cubism, an abstract drawing by Svetoslav Roerich, abstract illusionism, concept art, angular, broken-stained-glass, concrete poetry, anton semono. black and white, granular, abstract, hand drawings, grainy, dmysticism, sacred symbology, blueprint"' \
  -i 'output_format="png"' \
  -i 'guidance_scale=7.5' \
  -i 'audio_smoothing=0.8' \
  -i 'variation_strength=0.3' \
  -i 'audio_loudness_type="peak"' \
  -i 'interpolate_prompts=true' \
  -i 'interpolation_steps=4'

To learn more, take a look at the Cog documentation.

Run this to download the model and run it in your local environment:

docker run -d -p 5000:5000 --gpus=all r8.im/voodoohop/flux-dance@sha256:857fcca1bf0704ac58e0bc628dd433d200f531487d8e5bcf3f11de73591147e9
curl -s -X POST \
  -H "Content-Type: application/json" \
  -d $'{
    "input": {
      "fps": 10,
      "seed": 42,
      "width": 512,
      "height": 512,
      "narrative": "Silhouettes of valleys \\nSilhouettes of hills",
      "model_name": "flux",
      "style_suffix": "angular, academic art, cubism, an abstract drawing by Svetoslav Roerich, abstract illusionism, concept art, angular, broken-stained-glass, concrete poetry, anton semono. black and white, granular, abstract, hand drawings, grainy, dmysticism, sacred symbology, blueprint",
      "output_format": "png",
      "guidance_scale": 7.5,
      "audio_smoothing": 0.8,
      "variation_strength": 0.3,
      "audio_loudness_type": "peak",
      "interpolate_prompts": true,
      "interpolation_steps": 4
    }
  }' \
  http://localhost:5000/predictions

To learn more, take a look at the Cog documentation.

Output

No output yet! Press "Submit" to start a prediction.