deforum-art / deforum-stable-diffusion

Deforum Stable Diffusion

  • Public
  • 73.5K runs
  • A100 (80GB)
  • GitHub
  • License

Input

string

Choose stable diffusion model.

Default: "Protogen_V2.2.ckpt"

integer

Number of frames for animation

Default: 200

string
Shift + Return to add a new line

Prompt for animation. Provide 'frame number : prompt at this frame', separate different prompts with '|'. Make sure the frame number does not exceed the max_frames.

Default: "0: a beautiful apple, trending on Artstation | 50: a beautiful banana, trending on Artstation | 100: a beautiful coconut, trending on Artstation | 150: a beautiful durian, trending on Artstation"

integer

Width of output video. Reduce if out of memory.

Default: 512

integer

Height of output image. Reduce if out of memory.

Default: 512

integer
(minimum: 1, maximum: 500)

Number of denoising steps

Default: 50

number
(minimum: 1, maximum: 20)

Scale for classifier-free guidance

Default: 7

string

An enumeration.

Default: "euler_ancestral"

integer

Random seed. Leave blank to randomize the seed

integer
(minimum: 10, maximum: 60)

Choose fps for the video.

Default: 15

string

Choose CLIP model

Default: "ViT-L/14"

boolean

If not using init image, you can skip the next settings to setting the animation_mode.

Default: false

file

Provide init_image if use_init

boolean

Default: false

file

Provide mask_file if use_mask

boolean

Default: false

string

Choose Animation mode. All parameters below are for setting up animations.

Default: "2D"

string

An enumeration.

Default: "replicate"

string
Shift + Return to add a new line

angle parameter for the motion

Default: "0:(0)"

string
Shift + Return to add a new line

zoom parameter for the motion

Default: "0:(1.04)"

string
Shift + Return to add a new line

translation_x parameter for the 2D motion

Default: "0:(10*sin(2*3.14*t/10))"

string
Shift + Return to add a new line

translation_y parameter for the 2D motion

Default: "0:(0)"

string
Shift + Return to add a new line

translation_z parameter for the 2D motion

Default: "0:(10)"

string
Shift + Return to add a new line

rotation_3d_x parameter for the 3D motion

Default: "0:(0)"

string
Shift + Return to add a new line

rotation_3d_y parameter for the 3D motion

Default: "0:(0)"

string
Shift + Return to add a new line

rotation_3d_z parameter for the 3D motion

Default: "0:(0)"

boolean

Default: false

string
Shift + Return to add a new line

Default: "0:(0)"

string
Shift + Return to add a new line

Default: "0:(t%15)"

string
Shift + Return to add a new line

Default: "0:(0)"

string
Shift + Return to add a new line

Default: "0:(53)"

string
Shift + Return to add a new line

Default: "0: (0.02)"

string
Shift + Return to add a new line

Default: "0: (0.65)"

string
Shift + Return to add a new line

Default: "0: (1.0)"

string
Shift + Return to add a new line

Default: "0:(1)"

string
Shift + Return to add a new line

Default: "0:(0.5)"

string
Shift + Return to add a new line

Default: "0:(1)"

string
Shift + Return to add a new line

Default: "0:(100)"

string
Shift + Return to add a new line

Default: "0:(0)"

string
Shift + Return to add a new line

Default: "0: (5)"

string
Shift + Return to add a new line

Default: "0: (1.0)"

string
Shift + Return to add a new line

Default: "0: (0.2)"

string
Shift + Return to add a new line

Default: "0: (0.0)"

string

An enumeration.

Default: "Match Frame 0 LAB"

integer

Default: 1

string

An enumeration.

Default: "1"

boolean

Default: true

number

Default: 0.3

integer

Default: 200

integer

Default: 10000

integer

Default: 40

string

An enumeration.

Default: "border"

string

An enumeration.

Default: "bicubic"

file
integer

Default: 1

boolean

Default: true

boolean

Default: false

file
boolean

Default: false

boolean

Default: true

string

An enumeration.

Default: "None"

string

An enumeration.

Default: "Farneback"

boolean

Default: false

string

An enumeration.

Default: "None"

boolean

Default: false

string

An enumeration.

Default: "None"

boolean

Default: false

boolean

Default: false

boolean

Default: false

boolean

Default: false

integer

Default: 4

boolean

Default: false

string
Shift + Return to add a new line

Default: ""

Output

Generated in

This example was created by a different version, deforum-art/deforum-stable-diffusion:528a3441.

Run time and cost

This model costs approximately $0.98 to run on Replicate, or 1 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia A100 (80GB) GPU hardware. Predictions typically complete within 12 minutes. The predict time for this model varies significantly based on the inputs.

Readme

Deforum Stable Diffusion

Key Features

  • Our implementation is written in an IPython notebook and was designed for use with Google Colab.
  • In response to the implementation of the credit system, we have added support for local run times and will be adding a web user interfaces.
  • The notebook includes a variety of features for generating interpolation, 2D and 3D animations, and RANSAC animations.
  • We also offer CLIP, aesthetic, and color pallet conditioning.
  • Our goal is to provide users with a range of tools and options for creating stable diffusion images.