You're looking at a specific version of this model. Jump to the model overview.
deforum-art/deforum-stable-diffusion:652b0fed
Input schema
The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.
| Field | Type | Default value | Description |
|---|---|---|---|
| model_checkpoint |
string
(enum)
|
Protogen_V2.2.ckpt
Options: v2-1_768-ema-pruned.ckpt, v2-1_512-ema-pruned.ckpt, 768-v-ema.ckpt, 512-base-ema.ckpt, Protogen_V2.2.ckpt, v1-5-pruned.ckpt, v1-5-pruned-emaonly.ckpt, sd-v1-4.ckpt, robo-diffusion-v1.ckpt, wd-v1-3-float16.ckpt |
Choose stable diffusion model.
|
| max_frames |
integer
|
200
|
Number of frames for animation
|
| animation_prompts |
string
|
0: a beautiful apple, trending on Artstation | 50: a beautiful banana, trending on Artstation | 100: a beautiful coconut, trending on Artstation | 150: a beautiful durian, trending on Artstation
|
Prompt for animation. Provide 'frame number : prompt at this frame', separate different prompts with '|'. Make sure the frame number does not exceed the max_frames.
|
| width |
integer
(enum)
|
512
Options: 128, 256, 384, 448, 512, 576, 640, 704, 768, 832, 896, 960, 1024 |
Width of output video. Reduce if out of memory.
|
| height |
integer
(enum)
|
512
Options: 128, 256, 384, 448, 512, 576, 640, 704, 768, 832, 896, 960, 1024 |
Height of output image. Reduce if out of memory.
|
| num_inference_steps |
integer
|
50
Min: 1 Max: 500 |
Number of denoising steps
|
| guidance_scale |
number
|
7
Min: 1 Max: 20 |
Scale for classifier-free guidance
|
| sampler |
string
(enum)
|
euler_ancestral
Options: klms, dpm2, dpm2_ancestral, heun, euler, euler_ancestral, plms, ddim, dpm_fast, dpm_adaptive, dpmpp_2s_a, dpmpp_2m |
An enumeration.
|
| seed |
integer
|
Random seed. Leave blank to randomize the seed
|
|
| fps |
integer
|
15
Min: 10 Max: 60 |
Choose fps for the video.
|
| clip_name |
string
(enum)
|
ViT-L/14
Options: ViT-L/14, ViT-L/14@336px, ViT-B/16, ViT-B/32 |
Choose CLIP model
|
| use_init |
boolean
|
False
|
If not using init image, you can skip the next settings to setting the animation_mode.
|
| init_image |
string
|
Provide init_image if use_init
|
|
| use_mask |
boolean
|
False
|
None
|
| mask_file |
string
|
Provide mask_file if use_mask
|
|
| invert_mask |
boolean
|
False
|
None
|
| animation_mode |
string
(enum)
|
2D
Options: 2D, 3D, Video Input, Interpolation |
Choose Animation mode. All parameters below are for setting up animations.
|
| border |
string
(enum)
|
replicate
Options: wrap, replicate |
An enumeration.
|
| angle |
string
|
0:(0)
|
angle parameter for the motion
|
| zoom |
string
|
0:(1.04)
|
zoom parameter for the motion
|
| translation_x |
string
|
0:(10*sin(2*3.14*t/10))
|
translation_x parameter for the 2D motion
|
| translation_y |
string
|
0:(0)
|
translation_y parameter for the 2D motion
|
| translation_z |
string
|
0:(10)
|
translation_z parameter for the 2D motion
|
| rotation_3d_x |
string
|
0:(0)
|
rotation_3d_x parameter for the 3D motion
|
| rotation_3d_y |
string
|
0:(0)
|
rotation_3d_y parameter for the 3D motion
|
| rotation_3d_z |
string
|
0:(0)
|
rotation_3d_z parameter for the 3D motion
|
| flip_2d_perspective |
boolean
|
False
|
None
|
| perspective_flip_theta |
string
|
0:(0)
|
None
|
| perspective_flip_phi |
string
|
0:(t%15)
|
None
|
| perspective_flip_gamma |
string
|
0:(0)
|
None
|
| perspective_flip_fv |
string
|
0:(53)
|
None
|
| noise_schedule |
string
|
0: (0.02)
|
None
|
| strength_schedule |
string
|
0: (0.65)
|
None
|
| contrast_schedule |
string
|
0: (1.0)
|
None
|
| hybrid_video_comp_alpha_schedule |
string
|
0:(1)
|
None
|
| hybrid_video_comp_mask_blend_alpha_schedule |
string
|
0:(0.5)
|
None
|
| hybrid_video_comp_mask_contrast_schedule |
string
|
0:(1)
|
None
|
| hybrid_video_comp_mask_auto_contrast_cutoff_high_schedule |
string
|
0:(100)
|
None
|
| hybrid_video_comp_mask_auto_contrast_cutoff_low_schedule |
string
|
0:(0)
|
None
|
| kernel_schedule |
string
|
0: (5)
|
None
|
| sigma_schedule |
string
|
0: (1.0)
|
None
|
| amount_schedule |
string
|
0: (0.2)
|
None
|
| threshold_schedule |
string
|
0: (0.0)
|
None
|
| color_coherence |
string
(enum)
|
Match Frame 0 LAB
Options: Match Frame 0 HSV, Match Frame 0 LAB, Match Frame 0 RGB, Video Input |
An enumeration.
|
| color_coherence_video_every_N_frames |
integer
|
1
|
None
|
| diffusion_cadence |
string
(enum)
|
1
Options: 1, 2, 3, 4, 5, 6, 7, 8 |
An enumeration.
|
| use_depth_warping |
boolean
|
True
|
None
|
| midas_weight |
number
|
0.3
|
None
|
| near_plane |
integer
|
200
|
None
|
| far_plane |
integer
|
10000
|
None
|
| fov |
integer
|
40
|
None
|
| padding_mode |
string
(enum)
|
border
Options: border, reflection, zeros |
An enumeration.
|
| sampling_mode |
string
(enum)
|
bicubic
Options: bicubic, bilinear, nearest |
An enumeration.
|
| video_init_path |
string
|
None
|
|
| extract_nth_frame |
integer
|
1
|
None
|
| overwrite_extracted_frames |
boolean
|
True
|
None
|
| use_mask_video |
boolean
|
False
|
None
|
| video_mask_path |
string
|
None
|
|
| hybrid_video_generate_inputframes |
boolean
|
False
|
None
|
| hybrid_video_use_first_frame_as_init_image |
boolean
|
True
|
None
|
| hybrid_video_motion |
string
(enum)
|
None
Options: None, Optical Flow, Perspective, Affine |
An enumeration.
|
| hybrid_video_flow_method |
string
(enum)
|
Farneback
Options: Farneback, DenseRLOF, SF |
An enumeration.
|
| hybrid_video_composite |
boolean
|
False
|
None
|
| hybrid_video_comp_mask_type |
string
(enum)
|
None
Options: None, Depth, Video Depth, Blend, Difference |
An enumeration.
|
| hybrid_video_comp_mask_inverse |
boolean
|
False
|
None
|
| hybrid_video_comp_mask_equalize |
string
(enum)
|
None
Options: None, Before, After, Both |
An enumeration.
|
| hybrid_video_comp_mask_auto_contrast |
boolean
|
False
|
None
|
| hybrid_video_comp_save_extra_frames |
boolean
|
False
|
None
|
| hybrid_video_use_video_as_mse_image |
boolean
|
False
|
None
|
| interpolate_key_frames |
boolean
|
False
|
None
|
| interpolate_x_frames |
integer
|
4
|
None
|
| resume_from_timestring |
boolean
|
False
|
None
|
| resume_timestring |
string
|
|
None
|
Output schema
The shape of the response you’ll get when you run this model with an API.
{'format': 'uri', 'title': 'Output', 'type': 'string'}