You're looking at a specific version of this model. Jump to the model overview.
zsxkib /animatediff-illusions:b3ccb010
Input schema
The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.
Field | Type | Default value | Description |
---|---|---|---|
controlnet_video |
string
|
A short video/gif that will be used as the keyframes for QR Code Monster to use, Please note, all of the frames will be used as keyframes
|
|
enable_qr_code_monster_v2 |
boolean
|
True
|
Flag to enable QR Code Monster V2 ControlNet
|
qr_code_monster_v2_preprocessor |
boolean
|
True
|
Flag to pre-process keyframes for QR Code Monster V2 ControlNet
|
qr_code_monster_v2_guess_mode |
boolean
|
False
|
Flag to enable guess mode (un-guided) for QR Code Monster V2 ControlNet
|
controlnet_conditioning_scale |
number
|
0.18
|
Strength of ControlNet. The outputs of the ControlNet are multiplied by `controlnet_conditioning_scale` before they are added to the residual in the original UNet
|
loop |
boolean
|
True
|
Flag to loop the video. Use when you have an 'infinitely' repeating video/gif ControlNet video
|
head_prompt |
string
|
masterpiece, best quality, a haunting and detailed depiction of a ship at sea, battered by waves, ominous,((dark clouds:1.3)),distant lightning, rough seas, rain, silhouette of the ship against the stormy sky
|
Primary animation prompt. If a prompt map is provided, this will be prefixed at the start of every individual prompt in the map
|
prompt_map |
string
|
|
Prompt for changes in animation. Provide 'frame number : prompt at this frame', separate different prompts with '|'. Make sure the frame number does not exceed the length of video (frames)
|
tail_prompt |
string
|
|
Additional prompt that will be appended at the end of the main prompt or individual prompts in the map
|
negative_prompt |
string
|
|
None
|
frames |
integer
|
128
Min: 1 Max: 1024 |
Length of the video in frames (playback is at 8 fps e.g. 16 frames @ 8 fps is 2 seconds)
|
width |
integer
|
256
Min: 64 Max: 2160 |
Width of generated video in pixels, must be divisable by 8
|
height |
integer
|
384
Min: 64 Max: 2160 |
Height of generated video in pixels, must be divisable by 8
|
base_model |
string
(enum)
|
majicmixRealistic_v5Preview
Options: realisticVisionV40_v20Novae, lyriel_v16, majicmixRealistic_v5Preview, rcnzCartoon3d_v10, toonyou_beta3, CUSTOM |
Choose the base model for animation generation. If 'CUSTOM' is selected, provide a custom model URL in the next parameter
|
custom_base_model_url |
string
|
|
Only used when base model is set to 'CUSTOM'. URL of the custom model to download if 'CUSTOM' is selected in the base model. Only downloads from 'https://civitai.com/api/download/models/' are allowed
|
prompt_fixed_ratio |
number
|
0.5
Max: 1 |
Defines the ratio of adherence to the fixed part of the prompt versus the dynamic part (from prompt map). Value should be between 0 (only dynamic) to 1 (only fixed).
|
scheduler |
string
(enum)
|
k_dpmpp_sde
Options: ddim, pndm, heun, unipc, euler, euler_a, lms, k_lms, dpm_2, k_dpm_2, dpm_2_a, k_dpm_2_a, dpmpp_2m, k_dpmpp_2m, dpmpp_sde, k_dpmpp_sde, dpmpp_2m_sde, k_dpmpp_2m_sde |
Diffusion scheduler
|
steps |
integer
|
25
Min: 1 Max: 100 |
Number of inference steps
|
guidance_scale |
number
|
7.5
Max: 20 |
Guidance Scale. How closely do we want to adhere to the prompt and its contents
|
clip_skip |
integer
|
2
Min: 1 Max: 6 |
Skip the last N-1 layers of the CLIP text encoder (lower values follow prompt more closely)
|
context |
integer
|
16
Min: 1 Max: 32 |
Number of frames to condition on (default: max of <length> or 32). max for motion module v1 is 24
|
output_format |
string
(enum)
|
mp4
Options: mp4, gif |
Output format of the video. Can be 'mp4' or 'gif'
|
playback_frames_per_second |
integer
|
8
Min: 1 Max: 60 |
None
|
film_interpolation |
boolean
|
True
|
Whether to use FILM for between-frame interpolation (film-net.github.io)
|
num_interpolation_steps |
integer
|
3
Min: 1 Max: 50 |
Number of steps to interpolate between animation frames
|
seed |
integer
|
Seed for different images and reproducibility. Leave blank to randomise seed
|
Output schema
The shape of the response you’ll get when you run this model with an API.
{'format': 'uri', 'title': 'Output', 'type': 'string'}