Generate videos
These models can generate and edit videos from text prompts and images. They use advanced AI techniques like diffusion models and latent space interpolation to create high-quality, controllable video content.
Key capabilities:
- Text-to-video generation - Convert text prompts into video clips and animations. Useful for quickly prototyping video concepts.
- Image-to-video generation - Animate still images into video.
- Inpainting for infinite zoom - Use image inpainting to extrapolate video frames and create infinite zoom effects.
- Stylization - Apply artistic filters like cartoonification to give videos a unique look and feel.
Our Pick: AnimateDiff
For most people looking to generate custom videos from text or image prompts, we recommend AnimateDiff. This versatile model can animate your own personalized text-to-image diffusion models without requiring specific tuning.
AnimateDiff has quickly become one of the most used models in this collection, with over 150,000 runs. Its ease of use and compatibility with custom models make it a great choice for a wide range of video generation needs.
Also Great: Stable Diffusion Animation
If you want to animate the output of Stable Diffusion models specifically, Stable Diffusion Animation is an excellent option. It works by smoothly interpolating between text prompts to create a video sequence.
With over 100,000 runs, this straightforward approach is popular and effective. It’s a reliable way to bring your Stable Diffusion creations to life.
For Entertaining GIFs: Hotshot-XL
To generate short, high-quality GIFs featuring popular culture figures and styles, try Hotshot-XL. Trained to work alongside Stable Diffusion XL, this model excels at producing fun, shareable GIF content.
Hotshot-XL has been used over 40,000 times, attesting to the appeal of its specialized capabilities. If memes and eye-catching clips are what you’re after, give it a shot.
Recommended models
anotherjesse / zeroscope-v2-xl
Zeroscope V2 XL & 576w
lucataco / animate-diff
Animate Your Personalized Text-to-Image Diffusion Models
deforum / deforum_stable_diffusion
Animating prompts with stable diffusion
lucataco / hotshot-xl
😊 Hotshot-XL is an AI text-to-GIF model trained to work alongside Stable Diffusion XL
cjwbw / damo-text-to-video
Multi-stage text-to-video generation
andreasjansson / stable-diffusion-animation
Animate Stable Diffusion by interpolating between two prompts
ali-vilab / i2vgen-xl
RESEARCH/NON-COMMERCIAL USE ONLY: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models
nateraw / stable-diffusion-videos
Generate videos by interpolating the latent space of Stable Diffusion
zsxkib / animate-diff
🎨 AnimateDiff (w/ MotionLoRAs for Panning, Zooming, etc): Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning
arielreplicate / robust_video_matting
extract foreground of a video
cjwbw / text2video-zero
Text-to-Image Diffusion Models are Zero-Shot Video Generators
arielreplicate / stable_diffusion_infinite_zoom
Use Runway's Stable-diffusion inpainting model to create an infinite loop video
cjwbw / videocrafter
VideoCrafter2: Text-to-Video and Image-to-Video Generation and Editing
wyhsirius / lia
Learning to Animate Images via Latent Space Navigation
camenduru / dynami-crafter-576x1024
Create a video from an image
sanzgiri / cartoonify_video
Cartoonifies a video
zsxkib / animatediff-illusions
Monster Labs' Controlnet QR Code Monster v2 For SD-1.5 on top of AnimateDiff Prompt Travel (Motion Module SD 1.5 v2)
pollinations / real-basicvsr-video-superresolution
RealBasicVSR: Investigating Tradeoffs in Real-World Video Super-Resolution
pollinations / stable-diffusion-dance
Audio Reactive Stable Diffusion
zsxkib / animatediff-prompt-travel
🎨AnimateDiff Prompt Travel🧭 Seamlessly Navigate and Animate Between Text-to-Image Prompts for Dynamic Visual Narratives
arielreplicate / deoldify_video
Add colours to old video footage.
charlesmccarthy / hotshot-a40
Hotshot XL using SDXL for generating one second clips of high quality! Running on a40 Made by the greats at hotshot.co and brought to you by your friends at FullJourney! Thanks to LucaTaco for the MVP!
cloneofsimo / hotshot-xl-lora-controlnet
Text-to-gif using SDXL, with controlnet and lora support
pollinations / tune-a-video
About Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
cjwbw / controlvideo
Training-free Controllable Text-to-Video Generation