Readme
๐๏ธ FramePack Runner โ Image-to-Video with Prompt
Generate short videos from a single image and a motion prompt using the FramePack architecture by Stanford (2025).
๐ Try it now on Replicate
โจ Example usage
replicate run paullux/framepack-runner \
-v image=@input.png \
-v prompt="A cat jumps backward in surprise" \
-v seed=123 \
-v steps=30 \
-v duration_seconds=5 \
-v fps=30
๐ง About FramePack
Packing Input Frame Contexts in Next-Frame Prediction Models for Video Generation Lvmin Zhang, Maneesh Agrawala โ Stanford University, 2025
FramePack compresses temporal context into fixed-length representations, making it highly efficient for generating long video sequences.
-
๐ Project page
-
๐งช Uses the
FramePackPipeline
from ๐คdiffusers
๐ฆ Inputs
Name | Type | Description |
---|---|---|
image |
file |
The input image (.png or .jpg ) |
prompt |
string |
A motion-focused description prompt |
seed |
integer |
Random seed for reproducibility (default: 42 ) |
steps |
integer |
Sampling steps (default: 25 ) |
duration_seconds |
number |
Duration of the video in seconds (default: 5 ) |
fps |
integer |
Output video frame rate (default: 30 ) |
๐ค Output
Returns an .mp4
video file composed of all generated frames.
๐ How it works
python framepack_runner.py \
-v image=@input.png \
-v prompt="A cat jumps backward in surprise" \
-v seed=123 \
-v steps=30 \
-v duration_seconds=5 \
-v fps=30
All frames are saved locally and then compiled into a video using ffmpeg
.
๐ธ Example Prompt Ideas
-
The robot jumps forward and transforms mid-air.
-
A woman spins slowly in a dark room, lit by candlelight.
-
The camera zooms toward a cat staring at a moving shadow.
๐ License
This implementation uses FramePack under its original academic license. Your usage of Replicate infrastructure is bound by their terms of service.
๐ Credits
Based on FramePack by Lvmin Zhang & Maneesh Agrawala (Stanford).