paullux / framepack-runner

FramePack video generation with image + motion prompt. Based on Stanford's 2025 model.

  • Public
  • 82 runs
  • GitHub
  • Weights
  • Paper
  • License
Iterate in playground
Run with an API

Run time and cost

This model runs on Nvidia A100 (80GB) GPU hardware. We don't yet have enough runs of this model to provide performance information.

Readme

๐ŸŽž๏ธ FramePack Runner โ€“ Image-to-Video with Prompt

Run on Replicate

Generate short videos from a single image and a motion prompt using the FramePack architecture by Stanford (2025).

๐Ÿ‘‰ Try it now on Replicate


โœจ Example usage

replicate run paullux/framepack-runner \
  -v image=@input.png \
  -v prompt="A cat jumps backward in surprise" \
  -v seed=123 \
  -v steps=30 \
  -v duration_seconds=5 \
  -v fps=30

๐Ÿง  About FramePack

Packing Input Frame Contexts in Next-Frame Prediction Models for Video Generation Lvmin Zhang, Maneesh Agrawala โ€“ Stanford University, 2025

FramePack compresses temporal context into fixed-length representations, making it highly efficient for generating long video sequences.

  • ๐Ÿ“„ Project page

  • ๐Ÿงช Uses the FramePackPipeline from ๐Ÿค— diffusers


๐Ÿ“ฆ Inputs

Name Type Description
image file The input image (.png or .jpg)
prompt string A motion-focused description prompt
seed integer Random seed for reproducibility (default: 42)
steps integer Sampling steps (default: 25)
duration_seconds number Duration of the video in seconds (default: 5)
fps integer Output video frame rate (default: 30)

๐Ÿ“ค Output

Returns an .mp4 video file composed of all generated frames.


๐Ÿ›  How it works

python framepack_runner.py \
  -v image=@input.png \
  -v prompt="A cat jumps backward in surprise" \
  -v seed=123 \
  -v steps=30 \
  -v duration_seconds=5 \
  -v fps=30

All frames are saved locally and then compiled into a video using ffmpeg.

๐Ÿ“ธ Example Prompt Ideas

  • The robot jumps forward and transforms mid-air.

  • A woman spins slowly in a dark room, lit by candlelight.

  • The camera zooms toward a cat staring at a moving shadow.


๐Ÿ“ƒ License

This implementation uses FramePack under its original academic license. Your usage of Replicate infrastructure is bound by their terms of service.


๐Ÿ™Œ Credits

Based on FramePack by Lvmin Zhang & Maneesh Agrawala (Stanford).