lucataco / hunyuanvideo-lora-trainer

Fine-tune HunyuanVideo via a-r-r-o-w/finetrainers (Work In Progress)

  • Public
  • 52 runs
  • GitHub
  • Weights
  • Paper
  • License
Run with an API
Playground API Examples README Versions

Run time and cost

This model runs on Nvidia H100 GPU hardware. We don't yet have enough runs of this model to provide performance information.

Readme

About

A Cog implementation of a-r-r-o-w/finetrainers finetune scripts for training video LoRAs

How to use

Upload your training data as a zip file and hit Run to train. Your zip file should contain:

  • prompts.txt file which should contain prompts separated by lines
  • videos.txt file should contain the video file paths, separated by lines
  • mp4 video files at any resolution as long as it is divisible by 32. (For example, 720 * 480, 1920 * 1020, etc) And supported frame counts must be 4 * k or 4 * k + 1 (example: 16, 32, 49, 81). To help with video splitting and resizing see this model: lucataco/video-split

Run your LoRA

After training your LoRA use the following inference model: [lucataco/hunyuanvideo-community-lora]https://replicate.com/lucataco/hunyuanvideo-community-lora)