alexgenovese / ominicontrol-lora

WIP | Minimal and Universal Control for Diffusion Transformer

  • Public
  • 27 runs
  • GitHub
  • Weights
  • Paper
  • License

About

This endpoint is a Cog implementation of OminiControl with Flux Dev 1.

⚠ This version is not working due to a huge model folder of 56GB (flux + omini).

The working copy is on Github; please follow the Github URL below the title

OminiControl is a minimal yet powerful universal control framework for Diffusion Transformer models like FLUX.

  • Universal Control 🌐: A unified control framework that supports both subject-driven control and spatial control (such as edge-guided and in-painting generation).
  • Minimal Design πŸš€: Injects control signals while preserving original model structure. Only introduces 0.1% additional parameters to the base model.

Cover Image

Contact me if you need customizations.

Follow me on Twitter/X | Website

Licensing and commercial use

You can use the images commercially if you generate images on Replicate with FLUX.1 models and their fine-tunes.

If you download the weights off Replicate and generate images on your computer, you can’t use the images commercially.

Credits

OminiControl: Minimal and Universal Control for Diffusion Transformer Zhenxiong Tan, Songhua Liu, Xingyi Yang, Qiaochu Xue, and Xinchao Wang Learning and Vision Lab, National University of Singapore