lucataco / thinkdiffusionxl

ThinkDiffusionXL is a go-to model capable of amazing photorealism that's also versatile enough to generate high-quality images across a variety of styles and subjects without needing to be a prompting genius

  • Public
  • 12.8K runs
  • GitHub
  • Paper
  • License

Input

Output

Run time and cost

This model runs on Nvidia A40 (Large) GPU hardware. Predictions typically complete within 3 minutes. The predict time for this model varies significantly based on the inputs.

Readme

— The following is from the ThinkDiffusion Model Card as of 11/6/23 —

ThinkDiffusionXL (TDXL) ThinkDiffusionXL is the result of our goal to build a go-to model capable of amazing photorealism that’s also versatile enough to generate high-quality images across a variety of styles and subjects without needing to be a prompting genius.

You can find it preloaded on https://www.thinkdiffusion.com

Please leave a review if you’re happy with it, this will encourage us to create more and improve on it.

The work Data source: TDXL is trained on over 10,000 diverse images that span photorealism, digital art, anime, and more. The smallest resolution in our dataset is 1365x2048, but many images go up to resolutions as high as 4622x6753. In total, our dataset takes up 42GB.

Training: With 1.8 million steps, we’ve put in the work. For comparison, Juggernaut is at 600k steps and RealVisXL is at 348k steps

Hand-captioned images: Each image is carefully captioned by hand, enhancing the model’s ability to generate accurate and high-quality results from minimal prompts.

NSFW capabilities: The model includes over 1,000 tastefully curated NSFW images.

Our thoughts Detail and quality: Most XL models in the Realistic category suffer from poor detail, especially in the background and even in basic features like eyes, teeth, and skin. We believe TDXL outperforms in these areas due to its large, high-quality dataset. For comparison, Juggernaut has about half the image material, and RealVisXL has only 1,700 images. Ultimately, TDXL simply possesses much more “knowledge”.

Less bias: We made sure to use an equal number of images for each style, gender, etc. Other models we tested over the past few months had some kind of bias, sometimes it was bias toward portrait shots, gender bias, certain ethnicities, etc. For instance, Juggernaut has a bias in the Close-Up area, and the Cinematic Light is quite dominant in that model. RealVisXL also has a bias towards Portrait shots. On the other hand, TDXL gives you what you want: Landscape, Midshot, Full Body, Close-Up, Portrait, Sideview, Backview, Action Shots, Cinematic…whatever you want without always being pushed in a certain direction due to a bias.

Versatile base: Because of its large balanced quality dataset, TDXL is versatile to serve as a base model for future trainings. You can create new finetunes in entirely different directions, add LoRAs to fill in missing concepts, or do additional trainings with more balanced quality data.