Sherin Avatar – Flux Fast Train

Built on Flux LoRA Trainer, fine-tunes Flux models quickly and efficiently.

Overview

Sherin Avatar is designed for real-time avatar generation using Flux-based LoRA fine-tuning. It enables you to train custom styles or characters and generate expressive, high-quality avatars in seconds.

How to Train

Upload a zip file of images that contains the style or subject you want to train the model on.
Use SHERIN as your trigger_word that the model will learn to associate with your subject or style, and select subject or style as the type of fine-tuning you’re trying to run.
We’ll run an autocaptioning model on the input images that will generate captions which contain your trigger word. You can also provide your own captions. To do so, add a .txt file that contains a caption for each image you want to caption in the zip file you upload - for example, img_0.jpg would be captioned by img_0.txt.
For Destination select/create an empty Replicate model location to store your LoRAs.

Dataset Size and Image Resolution

Aim for a dataset of 10-20 images of your subject.
Images with resolutions around 1024x1024 are ideal.
Very large images will be scaled down to fit aspect ratios around 1024 resolutions.

Image Selection

For style LoRAs select images that highlight distinctive features of the style, use varied subjects but keep the style consistent.
For style LoRAs avoid datasets where certain elements dominate.
For character LoRAs use images of the subject in different settings, facial expressions, and backgrounds.
For character LoRAs avoid different haircuts or ages, and showing hands in a lot of face framing positions as we found this led to more hand hallucinations.

How to Run

After training is complete you will be able to run your LoRA in a new Replicate model at the destination location.

How to train with the API

To run a training from the API, you’ll still need to gather a zip file of images and select or create a model on Replicate as the destination for your training. Unlike in the UI, you’ll also need to upload the zip file to your storage platform of choice. You’ll also need to get a Replicate API token.

Once you have those things ready, you can call the training API like so:

curl -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
        "destination": "your-username/your-model-name",
        "input": {
            "input_images": "<your-training-data-url>",
            "trigger_word": "SHERIN",
            "lora_type": "subject"
        }
    }' \
  https://api.replicate.com/v1/models/replicate/fast-flux-trainer/versions/8b10794665aed907bb98a1a5324cd1d3a8bea0e9b31e65210967fb9c9e2e08ed/trainings

This will start the training and return a JSON with training metadata. You can check on the status of the training at replicate.com/trainings or programmatically through the API like so:

curl -s \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  https://api.replicate.com/v1/trainings/<training_id>

License

If you generate images on Replicate with FLUX.1 models and their fine-tunes, then you can use the images commercially.

If you download the weights off Replicate and generate images on your own computer, you can’t use the images commercially.

Off Replicate, the Flux-Dev LoRAs have the same license as the original base mode for FLUX.1-dev. If you choose the option to upload your trained LoRA to Huggingface, this License will be added for you.

Model created 1 month ago