You can fine-tune language models like Llama 2 or image models like SDXL with your own data on Replicate. If you don’t make any requests to your fine-tuned model for a while, it can take some time to start again. This is called a cold boot, and can be as slow as a few minutes for large models.

We’ve made some dramatic improvements to cold boots for fine-tuned models. They now boot in less than one second.

It works on these models:

• meta/llama-2-7b-chat
• meta/llama-2-13b-chat
• meta/llama-2-70b-chat
• meta/llama-2-7b
• meta/llama-2-13b
• meta/llama-2-70b
• stability-ai/sdxl

For now, it’s available only for new fine-tuned models created starting today. We’re also working on a more cold boot improvements for all models. Stay tuned.

To get started, check out these guides:

• Fine-tune Llama 2
• Fine-tune SDXL

Let’s go. 🚀