Training API for language models

Posted July 20, 2023

We built a training API for fine-tuning language models, and today we're making it available to all Replicate users.

You can fine-tune language models to make them better at a particular task, like classifying text, answering questions about your private data, being a chatbot, or extracting structured data from text.

You can train models like LLaMA 2, Flan T5, GPT-J and others. Check out the trainable language models collection to see what models can be fine-tuned, and stay tuned as we add support for more.

To get started, check out our guide to fine tuning a language model.

training = replicate.trainings.create(
  version="a16z-infra/llama7b-v2-chat:a845a72bb3fa3ae298143d13efa8873a2987dbf3d49c293513cd8abf4b845a83",
  input={
    "train_data": "https://example.com/my-training-data.jsonl",
  },
  destination="zeke/my-custom-llama-2"
)