moinnadeem / codellama-34b-instruct-vllm

  • Public
  • 78 runs

If you haven’t yet trained a model on Replicate, we recommend you read one of the following guides.

Pricing

Trainings for this model run on Nvidia A100 (80GB) GPU hardware, which costs $0.0014 per second.

Create a training

Install the Python library:

pip install replicate

Then, run this to create a training with moinnadeem/codellama-34b-instruct-vllm:49f07fce as the base model:

import replicate

training = replicate.trainings.create(
  version="moinnadeem/codellama-34b-instruct-vllm:49f07fcebd9e71cc2c451fd5d0667602987aa77f8ed9c6d63b8ab8ef97739fe7",
  input={
    ...
  },
  destination=f"{username}/<destination-model-name>"
)

print(training)

Note that before you can create a training, you’ll need to create a model and use its name as the value for the destination field.