See how this was deployed by looking at the README of replicate/axolotl-trainer
Genstruct 7B is an instruction-generation model, designed to create valid instructions given a raw text corpus. This enables the creation of new, partially synthetic instruction finetuning datasets from any raw-text corpus.
Honeycomb NLQ Generator
Honeycomb NLQ Generator hosted with vLLM
Honeycomb NLQ Generator hosted with vLLM + AWQ Quantized
This model is cold. You'll get a fast response if the model is warm and already running, and a slower response if the model is cold and starting up.
This model runs on A100 (80GB). View more.