tomasmcm / openinstruct-mistral-7b

Source: monology/openinstruct-mistral-7b ✦ Quant: TheBloke/openinstruct-mistral-7B-AWQ ✦ Commercially-usable 7B model, based on mistralai/Mistral-7B-v0.1 and finetuned on VMware/open-instruct

  • Public
  • 293 runs
  • Paper
  • License
Run with an API
Playground API Examples README Versions

Run time and cost

This model costs approximately $0.0012 to run on Replicate, or 833 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia A40 GPU hardware. Predictions typically complete within 3 seconds.

Readme

OpenInstruct Mistral-7B

1st among commercially-usable 7B models on the Open LLM Leaderboard!*

This is mistralai/Mistral-7B-v0.1 finetuned on VMware/open-instruct.
Quantized to FP16 and released under the Apache-2.0 license by myself.
Compute generously provided by Higgsfield AI.

Prompt format: Alpaca

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
[your instruction goes here]

### Response:
  • temperature: 0.2
  • top_k: 50
  • top_p 0.95
  • repetition_penalty: 1.1

*as of 21 Nov 2023. “commercially-usable” includes both an open-source base model and a non-synthetic open-source finetune dataset. updated leaderboard results available here.