nateraw / openchat_3.5-awq

OpenChat: Advancing Open-source Language Models with Mixed-Quality Data

  • Public
  • 85.6K runs
  • GitHub
  • Paper
  • License

Input

Output

Run time and cost

This model runs on Nvidia A40 (Large) GPU hardware. Predictions typically complete within 3 seconds.

Readme

See model card here

The AWQ version of the model, which is served here, can be found here. Thank you to TheBloke for sharing this!