kcaverly / neuralbeagle14-7b-gguf

NeuralBeagle14-7B is (probably) the best 7B model you can find!

  • Public
  • 12.1K runs
  • GitHub
  • Paper
Run with an API
Playground API Examples README Versions

Input

Output

Run time and cost

This model runs on Nvidia T4 GPU hardware. Predictions typically complete within 3 minutes.

Readme

“NeuralBeagle14-7B is (probably) the best 7B model you can find! 🎉”

The original model can be found here. The quantized version used is Q5_K_M, and can be found here.