andreasjansson / llama-2-13b-gguf
Llama-2 13B with support for grammars and jsonschema
Run time and cost
This model runs on Nvidia A40 (Large) GPU hardware. Predictions typically complete within 6 seconds. The predict time for this model varies significantly based on the inputs.