andreasjansson / llama-2-13b-gguf

Llama-2 13B with support for grammars and jsonschema

Demo API Examples README Versions (f705c8ea)

Run time and cost

This model runs on Nvidia A40 (Large) GPU hardware. Predictions typically complete within 6 seconds. The predict time for this model varies significantly based on the inputs.