These models generate structured data from natural language prompts. They enable exciting applications like:
For most users, we recommend the andreasjansson/llama-2-13b-chat-gguf model. It hits the sweet spot of popularity, speed, and general-purpose chat capabilities:
Whether you need to parse natural language into SQL queries, generate JSON data matching a schema, or converse with data using a structured chat interface, this model is a great fit.
For specialized code generation tasks, andreasjansson/codellama-7b-instruct-gguf is an excellent alternative. While a bit slower than our top pick, it offers:
If your structured data use case revolves heavily around generating code, this model is well worth considering. Its understanding of code semantics and syntax is top notch.
The other models in this collection are also quite capable for certain use cases. The larger Llama and CodeLlama variants offer even more power (at the cost of some speed). And andreasjansson/wizardcoder-python-34b-v1-gguf is great for Python code generation specifically. But for most users, our top recommendations offer the best balance of performance, flexibility, and ease of use.
Recommended Models
Recommended Models
andreasjansson/wizardcoder-python-34b-v1-gguf
WizardCoder-python-34B-v1.0 with support for grammars and jsonschema
Updated 2 years ago
771 runs
andreasjansson/codellama-34b-instruct-gguf
CodeLlama-34B-instruct with support for grammars and jsonschema
Updated 2 years ago
1.1K runs
andreasjansson/llama-2-13b-gguf
Llama-2 13B with support for grammars and jsonschema
Updated 2 years ago
755 runs