gregwdata / defog-sqlcoder-q8

Defog's SQLCoder is a state-of-the-art LLM for converting natural language questions to SQL queries. SQLCoder is a 15B parameter fine-tuned on a base StarCoder model.

  • Public
  • 12.4K runs
  • GitHub
  • License

This is a cog wrapper around Defog’s SQLCoder, to deploy it on Replicate .

It has initially been deployed with 8-bit quantization.

Defog released their code with an Apache v2 license, and the model weights as CC BY-SA 4.0.