Readme
This is a cog wrapper around Defog’s SQLCoder, to deploy it on Replicate .
It has initially been deployed with 8-bit quantization.
Defog released their code with an Apache v2 license, and the model weights as CC BY-SA 4.0.
gregwdata
/
defog-sqlcoder-q8
Defog's SQLCoder is a state-of-the-art LLM for converting natural language questions to SQL queries. SQLCoder is a 15B parameter fine-tuned on a base StarCoder model.
Run time and cost
This model costs approximately $0.00098 to run on Replicate, or 1020 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.
This model runs on Nvidia L40S GPU hardware. Predictions typically complete within 1 seconds.