Readme
This is a cog wrapper around Defog’s SQLCoder, to deploy it on Replicate .
It has initially been deployed with 8-bit quantization.
Defog released their code with an Apache v2 license, and the model weights as CC BY-SA 4.0.
gregwdata
/
defog-sqlcoder-q8
Defog's SQLCoder is a state-of-the-art LLM for converting natural language questions to SQL queries. SQLCoder is a 15B parameter fine-tuned on a base StarCoder model.
Input
Output
Run time and cost
This model runs on Nvidia A40 (Large) GPU hardware. Predictions typically complete within 1 seconds.