Readme
TheBloke’s quantized version of Deepseek’s Coder 33B Instruct model in GGUF format. The full model card can be found here.
Specifically, this is the deepseek-coder-33b-instruct.Q5_K_M.gguf model, with a 16k context window.
kcaverly
/
deepseek-coder-33b-instruct-gguf
A quantized 33B parameter language model from Deepseek for SOTA repository level code completion
Run time and cost
This model costs approximately $0.0045 to run on Replicate, or 222 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.
This model runs on Nvidia A40 (Large) GPU hardware. Predictions typically complete within 7 seconds.