Readme
TheBloke’s quantized version of Phind’s CodeLlama 33B V2 Instruct model in GGUF format. The full model card can be found here.
Specifically, this is the phind-codellama-34b-v2.Q5_K_M.gguf model, with a 4096 context window.
kcaverly
/
phind-codellama-34b-v2-gguf
A quantized 34B parameter language model from Phind for code completion
Input
Output
Run time and cost
This model runs on Nvidia A40 (Large) GPU hardware. Predictions typically complete within 4 minutes. The predict time for this model varies significantly based on the inputs.