This is a Cog implementation test for Language model streaming. The model is from Openbuddy finetuned mistral-7b in GPTQ quantization in 4bits by TheBloke.

peter65374/openbuddy-mistral-7b

Openbuddy finetuned mistral-7b in GPTQ quantization in 4bits by TheBloke
Public
71
runs