See the official model card for this model here: https://huggingface.co/TheBloke/Llama-2-70B-chat-AWQ
Thank you to TheBloke for sharing this model!
nateraw
/
llama-2-70b-chat-awq
llama-2-70b-chat quantized with AWQ and served with vLLM