nateraw/wizard-mega-13b-awq | Readme and Docs

nateraw / wizard-mega-13b-awq

wizard-mega-13b quantized with AWQ and served with vLLM (Updated 1 year, 8 months ago)

Public
5.5K runs
L40S
GitHub

Iterate in playground

Run with an API

Playground API Examples README Versions

Read the official model card here: https://huggingface.co/TheBloke/wizard-mega-13B-AWQ

Thank you to TheBloke for sharing this model!