nateraw/nous-hermes-llama2-awq – Run with an API on Replicate

nateraw / nous-hermes-llama2-awq

TheBloke/Nous-Hermes-Llama2-AWQ served with vLLM

Public
7.2K runs
GitHub

Run with an API

Playground API Examples README Versions

Input

Output

Run time and cost

This model runs on Nvidia A40 GPU hardware.

Readme

See the official model card for more information about this model: https://huggingface.co/TheBloke/Nous-Hermes-Llama2-AWQ

Thank you to TheBloke for sharing this model!