uwulewd/airoboros-llama-2-70b | Readme and Docs

Inference Airoboros L2 70B 2.1 - GPTQ using ExLlama.

Public

17.6K runs

Run with an API

Playground API Examples README Versions

Model used: Airoboros L2 70B 2.1 - GPTQ

LoRA used: Airoboros 2.1 Jannie 70B QLoRA

Inference using: ExLlama

Cog GitHub project: cog-exllama