Readme
Implementation of TheBloke/Upstage-Llama-2-70B-instruct-v2-GPTQ
Give me a follow if you like my work! @lucataco93
Upstage/Llama-2-70B-instruct-v2 - GPTQ
This model runs on Nvidia A100 (80GB) GPU hardware. Predictions typically complete within 39 seconds. The predict time for this model varies significantly based on the inputs.
Implementation of TheBloke/Upstage-Llama-2-70B-instruct-v2-GPTQ
Give me a follow if you like my work! @lucataco93