fooocus-api without async queue length limit
Runs Mixtral 8x7B on a single A40 GPU
This model doesn't have a readme.
This model is not yet booted but ready for API calls. Your first API call will boot the model and may take longer, but after that subsequent responses will be fast.
This model runs on L40S.