replicate / mpt-7b-storywriter
A 7B parameter LLM fine-tuned to support contexts with more than 65K tokens
Run time and cost
This model runs on Nvidia A100 (40GB) GPU hardware. Predictions typically complete within 24 seconds. The predict time for this model varies significantly based on the inputs.