replicate / mpt-7b-storywriter

A 7B parameter LLM fine-tuned to support contexts with more than 65K tokens

Demo API Examples README Versions (a38b8ba0)

Run time and cost

This model runs on Nvidia A100 (40GB) GPU hardware. Predictions typically complete within 24 seconds. The predict time for this model varies significantly based on the inputs.