You're looking at a specific version of this model. Jump to the model overview.
replicate /mpt-7b-storywriter:a38b8ba0
This version has been disabled because it consistently fails to complete setup.
Input
Run this model in Node.js with one line of code:
npm install replicate
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import Replicate from "replicate";
const replicate = new Replicate({
auth: process.env.REPLICATE_API_TOKEN,
});
Run replicate/mpt-7b-storywriter using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
const output = await replicate.run(
"replicate/mpt-7b-storywriter:a38b8ba0d73d328040e40ecfbb2f63a938dec8695fe15dfbd4218fa0ac3e76bf",
{
input: {
seed: -1,
debug: false,
top_p: 1,
max_length: 500,
temperature: 0.75,
length_penalty: 1,
repetition_penalty: 1,
no_repeat_ngram_size: 0
}
}
);
console.log(output);
To learn more, take a look at the guide on getting started with Node.js.
pip install replicate
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import replicate
Run replicate/mpt-7b-storywriter using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run(
"replicate/mpt-7b-storywriter:a38b8ba0d73d328040e40ecfbb2f63a938dec8695fe15dfbd4218fa0ac3e76bf",
input={
"seed": -1,
"debug": False,
"top_p": 1,
"max_length": 500,
"temperature": 0.75,
"length_penalty": 1,
"repetition_penalty": 1,
"no_repeat_ngram_size": 0
}
)
# The replicate/mpt-7b-storywriter model can stream output as it's running.
# The predict method returns an iterator, and you can iterate over that output.
for item in output:
# https://replicate.com/replicate/mpt-7b-storywriter/api#output-schema
print(item, end="")
To learn more, take a look at the guide on getting started with Python.
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
Run replicate/mpt-7b-storywriter using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
curl -s -X POST \
-H "Authorization: Bearer $REPLICATE_API_TOKEN" \
-H "Content-Type: application/json" \
-H "Prefer: wait" \
-d $'{
"version": "replicate/mpt-7b-storywriter:a38b8ba0d73d328040e40ecfbb2f63a938dec8695fe15dfbd4218fa0ac3e76bf",
"input": {
"seed": -1,
"debug": false,
"top_p": 1,
"max_length": 500,
"temperature": 0.75,
"length_penalty": 1,
"repetition_penalty": 1,
"no_repeat_ngram_size": 0
}
}' \
https://api.replicate.com/v1/predictions
To learn more, take a look at Replicate’s HTTP API reference docs.
brew install cog
If you don’t have Homebrew, there are other installation options available.
Run this to download the model and run it in your local environment:
cog predict r8.im/joehoover/mpt-7b-storywriter@sha256:a38b8ba0d73d328040e40ecfbb2f63a938dec8695fe15dfbd4218fa0ac3e76bf \
-i 'seed=-1' \
-i 'debug=false' \
-i 'top_p=1' \
-i 'max_length=500' \
-i 'temperature=0.75' \
-i 'length_penalty=1' \
-i 'repetition_penalty=1' \
-i 'no_repeat_ngram_size=0'
To learn more, take a look at the Cog documentation.
Run this to download the model and run it in your local environment:
docker run -d -p 5000:5000 --gpus=all r8.im/joehoover/mpt-7b-storywriter@sha256:a38b8ba0d73d328040e40ecfbb2f63a938dec8695fe15dfbd4218fa0ac3e76bf
curl -s -X POST \ -H "Content-Type: application/json" \ -d $'{ "input": { "seed": -1, "debug": false, "top_p": 1, "max_length": 500, "temperature": 0.75, "length_penalty": 1, "repetition_penalty": 1, "no_repeat_ngram_size": 0 } }' \ http://localhost:5000/predictions
To learn more, take a look at the Cog documentation.
Add a payment method to run this model.
Each run costs approximately $0.032. Alternatively, try out our featured models for free.
By signing in, you agree to our
terms of service and privacy policy
Output
No output yet! Press "Submit" to start a prediction.