Readme
This model doesn't have a readme.
pip install replicate
REPLICATE_API_TOKEN
environment variable:export REPLICATE_API_TOKEN=<paste-your-token-here>
Find your API token in your account settings.
import replicate
Run hazelnutcloud/bagelmisterytour-v2-8x7b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run(
"hazelnutcloud/bagelmisterytour-v2-8x7b:e4eda504fbe4ef51d10aa27c422e54481c5ff218fd2cd96112ed98a0b76f236e",
input={
"prompt": "<s> ### User:\nWhat's the largest planet in the solar system?\n\n### Assistant:\n",
"max_tokens": 16
}
)
# The hazelnutcloud/bagelmisterytour-v2-8x7b model can stream output as it's running.
# The predict method returns an iterator, and you can iterate over that output.
for item in output:
# https://replicate.com/hazelnutcloud/bagelmisterytour-v2-8x7b/api#output-schema
print(item, end="")
To learn more, take a look at the guide on getting started with Python.
No output yet! Press "Submit" to start a prediction.
This model costs approximately $0.0066 to run on Replicate, or 151 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.
This model runs on Nvidia L40S GPU hardware. Predictions typically complete within 7 seconds. The predict time for this model varies significantly based on the inputs.
This model doesn't have a readme.