Run joehoover/aaa-test-7b using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.
output = replicate.run(
"joehoover/aaa-test-7b:2c33464bab629edf9cc019fca3c295f88cf8b78b3a04d7e8efc2d3988ce0e3c3",
input={
"debug": False,
"top_k": 50,
"top_p": 0.9,
"temperature": 0.75,
"max_new_tokens": 128,
"min_new_tokens": -1
}
)
# The joehoover/aaa-test-7b model can stream output as it's running.# The predict method returns an iterator, and you can iterate over that output.for item in output:
# https://replicate.com/joehoover/aaa-test-7b/api#output-schemaprint(item, end="")
This model is not yet booted but ready for API calls. Your first API call will boot the model and may take longer, but after that subsequent responses will be fast.
This model costs approximately $0.0036 to run on Replicate, but this varies depending on your inputs.