You're looking at a specific version of this model. Jump to the model overview.
moinnadeem /llama-2-7b-mlc:afbbcfa4
Input schema
The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.
| Field | Type | Default value | Description |
|---|---|---|---|
| prompt |
string
|
Prompt to send to the model.
|
|
| max_new_tokens |
integer
|
128
Min: 1 |
Maximum number of tokens to generate. A word is generally 2-3 tokens
|
| seed |
integer
|
Random seed. Leave blank to randomize the seed
|
|
| debug |
boolean
|
False
|
provide debugging output in logs
|
| return_logits |
boolean
|
False
|
if set, only return logits for the first token. only useful for testing, etc.
|
| replicate_weights |
string
|
Path to fine-tuned weights produced by a Replicate fine-tune job.
|
Output schema
The shape of the response you’ll get when you run this model with an API.
Schema
{'items': {'type': 'string'},
'title': 'Output',
'type': 'array',
'x-cog-array-display': 'concatenate',
'x-cog-array-type': 'iterator'}