You're looking at a specific version of this model. Jump to the model overview.
andreasjansson /codellama-34b-instruct-gguf:1ed692e4
Input schema
The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.
| Field | Type | Default value | Description |
|---|---|---|---|
| prompt |
string
|
Prompt
|
|
| grammar |
string
|
Grammar in GBNF format. Use either grammar or jsonschema.
|
|
| jsonschema |
string
|
JSON schema for the generated output. Use either grammar or jsonschema.
|
|
| max_tokens |
integer
|
500
|
Max number of tokens to return
|
| temperature |
number
|
0.8
|
Temperature
|
| top_p |
number
|
0.95
|
Top P
|
| top_k |
number
|
10
|
Top K
|
| frequency_penalty |
number
|
0
Max: 2 |
Frequency penalty
|
| presence_penalty |
number
|
0
Max: 2 |
Presence
|
| repeat_penalty |
number
|
1.1
Max: 2 |
Repetition penalty
|
| mirostat_mode |
string
(enum)
|
Disabled
Options: Disabled, Mirostat, Mirostat 2.0 |
Mirostat sampling mode
|
| mirostat_learning_rate |
number
|
0.1
Max: 1 |
Mirostate learning rate, if mirostat_mode is not Disabled
|
| mirostat_entropy |
number
|
5
Max: 10 |
Mirostat target entropy
|
Output schema
The shape of the response you’ll get when you run this model with an API.
Schema
{'items': {'type': 'string'},
'title': 'Output',
'type': 'array',
'x-cog-array-display': 'concatenate',
'x-cog-array-type': 'iterator'}