You're looking at a specific version of this model. Jump to the model overview.

andreasjansson /codellama-34b-instruct-gguf:1ed692e4

Input

*string
Shift + Return to add a new line

Prompt

string
Shift + Return to add a new line

Grammar in GBNF format. Use either grammar or jsonschema.

string
Shift + Return to add a new line

JSON schema for the generated output. Use either grammar or jsonschema.

integer

Max number of tokens to return

Default: 500

number

Temperature

Default: 0.8

number

Top P

Default: 0.95

number

Top K

Default: 10

number
(minimum: 0, maximum: 2)

Frequency penalty

Default: 0

number
(minimum: 0, maximum: 2)

Presence

Default: 0

number
(minimum: 0, maximum: 2)

Repetition penalty

Default: 1.1

string

Mirostat sampling mode

Default: "Disabled"

number
(minimum: 0, maximum: 1)

Mirostate learning rate, if mirostat_mode is not Disabled

Default: 0.1

number
(minimum: 0, maximum: 10)

Mirostat target entropy

Default: 5

Output

No output yet! Press "Submit" to start a prediction.