You're looking at a specific version of this model. Jump to the model overview.

joehoover /falcon-40b-instruct:7eb0f4b1

Input

*string
Shift + Return to add a new line

Prompt to send to the model.

integer
(minimum: 1)

Maximum number of tokens to generate. A word is generally 2-3 tokens

Default: 500

number
(minimum: 0.01, maximum: 5)

Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.

Default: 0.75

number
(minimum: 0.01, maximum: 1)

When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens

Default: 1

number
(minimum: 0.01, maximum: 5)

Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it.

Default: 1

number
(minimum: 0.01, maximum: 5)

Increasing the length_penalty parameter above 1.0 will cause the model to favor longer sequences, while decreasing it below 1.0 will cause the model to favor shorter sequences.

Default: 1

integer
(minimum: 0)

If set to int > 0, all ngrams of size no_repeat_ngram_size can only occur once.

Default: 0

string
Shift + Return to add a new line

Comma delimited string specifying stop sequences. Multi-token stop sequences are supported, but they cannot contain commas.

integer
(minimum: -1)

Set seed for reproducible outputs. Set to -1 for random seed.

Default: -1

boolean

provide debugging output in logs

Default: false

Output

No output yet! Press "Submit" to start a prediction.