yunzai-cc / zoe-test

(Updated 1 year, 10 months ago)

  • Public
  • 14 runs
Iterate in playground

Input

*string
Shift + Return to add a new line

Prompt to send to the model.

string
Shift + Return to add a new line

chat history

integer
(minimum: 1)

Maximum number of tokens to generate. A word is generally 2-3 tokens

Default: 10

number
(minimum: 0.01, maximum: 5)

Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.

Default: 0.75

number
(minimum: 0.01, maximum: 1)

When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens

Default: 0.9

integer
(minimum: 0)

When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens. Overrides top_p if set. Set to `0` to disable.

Default: 0

number
(minimum: 0.01, maximum: 5)

Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it.

Default: 1

boolean

set stream repsonse

Default: false

Output

No output yet! Press "Submit" to start a prediction.

Run time and cost

This model runs on Nvidia A100 (80GB) GPU hardware. We don't yet have enough runs of this model to provide performance information.

Readme

This model doesn't have a readme.