0xsmw / workgpt

Helps you with work

  • Public
  • 1.3K runs
  • A100 (80GB)
  • GitHub
  • Paper
  • License

Input

*string
Shift + Return to add a new line

Prompt to send to LLaMA.

integer
(minimum: 1, maximum: 5)

Number of output sequences to generate

Default: 1

integer
(minimum: 1)

Maximum number of tokens for input + generation. A word is generally 2-3 tokens

Default: 2000

number
(minimum: 0.01, maximum: 5)

Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.

Default: 0.1

number
(minimum: 0.01, maximum: 1)

When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens

Default: 1

number
(minimum: 0.01, maximum: 5)

Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it.

Default: 1

Output

No output.
Generated in

Run time and cost

This model costs approximately $0.018 to run on Replicate, or 55 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia A100 (80GB) GPU hardware. Predictions typically complete within 14 seconds. The predict time for this model varies significantly based on the inputs.

Readme

🦾 This model is a synthetic coworker trained only on knowledge worker tasks.

Built by the team at Klu

Model description

8B Parameters 30k Instruction Set

Intended use

Maximize happiness by making you more productive.

Caveats and recommendations

This model is untested.