You're looking at a specific version of this model. Jump to the model overview.
lightweight-ai /prompt:cc18bfe8
Input schema
The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.
| Field | Type | Default value | Description |
|---|---|---|---|
| prompt |
string
|
Write me a poem about Machine Learning.
|
Prompt to send to the model.
|
| max_new_tokens |
integer
|
1024
Min: 1 Max: 2048 |
Maximum number of tokens to generate. A word is generally 2-3 tokens
|
| temperature |
number
|
0.6
Min: 0.1 Max: 4 |
Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.
|
| top_p |
number
|
0.9
Min: 0.05 Max: 1 |
When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens
|
| top_k |
integer
|
50
Min: 1 Max: 1000 |
When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens
|
| repetition_penalty |
number
|
1.2
|
A parameter that controls how repetitive text can be. Lower means more repetitive, while higher means less repetitive. Set to 1.0 to disable.
|
Output schema
The shape of the response you’ll get when you run this model with an API.
Schema
{'title': 'Output', 'type': 'string'}