You're looking at a specific version of this model. Jump to the model overview.
Input schema
The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.
| Field | Type | Default value | Description |
|---|---|---|---|
| model |
None
|
progen2-small
|
Model id
|
| device |
string
|
cuda:0
|
Device to run model on
|
| rng_seed |
integer
|
42
|
Random number generator seed
|
| rng_deterministic |
boolean
|
True
|
Use deterministic RNG
|
| p |
number
|
0.9
|
Probability of sampling from top-k
|
| t |
number
|
0.8
|
Temperature for top-k sampling
|
| max_length |
integer
|
1024
|
Maximum length of generated text
|
| num_samples |
integer
|
2
|
Number of samples to generate
|
| fp16 |
boolean
|
True
|
Use mixed precision
|
| context |
string
|
1
|
Context to use for generation
|
| sanity |
boolean
|
True
|
Run sanity check
|
Output schema
The shape of the response you’ll get when you run this model with an API.
Schema
{'title': 'Output', 'type': 'string'}