You're looking at a specific version of this model. Jump to the model overview.
titocosta /meditron-70b-awq:0460016b
Input schema
The fields you can use to run this model with an API. If you don’t give a value for a field its default value will be used.
Field | Type | Default value | Description |
---|---|---|---|
prompt |
string
|
Prompt
|
|
prompt_template |
string
|
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>question
{prompt}<|im_end|>
<|im_start|>answer
|
Prompt template
|
system_message |
string
|
You are a helpful AI assistant trained in the medical domain
|
System message
|
max_new_tokens |
integer
|
512
|
The maximum number of tokens the model should generate as output.
|
temperature |
number
|
0.2
|
Model temperature
|
top_p |
number
|
0.95
|
Top P
|
top_k |
integer
|
50
|
Top K
|
Output schema
The shape of the response you’ll get when you run this model with an API.
Schema
{'items': {'type': 'string'},
'title': 'Output',
'type': 'array',
'x-cog-array-display': 'concatenate',
'x-cog-array-type': 'iterator'}