Inputs (21)
| Name | Type | Required |
|---|---|---|
| model_file | COMBO | required |
| n_ctx | INT | required |
| n_gpu_layers | INT | required |
| unload_other_models | BOOLEAN | required |
| close_after_use | BOOLEAN | required |
| system | STRING | required |
| user | STRING | required |
| instant | BOOLEAN | required |
| max_history | INT | required |
| stop | STRING | required |
| temperature | FLOAT | required |
| top_p | FLOAT | required |
| seed | INT | required |
| max_tokens | INT | required |
| presence_penalty | FLOAT | required |
| frequency_penalty | FLOAT | required |
| repeat_penalty | FLOAT | required |
| response_format | STRING | required |
| enable | BOOLEAN | required |
| chat_model | CHAT_MODEL | optional |
| messages | MESSAGES | optional |
Outputs (3)
| Name | Type |
|---|---|
| chat_model | CHAT_MODEL |
| response | STRING |
| messages | MESSAGES |