Inputs (15)
| Name | Type | Required |
|---|---|---|
| prompt | STRING | required |
| system_prompt | STRING | required |
| model_id | STRING | required |
| max_new_tokens | INT | required |
| temperature | FLOAT | required |
| seed | INT | required |
| template_style | COMBO | required |
| top_k | INT | optional |
| top_p | FLOAT | optional |
| repetition_penalty | FLOAT | optional |
| length_penalty | FLOAT | optional |
| no_repeat_ngram_size | INT | optional |
| num_beams | INT | optional |
| early_stopping | BOOLEAN | optional |
| do_sample | BOOLEAN | optional |
Outputs (1)
| Name | Type |
|---|---|
| generated_text | STRING |