Llama.cpp Server Client
LlamaCppClient
Pack: comfyui-llamacpp-client
custom_nodes.comfyui-llamacpp-client
Inputs (70)
| Name | Type | Required |
|---|---|---|
| server_url | STRING | required |
| endpoint | COMBO | required |
| prompt | STRING | required |
| api_key | STRING | optional |
| timeout | INT | optional |
| n_predict | INT | optional |
| temperature | FLOAT | optional |
| top_k | INT | optional |
| top_p | FLOAT | optional |
| min_p | FLOAT | optional |
| seed | INT | optional |
| dynatemp_range | FLOAT | optional |
| dynatemp_exponent | FLOAT | optional |
| xtc_probability | FLOAT | optional |
| xtc_threshold | FLOAT | optional |
| repeat_penalty | FLOAT | optional |
| repeat_last_n | INT | optional |
| presence_penalty | FLOAT | optional |
| frequency_penalty | FLOAT | optional |
| dry_multiplier | FLOAT | optional |
| dry_base | FLOAT | optional |
| dry_allowed_length | INT | optional |
| dry_penalty_last_n | INT | optional |
| dry_sequence_breakers | STRING | optional |
| mirostat | INT | optional |
| mirostat_tau | FLOAT | optional |
| mirostat_eta | FLOAT | optional |
| typical_p | FLOAT | optional |
| n_keep | INT | optional |
| stop_sequences | STRING | optional |
| ignore_eos | BOOLEAN | optional |
| stream | BOOLEAN | optional |
| n_probs | INT | optional |
| min_keep | INT | optional |
| post_sampling_probs | BOOLEAN | optional |
| return_tokens | BOOLEAN | optional |
| timings_per_token | BOOLEAN | optional |
| grammar | STRING | optional |
| json_schema | STRING | optional |
| logit_bias | STRING | optional |
| cache_prompt | BOOLEAN | optional |
| id_slot | INT | optional |
| samplers | STRING | optional |
| t_max_predict_ms | INT | optional |
| messages | STRING | optional |
| system_message | STRING | optional |
| user_message | STRING | optional |
| assistant_message | STRING | optional |
| max_tokens | INT | optional |
| model | STRING | optional |
| tools | STRING | optional |
| tool_choice | STRING | optional |
| response_format | STRING | optional |
| input_text | STRING | optional |
| encoding_format | COMBO | optional |
| embd_normalize | INT | optional |
| content | STRING | optional |
| tokens | STRING | optional |
| add_special | BOOLEAN | optional |
| parse_special | BOOLEAN | optional |
| with_pieces | BOOLEAN | optional |
| input_prefix | STRING | optional |
| input_suffix | STRING | optional |
| input_extra | STRING | optional |
| query | STRING | optional |
| documents | STRING | optional |
| top_n | INT | optional |
| lora | STRING | optional |
| response_fields | STRING | optional |
| image_data | STRING | optional |