Load GGUF Model

LoadGGUFModel

Pack: ComfyUI-LLM-GGUF

custom_nodes.ComfyUI-LLM-GGUF

Inputs (4)

NameTypeRequired
model_nameCOMBOrequired
gpu_layersINTrequired
context_sizeINTrequired
llama_cli_pathSTRINGoptional

Outputs (1)

NameType
modelLLM_MODEL