GGUF Accelerator (patch_on_device)

IAMCCS_GGUF_accelerator

Pack: IAMCCS-nodes

custom_nodes.IAMCCS-nodes

Inputs (8)

NameTypeRequired
modelMODELrequired
modeCOMBOrequired
patch_on_deviceBOOLEANrequired
move_patches_nowBOOLEANrequired
min_free_vram_mbINTrequired
oom_fallbackBOOLEANrequired
move_policyCOMBOrequired
leave_free_vram_mbINTrequired

Outputs (2)

NameType
modelMODEL
reportSTRING