PM Task Arithmetic (Mergekit)

PM Task Arithmetic (Mergekit)

Concept: Computes "task vectors" for each model by subtracting a base_model. These task vectors are then combined as a weighted average and added back to the base_model. Use Cases: Combining skills from multiple models fine-tuned from a common ancestor Transferring specific capabilities (e.g., coding ability, instruction following) from one model to another Steering style or behavior of a model by adding small task vectors from other models Inputs: Requires a base_model and one or more other models. Key Parameters: - weight (per-model): Weight for each model's task vector in the merge - lambda (global): Scaling factor applied to the summed task vectors before adding back to the base. Default 1.0

Pack: LoRA Power-Merger ComfyUI

custom_nodes.LoRA-Merger-ComfyUI

Inputs (2)

NameTypeRequired
rescale_normCOMBOrequired
normalizeBOOLEANrequired

Outputs (1)

NameType
MergeMethodMergeMethod