PM Task Arithmetic (Mergekit)
PM Task Arithmetic (Mergekit)
Concept: Computes "task vectors" for each model by subtracting a base_model. These task vectors are then combined as a weighted average and added back to the base_model. Use Cases: Combining skills from multiple models fine-tuned from a common ancestor Transferring specific capabilities (e.g., coding ability, instruction following) from one model to another Steering style or behavior of a model by adding small task vectors from other models Inputs: Requires a base_model and one or more other models. Key Parameters: - weight (per-model): Weight for each model's task vector in the merge - lambda (global): Scaling factor applied to the summed task vectors before adding back to the base. Default 1.0
Pack: LoRA Power-Merger ComfyUI
custom_nodes.LoRA-Merger-ComfyUI
Inputs (2)
Outputs (1)
| Name | Type |
|---|---|
| MergeMethod | MergeMethod |