PM Ties (Mergekit)
PM Ties (Mergekit)
Concept: Builds on Task Arithmetic by sparsifying task vectors and applying a sign consensus algorithm. This helps to resolve interference when merging multiple models and retain more of their individual strengths. Use Cases: Merging a larger number of models effectively Reducing parameter interference and negative synergy between merged models Inputs: Requires 2 or more models. Key Parameters: - weight (per-model): Weight for each model's task vector - density (per-model): Fraction of weights to retain in each sparsified task vector - lambda (global): As in Task Arithmetic
Pack: LoRA Power-Merger ComfyUI
custom_nodes.LoRA-Merger-ComfyUI
Inputs (3)
Outputs (1)
| Name | Type |
|---|---|
| MergeMethod | MergeMethod |