PM Ties (Mergekit)

PM Ties (Mergekit)

Concept: Builds on Task Arithmetic by sparsifying task vectors and applying a sign consensus algorithm. This helps to resolve interference when merging multiple models and retain more of their individual strengths. Use Cases: Merging a larger number of models effectively Reducing parameter interference and negative synergy between merged models Inputs: Requires 2 or more models. Key Parameters: - weight (per-model): Weight for each model's task vector - density (per-model): Fraction of weights to retain in each sparsified task vector - lambda (global): As in Task Arithmetic

Pack: LoRA Power-Merger ComfyUI

custom_nodes.LoRA-Merger-ComfyUI

Inputs (3)

NameTypeRequired
rescale_normCOMBOrequired
normalizeBOOLEANrequired
densityFLOATrequired

Outputs (1)

NameType
MergeMethodMergeMethod