Prompt Injection Node for ComfyUI

by DataCTE0 starssuccess

This custom node for ComfyUI allows you to inject specific prompts at specific blocks of the Stable Diffusion UNet, providing fine-grained control over the generated image. It is based on the concept that the content/subject understanding of the model is primarily contained within the MID0 and MID1 blocks, as demonstrated in the B-Lora (Content Style implicit separation) paper. Features. Inject different prompts into specific UNet blocks Three different node variations for flexible workflow integration Customize the learning rate of specific blocks to focus on content, lighting, style, or other aspects Potential for developing a 'Mix of Experts' approach by swapping blocks on-the-fly based on prompt content

View on GitHub

Nodes (6)

Attn2 Prompt Injection (advanced)AdvancedPromptInjectionadvanced/model
Attn2 SD1.5 Prompt Injection (advanced)AdvancedSD15PromptInjectionadvanced/model
Attn2 Prompt InjectionPromptInjectionadvanced/model
Attn2 SD1.5 Prompt InjectionSD15PromptInjectionadvanced/model
Attn2 Prompt Injection (simple)SimplePromptInjectionadvanced/model
Attn2 SD1.5 Prompt Injection (simple)SimpleSD15PromptInjectionadvanced/model