Text Encoder Deep Debiaser (Qwen3-4B)

Qwen3_4BTextEncoderDebiaser

Deep sub-component debiaser for Qwen3-4B Text Encoder. 182 individual controls splitting every layer into functional parts: layers: input_norm | attn | attn_norm | mlp | post_norm ⚠️ QUANTIZED MODEL: Only float tensors (norms, some weights) can be modified. Quantized layers (U8, F8_E4M3) are preserved unchanged. Strength 1.0 = unchanged. Below 1.0 = weakened. Above 1.0 = boosted. LoRA-safe: patches stack independently with any applied LoRAs. TIP: Boost embed_tokens (1.5-2.0) for better prompt adherence. SAVE: Enable save_model to export the modified weights. full_model = complete safetensors file diff_only = only modified weights (small delta file) both = saves both files

Pack: Realtime LoRA Trainer

custom_nodes.comfyUI-Realtime-Lora

Inputs (369)

Name	Type	Required
clip	CLIP	required
preset	COMBO	required
save_model	BOOLEAN	required
save_mode	COMBO	required
filename	STRING	required
embed_tokens	BOOLEAN	required
embed_tokens_str	FLOAT	required
l0_input_norm	BOOLEAN	required
l0_input_norm_str	FLOAT	required
l0_attn	BOOLEAN	required
l0_attn_str	FLOAT	required
l0_attn_norm	BOOLEAN	required
l0_attn_norm_str	FLOAT	required
l0_mlp	BOOLEAN	required
l0_mlp_str	FLOAT	required
l0_post_norm	BOOLEAN	required
l0_post_norm_str	FLOAT	required
l1_input_norm	BOOLEAN	required
l1_input_norm_str	FLOAT	required
l1_attn	BOOLEAN	required
l1_attn_str	FLOAT	required
l1_attn_norm	BOOLEAN	required
l1_attn_norm_str	FLOAT	required
l1_mlp	BOOLEAN	required
l1_mlp_str	FLOAT	required
l1_post_norm	BOOLEAN	required
l1_post_norm_str	FLOAT	required
l2_input_norm	BOOLEAN	required
l2_input_norm_str	FLOAT	required
l2_attn	BOOLEAN	required
l2_attn_str	FLOAT	required
l2_attn_norm	BOOLEAN	required
l2_attn_norm_str	FLOAT	required
l2_mlp	BOOLEAN	required
l2_mlp_str	FLOAT	required
l2_post_norm	BOOLEAN	required
l2_post_norm_str	FLOAT	required
l3_input_norm	BOOLEAN	required
l3_input_norm_str	FLOAT	required
l3_attn	BOOLEAN	required
l3_attn_str	FLOAT	required
l3_attn_norm	BOOLEAN	required
l3_attn_norm_str	FLOAT	required
l3_mlp	BOOLEAN	required
l3_mlp_str	FLOAT	required
l3_post_norm	BOOLEAN	required
l3_post_norm_str	FLOAT	required
l4_input_norm	BOOLEAN	required
l4_input_norm_str	FLOAT	required
l4_attn	BOOLEAN	required
l4_attn_str	FLOAT	required
l4_attn_norm	BOOLEAN	required
l4_attn_norm_str	FLOAT	required
l4_mlp	BOOLEAN	required
l4_mlp_str	FLOAT	required
l4_post_norm	BOOLEAN	required
l4_post_norm_str	FLOAT	required
l5_input_norm	BOOLEAN	required
l5_input_norm_str	FLOAT	required
l5_attn	BOOLEAN	required
l5_attn_str	FLOAT	required
l5_attn_norm	BOOLEAN	required
l5_attn_norm_str	FLOAT	required
l5_mlp	BOOLEAN	required
l5_mlp_str	FLOAT	required
l5_post_norm	BOOLEAN	required
l5_post_norm_str	FLOAT	required
l6_input_norm	BOOLEAN	required
l6_input_norm_str	FLOAT	required
l6_attn	BOOLEAN	required
l6_attn_str	FLOAT	required
l6_attn_norm	BOOLEAN	required
l6_attn_norm_str	FLOAT	required
l6_mlp	BOOLEAN	required
l6_mlp_str	FLOAT	required
l6_post_norm	BOOLEAN	required
l6_post_norm_str	FLOAT	required
l7_input_norm	BOOLEAN	required
l7_input_norm_str	FLOAT	required
l7_attn	BOOLEAN	required
l7_attn_str	FLOAT	required
l7_attn_norm	BOOLEAN	required
l7_attn_norm_str	FLOAT	required
l7_mlp	BOOLEAN	required
l7_mlp_str	FLOAT	required
l7_post_norm	BOOLEAN	required
l7_post_norm_str	FLOAT	required
l8_input_norm	BOOLEAN	required
l8_input_norm_str	FLOAT	required
l8_attn	BOOLEAN	required
l8_attn_str	FLOAT	required
l8_attn_norm	BOOLEAN	required
l8_attn_norm_str	FLOAT	required
l8_mlp	BOOLEAN	required
l8_mlp_str	FLOAT	required
l8_post_norm	BOOLEAN	required
l8_post_norm_str	FLOAT	required
l9_input_norm	BOOLEAN	required
l9_input_norm_str	FLOAT	required
l9_attn	BOOLEAN	required
l9_attn_str	FLOAT	required
l9_attn_norm	BOOLEAN	required
l9_attn_norm_str	FLOAT	required
l9_mlp	BOOLEAN	required
l9_mlp_str	FLOAT	required
l9_post_norm	BOOLEAN	required
l9_post_norm_str	FLOAT	required
l10_input_norm	BOOLEAN	required
l10_input_norm_str	FLOAT	required
l10_attn	BOOLEAN	required
l10_attn_str	FLOAT	required
l10_attn_norm	BOOLEAN	required
l10_attn_norm_str	FLOAT	required
l10_mlp	BOOLEAN	required
l10_mlp_str	FLOAT	required
l10_post_norm	BOOLEAN	required
l10_post_norm_str	FLOAT	required
l11_input_norm	BOOLEAN	required
l11_input_norm_str	FLOAT	required
l11_attn	BOOLEAN	required
l11_attn_str	FLOAT	required
l11_attn_norm	BOOLEAN	required
l11_attn_norm_str	FLOAT	required
l11_mlp	BOOLEAN	required
l11_mlp_str	FLOAT	required
l11_post_norm	BOOLEAN	required
l11_post_norm_str	FLOAT	required
l12_input_norm	BOOLEAN	required
l12_input_norm_str	FLOAT	required
l12_attn	BOOLEAN	required
l12_attn_str	FLOAT	required
l12_attn_norm	BOOLEAN	required
l12_attn_norm_str	FLOAT	required
l12_mlp	BOOLEAN	required
l12_mlp_str	FLOAT	required
l12_post_norm	BOOLEAN	required
l12_post_norm_str	FLOAT	required
l13_input_norm	BOOLEAN	required
l13_input_norm_str	FLOAT	required
l13_attn	BOOLEAN	required
l13_attn_str	FLOAT	required
l13_attn_norm	BOOLEAN	required
l13_attn_norm_str	FLOAT	required
l13_mlp	BOOLEAN	required
l13_mlp_str	FLOAT	required
l13_post_norm	BOOLEAN	required
l13_post_norm_str	FLOAT	required
l14_input_norm	BOOLEAN	required
l14_input_norm_str	FLOAT	required
l14_attn	BOOLEAN	required
l14_attn_str	FLOAT	required
l14_attn_norm	BOOLEAN	required
l14_attn_norm_str	FLOAT	required
l14_mlp	BOOLEAN	required
l14_mlp_str	FLOAT	required
l14_post_norm	BOOLEAN	required
l14_post_norm_str	FLOAT	required
l15_input_norm	BOOLEAN	required
l15_input_norm_str	FLOAT	required
l15_attn	BOOLEAN	required
l15_attn_str	FLOAT	required
l15_attn_norm	BOOLEAN	required
l15_attn_norm_str	FLOAT	required
l15_mlp	BOOLEAN	required
l15_mlp_str	FLOAT	required
l15_post_norm	BOOLEAN	required
l15_post_norm_str	FLOAT	required
l16_input_norm	BOOLEAN	required
l16_input_norm_str	FLOAT	required
l16_attn	BOOLEAN	required
l16_attn_str	FLOAT	required
l16_attn_norm	BOOLEAN	required
l16_attn_norm_str	FLOAT	required
l16_mlp	BOOLEAN	required
l16_mlp_str	FLOAT	required
l16_post_norm	BOOLEAN	required
l16_post_norm_str	FLOAT	required
l17_input_norm	BOOLEAN	required
l17_input_norm_str	FLOAT	required
l17_attn	BOOLEAN	required
l17_attn_str	FLOAT	required
l17_attn_norm	BOOLEAN	required
l17_attn_norm_str	FLOAT	required
l17_mlp	BOOLEAN	required
l17_mlp_str	FLOAT	required
l17_post_norm	BOOLEAN	required
l17_post_norm_str	FLOAT	required
l18_input_norm	BOOLEAN	required
l18_input_norm_str	FLOAT	required
l18_attn	BOOLEAN	required
l18_attn_str	FLOAT	required
l18_attn_norm	BOOLEAN	required
l18_attn_norm_str	FLOAT	required
l18_mlp	BOOLEAN	required
l18_mlp_str	FLOAT	required
l18_post_norm	BOOLEAN	required
l18_post_norm_str	FLOAT	required
l19_input_norm	BOOLEAN	required
l19_input_norm_str	FLOAT	required
l19_attn	BOOLEAN	required
l19_attn_str	FLOAT	required
l19_attn_norm	BOOLEAN	required
l19_attn_norm_str	FLOAT	required
l19_mlp	BOOLEAN	required
l19_mlp_str	FLOAT	required
l19_post_norm	BOOLEAN	required
l19_post_norm_str	FLOAT	required
l20_input_norm	BOOLEAN	required
l20_input_norm_str	FLOAT	required
l20_attn	BOOLEAN	required
l20_attn_str	FLOAT	required
l20_attn_norm	BOOLEAN	required
l20_attn_norm_str	FLOAT	required
l20_mlp	BOOLEAN	required
l20_mlp_str	FLOAT	required
l20_post_norm	BOOLEAN	required
l20_post_norm_str	FLOAT	required
l21_input_norm	BOOLEAN	required
l21_input_norm_str	FLOAT	required
l21_attn	BOOLEAN	required
l21_attn_str	FLOAT	required
l21_attn_norm	BOOLEAN	required
l21_attn_norm_str	FLOAT	required
l21_mlp	BOOLEAN	required
l21_mlp_str	FLOAT	required
l21_post_norm	BOOLEAN	required
l21_post_norm_str	FLOAT	required
l22_input_norm	BOOLEAN	required
l22_input_norm_str	FLOAT	required
l22_attn	BOOLEAN	required
l22_attn_str	FLOAT	required
l22_attn_norm	BOOLEAN	required
l22_attn_norm_str	FLOAT	required
l22_mlp	BOOLEAN	required
l22_mlp_str	FLOAT	required
l22_post_norm	BOOLEAN	required
l22_post_norm_str	FLOAT	required
l23_input_norm	BOOLEAN	required
l23_input_norm_str	FLOAT	required
l23_attn	BOOLEAN	required
l23_attn_str	FLOAT	required
l23_attn_norm	BOOLEAN	required
l23_attn_norm_str	FLOAT	required
l23_mlp	BOOLEAN	required
l23_mlp_str	FLOAT	required
l23_post_norm	BOOLEAN	required
l23_post_norm_str	FLOAT	required
l24_input_norm	BOOLEAN	required
l24_input_norm_str	FLOAT	required
l24_attn	BOOLEAN	required
l24_attn_str	FLOAT	required
l24_attn_norm	BOOLEAN	required
l24_attn_norm_str	FLOAT	required
l24_mlp	BOOLEAN	required
l24_mlp_str	FLOAT	required
l24_post_norm	BOOLEAN	required
l24_post_norm_str	FLOAT	required
l25_input_norm	BOOLEAN	required
l25_input_norm_str	FLOAT	required
l25_attn	BOOLEAN	required
l25_attn_str	FLOAT	required
l25_attn_norm	BOOLEAN	required
l25_attn_norm_str	FLOAT	required
l25_mlp	BOOLEAN	required
l25_mlp_str	FLOAT	required
l25_post_norm	BOOLEAN	required
l25_post_norm_str	FLOAT	required
l26_input_norm	BOOLEAN	required
l26_input_norm_str	FLOAT	required
l26_attn	BOOLEAN	required
l26_attn_str	FLOAT	required
l26_attn_norm	BOOLEAN	required
l26_attn_norm_str	FLOAT	required
l26_mlp	BOOLEAN	required
l26_mlp_str	FLOAT	required
l26_post_norm	BOOLEAN	required
l26_post_norm_str	FLOAT	required
l27_input_norm	BOOLEAN	required
l27_input_norm_str	FLOAT	required
l27_attn	BOOLEAN	required
l27_attn_str	FLOAT	required
l27_attn_norm	BOOLEAN	required
l27_attn_norm_str	FLOAT	required
l27_mlp	BOOLEAN	required
l27_mlp_str	FLOAT	required
l27_post_norm	BOOLEAN	required
l27_post_norm_str	FLOAT	required
l28_input_norm	BOOLEAN	required
l28_input_norm_str	FLOAT	required
l28_attn	BOOLEAN	required
l28_attn_str	FLOAT	required
l28_attn_norm	BOOLEAN	required
l28_attn_norm_str	FLOAT	required
l28_mlp	BOOLEAN	required
l28_mlp_str	FLOAT	required
l28_post_norm	BOOLEAN	required
l28_post_norm_str	FLOAT	required
l29_input_norm	BOOLEAN	required
l29_input_norm_str	FLOAT	required
l29_attn	BOOLEAN	required
l29_attn_str	FLOAT	required
l29_attn_norm	BOOLEAN	required
l29_attn_norm_str	FLOAT	required
l29_mlp	BOOLEAN	required
l29_mlp_str	FLOAT	required
l29_post_norm	BOOLEAN	required
l29_post_norm_str	FLOAT	required
l30_input_norm	BOOLEAN	required
l30_input_norm_str	FLOAT	required
l30_attn	BOOLEAN	required
l30_attn_str	FLOAT	required
l30_attn_norm	BOOLEAN	required
l30_attn_norm_str	FLOAT	required
l30_mlp	BOOLEAN	required
l30_mlp_str	FLOAT	required
l30_post_norm	BOOLEAN	required
l30_post_norm_str	FLOAT	required
l31_input_norm	BOOLEAN	required
l31_input_norm_str	FLOAT	required
l31_attn	BOOLEAN	required
l31_attn_str	FLOAT	required
l31_attn_norm	BOOLEAN	required
l31_attn_norm_str	FLOAT	required
l31_mlp	BOOLEAN	required
l31_mlp_str	FLOAT	required
l31_post_norm	BOOLEAN	required
l31_post_norm_str	FLOAT	required
l32_input_norm	BOOLEAN	required
l32_input_norm_str	FLOAT	required
l32_attn	BOOLEAN	required
l32_attn_str	FLOAT	required
l32_attn_norm	BOOLEAN	required
l32_attn_norm_str	FLOAT	required
l32_mlp	BOOLEAN	required
l32_mlp_str	FLOAT	required
l32_post_norm	BOOLEAN	required
l32_post_norm_str	FLOAT	required
l33_input_norm	BOOLEAN	required
l33_input_norm_str	FLOAT	required
l33_attn	BOOLEAN	required
l33_attn_str	FLOAT	required
l33_attn_norm	BOOLEAN	required
l33_attn_norm_str	FLOAT	required
l33_mlp	BOOLEAN	required
l33_mlp_str	FLOAT	required
l33_post_norm	BOOLEAN	required
l33_post_norm_str	FLOAT	required
l34_input_norm	BOOLEAN	required
l34_input_norm_str	FLOAT	required
l34_attn	BOOLEAN	required
l34_attn_str	FLOAT	required
l34_attn_norm	BOOLEAN	required
l34_attn_norm_str	FLOAT	required
l34_mlp	BOOLEAN	required
l34_mlp_str	FLOAT	required
l34_post_norm	BOOLEAN	required
l34_post_norm_str	FLOAT	required
l35_input_norm	BOOLEAN	required
l35_input_norm_str	FLOAT	required
l35_attn	BOOLEAN	required
l35_attn_str	FLOAT	required
l35_attn_norm	BOOLEAN	required
l35_attn_norm_str	FLOAT	required
l35_mlp	BOOLEAN	required
l35_mlp_str	FLOAT	required
l35_post_norm	BOOLEAN	required
l35_post_norm_str	FLOAT	required
final_norm	BOOLEAN	required
final_norm_str	FLOAT	required

Outputs (2)

Name	Type
clip	CLIP
info	STRING