feat: add support for underline style lora of flux

[leejet]

No description provided.

[ddpasa]

This improves #1092 . Text encoders are still not completely loaded, but it looks like the transformer is fine after this.

[leejet]

@ddpasa This update should make the LoRA for text_encoders work. However, I couldn’t find a corresponding LoRA to test it with. If you could upload a LoRA to HuggingFace or Civitai for me to download and test, I would really appreciate it.

[ddpasa]

@ddpasa This update should make the LoRA for text_encoders work. However, I couldn’t find a corresponding LoRA to test it with. If you could upload a LoRA to HuggingFace or Civitai for me to download and test, I would really appreciate it.

Thanks @leejet , I uploaded an example Lora here: https://huggingface.co/ddhfacc/lora_debug/tree/main It has T5 and Clip layers as well.

Pulling the additional commit did not reduce the number of unused lora layers for me.

[leejet]

@ddpasa Everything should be ok now.

[ddpasa]

@ddpasa Everything should be ok now.

I think so, testing now. I don't see similar errors in the log after 6bff0d9. I'll generate a few and compare with Comfy.

[ddpasa]

I generated multiple images, as far as I can tell, it works great now. Thanks for fixing this!