I beg you! please add Eligen Entity lora support and nodes in ComfyUI.

[krigeta]

Feature Idea

Hey @comfyanonymous , please I beg you, please add support for Eligen Entity lora support and nodes in ComfyUI, please!

Existing Solutions

No response

Other

No response

[nitinh12]

They also have this now - https://www.modelscope.cn/models/DiffSynth-Studio/Qwen-Image-EliGen-Poster
Please @comfyanonymous add these, I have seen this guy everywhere trying to get this in comfy ui.

[krigeta]

Thanks for the support @nitinh12 , Eligen is a very powerful technique for latent and regional attention, but unfortunately there is no support in the awesome comfyUI.

[nitinh12]

Thanks for the support @nitinh12 , Eligen is a very powerful technique for latent and regional attention, but unfortunately there is no support in the awesome comfyUI.

Yes, I know I even mentioned it to comfy in the first thread about adding diffsynth control nets

[krigeta]

Thanks for the support @nitinh12 , Eligen is a very powerful technique for latent and regional attention, but unfortunately, there is no support in the awesome comfyUI.

Yes, I know I even mentioned it to comfy in the first thread about adding diffsynth control nets

I hope they will consider my request. I know the current scenario is very hectic for them for working on multiple things, but Eligen does wonders

[krigeta]

Hey @comfyanonymous @Kosinkadink @kijai @bigcat88 at least tell me if you guys are gonna implement it or not, please?

[Kosinkadink]

Could you post all the relevant links so we can take a look? I see one link posted already in this thread, but getting full context would be good. Thanks!

[krigeta]

Sure, here it is:

Technical Details with examples and Methodology: https://huggingface.co/modelscope/EliGen

works with DIT models like Qwen-image, Flux.

Lora was trained at a Chinese studio: https://www.modelscope.cn/models/DiffSynth-Studio/Qwen-Image-EliGen-V2/files

Flux working gradio app(Live):
https://www.modelscope.cn/studios/DiffSynth-Studio/EliGen/summary

Qwen-Image Gradio app: https://github.com/modelscope/DiffSynth-Studio/blob/main/apps/gradio/qwen_image_eligen.py

a comfyUI custom node, basically a wrapper of Diffsynth in comfyUI: https://github.com/AIFSH/ComfyUI-DiffSynth-Studio

Main Github repo: https://github.com/modelscope/DiffSynth-Studio
Training dataset: https://www.modelscope.cn/datasets/DiffSynth-Studio/EliGenTrainSet

And I am requesting this because it seems the best regional prompting that is entity-based available out there for DIT models and then we can able to use loras, controlnets like everything is working in comfyUI like a charm but only this is missing.

[krigeta]

Hey dear @Kosinkadink any update?

[krigeta]

Hey mate @Kosinkadink any update?

[krigeta]

Hey team, @comfyanonymous, @comfyui-wiki, @Kosinkadink, and @bigcat88, is there any update to this? Please respond with a simple yes or no.

[krigeta]

Could you post all the relevant links so we can take a look? I see one link posted already in this thread, but getting full context would be good. Thanks!

any update mate?

[krigeta]

Hello...

[krigeta]

Hey @Kosinkadink please response.

[Kosinkadink]

We will try to take a look next week!