par xinsir
Open source · 92k downloads · 1712 likes
ControlNet Union SDXL 1.0 est un modèle avancé qui combine plusieurs fonctionnalités de contrôle et d'édition d'images en un seul outil polyvalent. Il permet de générer ou modifier des images à partir de multiples conditions (comme des contours, des poses ou des masques) simultanément, sans perte de qualité ni augmentation des paramètres techniques. Grâce à une architecture optimisée, il supporte plus de dix types de contrôles différents tout en maintenant une compatibilité avec d'autres modèles SDXL et des LoRA, offrant ainsi une grande flexibilité. Ses capacités d'édition incluent des outils comme la réduction de flou, la variation stylistique ou la super-résolution, permettant d'améliorer ou de transformer des images existantes avec précision. Ce modèle se distingue par sa capacité à produire des images haute résolution, comparables à des outils professionnels, tout en restant accessible et open source pour la communauté.
We design a new architecture that can support 10+ control types in condition text-to-image generation and can generate high resolution images visually comparable with midjourney. The network is based on the original ControlNet architecture, we propose two new modules to: 1 Extend the original ControlNet to support different image conditions using the same network parameter. 2 Support multiple conditions input without increasing computation offload, which is especially important for designers who want to edit image in detail, different conditions use the same condition encoder, without adding extra computations or parameters. We do thoroughly experiments on SDXL and achieve superior performance both in control ability and aesthetic score. We release the method and the model to the open source community to make everyone can enjoy it.
Inference scripts and more details can found: https://github.com/xinsir6/ControlNetPlus/tree/main
If you find it useful, please give me a star, thank you very much
SDXL ProMax version has been released!!!，Enjoy it!!!
I am sorry that because of the project's revenue and expenditure are difficult to balance, the GPU resources are assigned to other projects that are more likely to be profitable, the SD3 trainging is stopped until I find enough GPU supprt, I will try my best to find GPUs to continue training. If this brings you inconvenience, I sincerely apologize for that. I want to thank everyone who likes this project, your support is what keeps me going
Note: we put the promax model with a promax suffix in the same huggingface model repo, detailed instructions will be added later.
Following example show from 1M resolution --> 9M resolution
