anime detailer xl lora
by Linaqruf
Open source · 4k downloads · 61 likes
2.2
(61 reviews)ImageAPI & LocalAbout
Anime Detailer XL LoRA is an innovative LoRA model designed to enhance anime image generations with Animagine XL 2.0. It allows for fine-tuning the level of detail in illustrations, offering precise control between highly detailed renders and more stylized or abstract versions. Ideal for artists and creators looking to refine their works, it excels at improving textures, outlines, and visual elements while preserving the anime aesthetic. This model stands out for its flexibility, enabling dynamic adjustments to the rendering based on needs, whether for realistic illustrations or more minimalist designs. Its intuitive approach makes it a valuable tool for exploring different artistic interpretations without compromising the overall coherence of the image.
Documentation
Anime Detailer XL LoRA
Overview
Anime Detailer XL LoRA is a cutting-edge LoRA adapter designed to work alongside Animagine XL 2.0. This unique model specializes in concept modulation, enabling users to adjust the level of detail in generated anime-style images. By manipulating a concept slider, users can create images ranging from highly detailed to more abstract representations.
Model Details
- Developed by: Linaqruf
- Model type: LoRA adapter for Stable Diffusion XL
- Model Description: This adapter is a concept slider, allowing users to control the level of detail in anime-themed images. The closer the slider is set to 2, the more detailed the result; closer to -2, the less detailed. It is a versatile tool for artists and creators seeking various artistic expressions within anime imagery.
- License: CreativeML Open RAIL++-M License
- Finetuned from model: Animagine XL 2.0
🧨 Diffusers Installation
Ensure the installation of the latest diffusers library, along with other essential packages:
Bash
pip install diffusers --upgrade
pip install transformers accelerate safetensors
The following Python script demonstrates how to utilize the LoRA with Animagine XL 2.0. The default scheduler is EulerAncestralDiscreteScheduler, but it can be explicitly defined for clarity.
Py
import torch
from diffusers import (
StableDiffusionXLPipeline,
EulerAncestralDiscreteScheduler,
AutoencoderKL
)
# Initialize LoRA model and weights
lora_model_id = "Linaqruf/anime-detailer-xl-lora"
lora_filename = "anime-detailer-xl.safetensors"
lora_scale_slider = 2 # -2 for less detailed result
# Load VAE component
vae = AutoencoderKL.from_pretrained(
"madebyollin/sdxl-vae-fp16-fix",
torch_dtype=torch.float16
)
# Configure the pipeline
pipe = StableDiffusionXLPipeline.from_pretrained(
"Linaqruf/animagine-xl-2.0",
vae=vae,
torch_dtype=torch.float16,
use_safetensors=True,
variant="fp16"
)
pipe.scheduler = EulerAncestralDiscreteScheduler.from_config(pipe.scheduler.config)
pipe.to('cuda')
# Load and fuse LoRA weights
pipe.load_lora_weights(lora_model_id, weight_name=lora_filename)
pipe.fuse_lora(lora_scale=lora_scale_slider)
# Define prompts and generate image
prompt = "face focus, cute, masterpiece, best quality, 1girl, green hair, sweater, looking at viewer, upper body, beanie, outdoors, night, turtleneck"
negative_prompt = "lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry"
image = pipe(
prompt,
negative_prompt=negative_prompt,
width=1024,
height=1024,
guidance_scale=12,
num_inference_steps=50
).images[0]
# Unfuse LoRA before saving the image
pipe.unfuse_lora()
image.save("anime_girl.png")
Acknowledgements
Our project has been enriched by the following significant works:
- Erasing Concepts from Diffusion Models by Rohit Gandikota et al.
- LECO by p1atdev.
- AI Toolkit by Ostris.
Capabilities & Tags
diffuserstext-to-imagestable-diffusionlorasafetensorsstable-diffusion-xlen
Links & Resources