Applying SD 1.5 models and loras to SDXL

By NTC

sd1.5 with sdxl

Problem: I want to reuse SD 1.5 checkpoints and loras with SDXL.

Solution:

sdxl+sd1.5+lora

This shows how to load and use img2img on sdxl output with a 1.5 checkpoint and lora. Uses comfyui, based on https://github.com/SytanSD/Sytan-SDXL-ComfyUI .

Before(sdxl+refiner):

sdxl only

After (sdxl+ aniverse sd15 checkpoint + trip lora):

sdxl+sd15+lora

This lets you create SDXL lora based on sd 1.5 checkpoint + lora as the output images are 1024x1024.

  1. Install Comfy UI and Comfy UI manager https://github.com/ltdrdata/ComfyUI-Manager

  2. Download the SD XL to SD 1.5 comfy JSON and import it sd_1-5_to_sdxl_1-0.json

  3. Click “Manager” in comfyUI, then ‘Install missing custom nodes’

  4. Restart ComfyUI

  5. Install SDXL (directory: models/checkpoints)

  6. Install a custom SD 1.5 model (directory: models/checkpoints) https://civit.ai

  7. Install your loras (directory: models/loras)

  8. Restart ComfyUI

  9. Select your checkpoints

  10. Queue!