ControlNet v1.1 model collection

ControlNet v1.1 model supports stable diffusion 1.5 or 2.0

The stable diffusion 1.5 and stable diffusion 2.0 models are compatible, so the ControlNet v1.1 model file can also be used on stable diffusion 2.0.

This article is a different type of ControlNet model that supports SD1.5/2.0 compiled by ComfyuUI-Wiki

ControlNet v1.1 corresponding model files and downloads

Large - Larger volume from the version provided by lllyasviel

Provider: lllyasviel

Github homepage: https://github.com/lllyasviel/ControlNet-v1-1-nightly

Hugging face repository: https://huggingface.co/lllyasviel/ControlNet-v1-1/tree/main

Compatible with Stable diffusion version: stable diffusion v1.5

Model file size: 1.45 GB Large

Medium - Safetensors/FP16 medium volume, from the version provided by comfyanonymous

Provider: comfyanonymous

Huggingface warehouse address: https://huggingface.co/comfyanonymous/ControlNet-v1-1_fp16_safetensors/tree/main

Model file size: 723MB

Description: Provided by ComfyUI author huggingface repository, it has a better experience in ComfyUI and is also compatible with other UIs.

Small - Control lora Safetensors/FP16 Small size from the version provided by comfyanonymous

Provider: comfyanonymous

Huggingface warehouse address: https://huggingface.co/comfyanonymous/ControlNet-v1-1_fp16_safetensors/tree/main

Model file size: 136MB smaller

Description: Provided by ComfyUI author huggingface repository, it has a better experience in ComfyUI and is also compatible with other UIs.

ControlNet for StableDiffusion 2.1

Author: thibaud

Hugging face warehouse: https://huggingface.co/thibaud/controlnet-sd21

Compatible with Stable diffusion version: stable diffusion v2.1

The following file formats are divided into two formats: .safetensors and .ckpt. Usually, if you just want to use the corresponding model, download the .safetensors file.

controlNet 1.1 Model Overview

ControlNet 1.1 is a version updated and optimized based on ControlNet 1.0, with the same architecture. It includes all previous models and adds several new models to bring the total number to 14.

New Features and Improvements ControlNet 1.1 introduces some new features and improvements:

New soft edge: A new soft edge processing method called "SoftEdge_safe" has been added to improve the naturalness of image edges.

Preprocessor extension: Multiple preprocessors have been added, such as Canny, Depth, inpaint, etc. These preprocessors can be used for different image processing tasks.

Robustness and Quality Improvement: Versions mainly enhance the robustness of the model and the quality of the generated images.

controlNet 1.1 Application Scenario

ControlNet 1.1 can be applied to a variety of AI painting scenarios, including but not limited to:

Image repair: Use the inpaint preprocessor to fill and repair damaged or missing image parts. Edge detection: Use the Canny preprocessor to extract edge information of images and further apply to other image processing tasks. Depth map generation: Generate depth information of the image through the Depth preprocessor, which is used to create a more three-dimensional visual effect.