Sign In

Coloring your manual drawings with Stable Diffusion

Coloring your manual drawings with Stable Diffusion

Objective

Coloring your manual drawings with Stable Diffusion and ControlNet

Environment

For this test I will use:

Your Drawings

Take a picture or scan your draw an save on your computer.

In my case I will take a picture with my phone and then I will save to Google Photos, then I go to the web https://photos.google.com/

I open with Krita (https://krita.org/it/ )

Make images in Stable Diffusion

Set the image in the ControlNet plug-in.

Set Enabled = true and set Control Type=Canny

Checkpoint: camelliamixLine_v2 (https://civitai.com/models/44195/camelliamixline)

Prompt

robot yellow and red

Negative

blurry, blurry_image, Lowres, Low_resolution, Low_picture_quality, Low_picture_anime, extra_anatomy, extra_body, extra_navel, extra_face, extra_eyes, extra_chest, extra_nipples, extra_hips, extra_arms, extra_hands, extra_fingers, extra_legs, extra_feet, extra_toe, missing_anatomy, missing_body, missing_navel, missing_face, missing_eyes, missing_chest, missing_nipples, missing_hips, missing_arms, missing_hands, missing_fingers, missing_legs, missing_feet, missing_toe, sketch, sketching, (worst quality: 2), (low quality:2), ((monochrome)), ((grayscale)), inpainting, HDR, bad_prompt_version2, jpeg artifacts, signature, watermark, text, error, missing fingers

robot yellow and red
Negative prompt: blurry, blurry_image, Lowres, Low_resolution, Low_picture_quality, Low_picture_anime, extra_anatomy, extra_body, extra_navel, extra_face, extra_eyes, extra_chest, extra_nipples, extra_hips, extra_arms, extra_hands, extra_fingers, extra_legs, extra_feet, extra_toe, missing_anatomy, missing_body, missing_navel, missing_face, missing_eyes, missing_chest, missing_nipples, missing_hips, missing_arms, missing_hands, missing_fingers, missing_legs, missing_feet, missing_toe, sketch, sketching, (worst quality: 2), (low quality:2), ((monochrome)), ((grayscale)), inpainting, HDR, bad_prompt_version2, jpeg artifacts, signature, watermark, text, error, missing fingers
Steps: 20, Sampler: Euler a, CFG scale: 7, Seed: 2620168941, Face restoration: GFPGAN, Size: 768x512, Model hash: 1bbeb9eded, Model: camelliamixLine_v2, ENSD: 31337, Token merging ratio: 0.1, ControlNet 0: "Module: canny, Model: control_v11p_sd15_canny [d14c016b], Weight: 1, Resize Mode: Crop and Resize, Low Vram: False, Processor Res: 512, Threshold A: 100, Threshold B: 200, Guidance Start: 0, Guidance End: 1, Pixel Perfect: False, Control Mode: Balanced, Hr Option: Both, Save Detected Map: True", Downcast alphas_cumprod: True, Eta: 0.5, Pad conds: True, Version: v1.8.0

I select this one...

In my case I want to remove the background.

To do this I will send the image to the ExtraTab. Set The Background Removal component

Check my article : https://civitai.com/articles/3696/stable-diffusion-a1111-streamlined-background-removal-across-multiple-images to install this component.

Final Result

I copy and paste the image with transparency in Krita

In my test I have generate a background image with stable Diffusion and pasted in another layer.

And here is the result.

You can use this method to colorize any of your quick drawings.

I hope you enjoy this simple article.

2

Comments