Table of Contents

1. Introduction

2. Stable Diffusion Basics

3. Video Generation

4. Tools and Utilities

5. Training

6. LoRAs

7. Textual Inversion

8. Prompt Engineering

9. Camera Angles, Distance, and Lighting

10. AI Image/Model Repositories

11. Alternative UIs

12. Cloud-based Alternatives

13. Live Image Generation

14. Academic Papers

15. Conclusion

Introduction

This guide provides a curated list of resources for Stable Diffusion and AI image generation. Whether you're a beginner or an experienced user, you'll find valuable information to enhance your AI art creation process.

Stable Diffusion Basics

Learn the fundamentals of Stable Diffusion:

• Understanding Samplers - Comprehensive guide to different sampling methods in Stable Diffusion.
  [https://stable-diffusion-art.com/samplers/]

• Insights for Intermediates - Tips on crafting desired images using A1111 interface.
  [https://civitai.com/articles/983/insights-for-intermediates-how-to-craft-the-images-you-want-with-a1111]

• Settings Recommendations for Novices - Beginner-friendly guide to txt2img settings.
  [https://civitai.com/articles/904/settings-recommendations-for-novices-a-guide-for-understanding-the-settings-of-txt2img]

• Image-to-Image with Stable Diffusion - Overview of img2img technique.
  [https://dataconomy.com/2023/08/28/img2img-stable-diffusion-image-to-image/]

Video Generation

Explore video generation with AI:

• Guide to Video2Video - Tutorial on creating videos using AI.
  [https://civitai.com/articles/1841/guide-video2video]

Tools and Utilities

Useful tools to enhance your Stable Diffusion workflow:

• SearchCivitAI - A powerful search engine for CivitAI resources.
  [https://searchcivitai.com/]

Training

Resources for training your own models:

Scripts / Tools

• Kohya_SS - Popular training script for Stable Diffusion.
  [https://github.com/bmaltais/kohya_ss]

• Dreambooth Extension for Stable-Diffusion-WebUI - WebUI extension for Dreambooth training.
  [https://github.com/d8ahazard/sd_dreambooth_extension]

Information / How-To

• Differences between training Methods - YouTube video from koiboy explaining various training methods.
  [https://youtu.be/dVjMiJsuR5o?si=7yeU72a5uZj4f4en]

• Fine-tuning benchmark from Corridor Digital - Comprehensive benchmark for fine-tuning methods.
  [https://docs.google.com/spreadsheets/d/1Ycr_gUMnzykn8Xe5oA4C5u-e4NVcgBgedXY6WujWK50/edit?usp=sharing]

• Stable Diffusion Cheat-Sheet - Quick reference guide for Stable Diffusion.
  [https://supagruen.github.io/StableDiffusion-CheatSheet/]

LoRAs

Understanding and working with LoRAs (Low-Rank Adaptations):

• Low-rank Adaptation for Fast Text-to-Image Diffusion Fine-tuning - Original paper on LoRA technique.
  [https://arxiv.org/abs/2106.09685]

• Understanding LoRA Training - A three-part series on LoRA training on medium.com:

  • Part 1: Learning Rate Schedulers, Network Dimension and Alpha
    [https://medium.com/@dreamsarereal/understanding-lora-training-part-1-learning-rate-schedulers-network-dimension-and-alpha-c88a8658beb7]

  • Part 2: Offset Noise, Epochs and Repeats
    [https://medium.com/@dreamsarereal/understanding-lora-training-part-2-offset-noise-epochs-and-repeats-c68b86c69da8]

  • Part 3: Block Weights
    [https://medium.com/@dreamsarereal/understanding-lora-training-part-3-block-weights-967711816280]

Prompt Engineering

Master the art of crafting effective prompts:

• Stable Diffusion Prompts Guide - Comprehensive guide to writing prompts.
  [https://aituts.com/stable-diffusion-prompts]

• Hackr.io's Stable Diffusion Prompts Guide - Another perspective on prompt engineering.
  [https://hackr.io/blog/stable-diffusion-prompts]

Camera Angles, Distance, and Lighting

Control the visual aspects of your generated images:

• Stable Diffusion Camera Distance and Angles - Controlling camera distance and angles.
  [https://medium.com/stablediffusion/stable-diffusion-enables-the-control-of-camera-distance-and-angles-using-prompts-53ca4d1c9981]

• The Ultimate Stable Diffusion Camera Angle Prompts Guide - A comprehensive guide on controlling camera angles.
  [https://animegenius.live3d.io/tutorial/the-ultimate-stable-diffusion-camera-angle-prompts-guide]

• SDXL Guide to Camera Framing and Angle - A guide on controlling the view for XL models
  [https://weirdwonderfulai.art/resources/sdxl-guide-to-camera-framing-and-angle/]

• Discover How Camera Positions Can Elevate Your AI Art and Generative AI Storytelling
  [https://unimatrixz.com/blog/latent-space-camera-positions/]

AI Image/Model Repositories

Find inspiration and resources:

• CivitAI - Large repository of AI models and images.

• PromptHero - Collection of AI models and prompts.

• Tensor.art - AI art community and resources.

• MajinAI.art - AI art platform and community.

• Holara.ai - AI model and image repository.

Alternative UIs

Explore different user interfaces for Stable Diffusion:

Tools to Install multiple UIs

• Stability Matrix - Manage multiple Stable Diffusion UIs.
  [https://lykos.ai/]

• pinokio - Another tool for managing Stable Diffusion installations.
  [https://pinokio.computer/]

Manually Install UIs

• SD.Next - Fork of AUTOMATIC1111's Web UI with additional features.
  [https://github.com/vladmandic/automatic]

• Stable Diffusion Web UI-UX - Enhanced user experience for Stable Diffusion Web UI.
  [https://github.com/anapnoe/stable-diffusion-webui-ux]

• InvokeAI - Stable Diffusion toolkit for creators.
  [https://github.com/invoke-ai/InvokeAI]

• Fooocus - User-friendly interface for Stable Diffusion.
  [https://github.com/lllyasviel/Fooocus]

• RuinedFooocus - Fork of Fooocus with additional features.
  [https://github.com/runew0lf/RuinedFooocus]

• ComfyUI - Node-based UI for Stable Diffusion.
  [https://github.com/comfyanonymous/ComfyUI]

  • Beginner's Guide to ComfyUI - Tutorial for getting started with ComfyUI.
    [https://comfyanonymous.github.io/ComfyUI_tutorial_vn/]

• StableSwarmUI - Beginner-friendly interface to ComfyUI.
  [https://github.com/Stability-AI/StableSwarmUI]

• EasyDiffusion - User-friendly Stable Diffusion interface.
  [https://github.com/easydiffusion/easydiffusion]

Cloud-based Alternatives

Access Stable Diffusion without local installation:

• Leonardo AI - AI-powered creative platform.
  [https://leonardo.ai/]

• Mage.space - Cloud-based AI image generation.
  [https://www.mage.space/]

• Playground AI - AI image creation and editing platform.
  [https://playground.com/]

Live Image Generation

Create AI art in real-time:

• Krea - AI-powered creative tool for real-time image generation.
  [https://www.krea.ai/home]

Academic Papers

Dive deeper into the technology behind AI image generation:

• Personalizing Text-to-Image Generation via Aesthetic Gradients - Research on personalizing text-to-image models.
  [https://arxiv.org/abs/2209.12330]

• An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion - Study on Textual Inversion technique.
  [https://arxiv.org/pdf/2208.01618]

Conclusion

This guide provides a comprehensive overview of resources for Stable Diffusion and AI image generation. Whether you're just starting or looking to advance your skills, these tools and references will help you navigate the exciting world of AI-generated art. Remember to experiment, stay curious, and keep learning as this field continues to evolve rapidly.