ghost
Sign In

AlbedoBase XL

6.9k
99k
4.0m
1.3k
Verified:
SafeTensor
Type
Checkpoint Merge
Stats
1,646
16,962
Reviews
Published
Sep 26, 2024
Base Model
SDXL 1.0
Hash
AutoV2
D7D94FD192


If you've found value in the model, please consider offering your support. Your contribution will be devoted entirely to advancing the SDXL community.

🙋🏼‍♂️ join us (deviantart)|ㅤ 🛒 purchaseㅤ |ㅤ 🌱 donate


AlbedoBase XL (SFW&NSFW)

The refiner is unnecessary, and VAE is included.


GOAL

Stable Diffusion XL has 3.5 billion parameters (excluding the Refiner), which is about 3.6 times more than the SD v1.5 version. I believe that this is not just a number, but a number that can lead to a significant improvement in performance.

It has been a while since we realized that the overall performance of SD v1.5 has improved beyond imagination thanks to the explosive contributions of our community. Therefore, I am working on completing this AlbedoBase XL model in order to optimally reproduce the performance improvement that occurred in v1.5 in this XL version as well.

My goal is to directly test the performance of all Checkpoints and LoRAs that are publicly uploaded to Civitai, and merge only the resources that are judged to be optimal after passing through several filters. This will surpass the performance of image-generating AI of companies such as Midjourney.

As of now, AlbedoBase XL v1.3 has merged exactly 141 selected checkpoints and 251 LoRAs.

  • V3 mini has merged (v2.1 + 10 checkpoints)


LOG

v3-mini

I sincerely apologize for keeping you waiting for such a long time.

I’ve been dealing with some personal matters, and while working on the new version, I also faced health issues. Even as I write this, I am still struggling with these challenges.

I felt it wouldn’t be enough to just provide a brief update, so I kindly ask for your understanding as I share this more detailed message.

Since the release of version 2.0, I have been dedicating myself to studying deep learning independently. I don’t have a formal degree, and apart from a modest aptitude for programming, only my background is in the arts. As a result, I lack the mathematical and scientific foundation to achieve significant breakthroughs, given the time and effort I’ve invested. Despite this, the experience of immersing myself in this self-directed study and research has been an invaluable treasure in my life.

Recently, I stumbled upon an idea that could potentially be a significant breakthrough. After reworking hundreds of formulas and methods since version 2.0, I managed to develop a rather intriguing and successful algorithm. The model merging process was based on SDXL1.0 and SD1.5, along with other carefully curated models. These were categorized into five primary classifications: “ANIME,” “REALISM,” “ARTISTIC,” “NSFW,” and “BASE,” and fed into the merging algorithm as datasets. This approach has resulted in some fascinating outcomes.

However, as challenging as the algorithm development was, nothing has been as daunting as the performance testing phase. My physical and mental health deteriorated significantly during this period, to the point where I realized I couldn’t continue this work on my own. This is what ultimately led me to decide to release this version.

And now, I am thrilled to announce the release of the much-anticipated AlbedoBaseXL V3 Mini version. While this model is a smaller-scale merge, it is not limited to any specific area and performs remarkably well across various domains. It has the potential to serve as a new base model for SDXL1.0. (For reference, my merging algorithm is not a “linear merging,” so it can essentially be considered a new fine-tuned model.)

This model, along with the existing AlbedoBase models, is versatile and surpasses all previous versions in every aspect. (The NSFW content, while not extreme, offers a broader range of expression compared to previous versions like v2.1. A dedicated NSFW merging model will be released in the future.)

On another note, I’ve noticed that many shared models have recently begun to adopt licenses that prohibit merging or external commercialization. This has been a disappointment, as it has prevented me from using some truly excellent models for merging.

I would like to express my heartfelt gratitude to the model developers who have provided free licenses, allowing their high-quality models—products of considerable time and effort—to be used for merging.

I’ll be back soon.

I eagerly look forward to your performance tests across a wide range of areas, including ANIME, REALISM, ARTISTIC, 2.5D, 3D, and NSFW.

As model developers, we only plant the seeds. It is ultimately you, the model users and artists, who cultivate them and bring forth the flowers and fruits.

Thank you, as always.


For those who wish to support my work with a small financial contribution, please consider using the links below. I am currently unable to secure employment and face an uncertain future regarding my livelihood.

🌱 donate

The spec grid(380.5 MB): download


v2.1
Re-merge and adjust v0.1 to 2.0 using new merging algorithm and formula.

The spec grid(424.5 MB): download

v2.0

I'd like to thank everyone who helped me on the AlbedoBase XL Pre side. Without you guys, the release date would probably have been much later. Thank you so much!

  • I have written a custom script to converge the existing AlbedoBase XL models into one. Intricately aligning the row and column weights of all U-NET and CLIP blocks according to a unique formula of mine.

  • If you encounter a bug in image generation (if nothing is generated), please switch to CLIP SKIP 2 or modify the prompt slightly! There may be combinations of prompts that CLIP does not recognize. In that case, you can change the order of words, use different words, or, most simply, change the CLIP SKIP. I will gradually work on resolving these issues in the future like v1.3.

The spec grid(403.5 MB): download

v1.3

  • In order to illustrate the quality associated with the model's randomness, I standardized the seed value at '9' for all showcase images intended for sampling and proceeded with their immediate generation.

  • Especially with this version, due to the significant impact of negative prompts, leaving the negative prompt field empty is likely to produce the nice quality.

The spec grid(438.7 MB): download

  • As you can see, as the number of Steps increases, it becomes available for all samplers, and the quality also improves.

  • Due to the effect of the LoRA I developed and merged, as described below, using sentence-form prompts rather than tag (a list of words) prompts is directly related to improving quality.

  • I merged 45 checkpoints and 7 LoRAs. After that, I merged AlbedoBase v0.4 and v0.3 in order, less than 0~5%, to reawaken the diluted merged models that had become outdated. 

  • Among the 7 LoRAs, one is created by me. It involves analyzing and annotating captions for a total of 174 high-quality pictorial photos using GPT4-V. Merging this LoRA resulted in astonishingly clear images and an impressively excellent understanding of prompts.

  • My self-created LoRAs are exclusively available for purchase to my Ko-fi supporters at the Creative level or higher.


v1.2

  • Merged the 22 latest checkpoints.

The spec grid(565.6 MB): download

v1.1

  • Stabilized.

  • More detailed.

  • If you think you are an advanced user, I recommend version 1.0. If version 1.0 finds the right settings, it can output much more vivid works.

The spec grid(349.7 MB): download

v1.0

  • Merged 106 LoRAs.

  • Merged 19 Checkpoints.

  1. The model can produce different results depending on the settings you choose, so it's important to check the spec grid before using it.

    • I have found that using a few specific negative prompts can help to resolve the issue of asymmetrical eyes or pixelated images. The Spec Grid may vary depending on your CPU or GPU device, so please use it as a general reference. Experiment with a few negative prompts to improve the quality(ex; strabismus). I found that it is difficult to satisfy all settings equally as the number of merged LoRA increases. However, I would like you to focus on this advantage in version 1.0, as it can produce works of amazing quality in various aspects with the right settings. I will be back with a more stable version in the future.

  2. You can find useful setting values in the showcase or by searching for others.

  3. As always, it's best to leave the negative prompt blank for the best results.

  4. This v1.0 was a lot of work, so I'm taking a break for a bit. I hope you'll enjoy using the model, and if you merge it, please share it in Civitai for free. That way, we can all keep improving it.

The spec grid(479.4 MB): download

v0.4

  • Merged 132 LoRAs.

  • Merged 4 Checkpoints.

The spec grid: download

v0.3

  • Improved in all of the samplers.

  • Achieved lifelike realism.

  • Stabilized.

The spec grid: download

v0.2

  • Significant improvements in clarity and detailing.

  • Improved hand and foot implementation.

  • Major aesthetic improvements; composition, abstraction, flow, light and color, etc.

v0.1

  • After appropriate fine-tuning on the SDXL1.0 model, meticulously and purposefully merge over 40+ high-quality models publicly available on Civitai.

  • Testing has primarily focused on ensuring maximum quality with the minimum number of prompt tokens, and it has not been confirmed how much the quality can improve when using a large number of tokens. (Please conduct your own tests and share the results)

  • Typically, the most beautiful results are achieved at the midpoint between reality and animation.

  • Nevertheless, when using an appropriate prompt, there is generally nothing it cannot express. (I assert that it possesses abundant value as a foundational model that surpasses others in merging. However, please keep in mind that this is currently v0.1)