ghost
Sign In

[XL + 1.5] [alpha] Concept 3D Render | 3D光效

172
1.3k
5.8k
30
Updated: Jan 5, 2024
concept3dfilmskinlighteffects
Verified:
SafeTensor
Type
LoRA
Stats
751
3,165
Reviews
Published
Jan 2, 2024
Base Model
SD 1.5
Training
Steps: 20
Epochs: 4
Usage Tips
Clip Skip: 2
Strength: 0.5
Trigger Words
Eve3D
lens_flare
chromatic_aberration
film_grain
subsurface_scattering
high_contrast
caustics
dim_lighting
Hash
AutoV2
2CD02456EC

TL;DR | 太长不看

Trigger word is Eve3D. Use img2img for upscaling. Use ADetailer for different face. Don't use AntiBurn. Recommended weight: XL checkpoints at 0.4 ~ 0.6, 1.5 - realistic/3D checkpoints at 0.6 or 0.7 and 1.5 - anime checkpoints at <=0.5. 
触发词:Eve3D。使用图生图来放大图片获得细节。使用ADetailer 来更换脸型。不要使用AntiBurn。建议LoRA权重为:[XL] 0.4!0.6, [1.5 - 写实/3D] 0.6/0.7, [1.5 - 二次元] <=0.5。
Changelog at the end. 更新日志放在最底部。

Intro | 简介

This LoRA spices up the skin / lighting / image vibe. In simple word it adds a dreamy tone to the final image. This is currently still in the alpha test. It fixes the character's face (in 3D/realistic checkpoints) or draws towards 3D feel (in most anime checkpoints). Use ADetailer or LoRA Block Weight to reduce this issue.

此为增强皮肤 / 光照 / 氛围的LoRA,可用于不同风格的大模型。简单来说使用后会使图片产生一种朦胧梦幻的3D渲染质感,若在二次元模型中使用,则主要表现为光感增强。LoRA目前仍为早期测试阶段,在3D和写实模型中对脸型影响较大,在二次元模型中会显著增强立体感。请使用ADetailer 来调整脸部。

1.5Detail | 训练细节(1.5)

The intention was to train this LoRA to understand these 3D concepts better:

lens flare / chromatic aberration / film grain / subsurface scattering / caustics

In order to achieve that, I have increased the network_dim to 128, and image resolution to 1024*1536. Thanks to NeoClassicalRibbon for their insights on training Hipoly 3D Model LoRA.

The result was pretty acceptable. In my testing this LoRA indeed catches some of the effects mentioned above. I did a performance test on most of the checkpoints I constantly use, you can download the performance spreadsheet HERE.

此LoRA的目的是为了微调以下3D渲染概念:

镜头光晕 / 边缘色散 / 胶片颗粒 / 次表面散射 / 焦散

为了令模型学习到这种程度的细节,我将LoRA 网络分辨率上调至128(经过两个版本测试的决定),同时使用1024*1536的训练图像分辨率。训练参考了NeoClassicalRibbon 所编写的 insight on training Hipoly 3D Model LoRA

LoRA得出的结果目前达到了我的基本预期,在我的测试中它对于部分上述概念拥有了更好的理解能力。你可以在这里下载查看测试图表。

Usage Guide | 使用说明

1. Activating | 启用

LoRA weight: 0.6-0.8 (below 0.5 for anime checkpoints)

Main trigger: Eve3D,

Then pick: lens_flare, chromatic_aberration, film_grain, subsurface_scattering, high_contrast, caustics.

Not all of them are required, experiment as you see fit. I personally like to keep them all.

For this LoRA you don't really need LBW to control weight. Keep in mind that if you wish to generate different faces, you're better off using ADetailer.

Images from text2img will most definitely look blurry and "broken". It's fine, a lot of checkpoints have this problem even without any LoRA. Think of it as a way of laying down the basic composition. All the details will appear after upscaling.

使用0.6-0.8的LoRA权重,在二次元模型中使用时可以调低至0.5或以下。

主要触发词为:Eve3D。

然后,你可以选择下列提示词

lens_flare, chromatic_aberration, film_grain, subsurface_scattering, dim_lighting, high_contrast, caustics,

不是所有提示词都需要填写,只是我喜欢全部加入。

这个LoRA不一定需要LBW控制区块。在文生图时,出来的结果可能看上去像是模糊、损坏的图片,尤其是生成全身图时。对于大部分大模型来说,这是正常现象(因为训练使用的图片分辨率远超1.5文生图所能使用的),只需要通过图生图即可得到正确的结果。

2. Upscaling | 扩大图片

Use img2img upscale, if you don't, your image will look blurry and bad, and all of the details won't kick in. Below are parameters I use.

text2img Steps:32 | Sampler: DPM++ 2M Karras or Eular a | Resolution: 512*768 | CFG: 7 | Hires. fix and Refiner: OFF | Anti Burn: OFF

img2img Steps:48 | Sampler: DPM++ 2M Karras or Eular a | Resolution: 1024*1536 (or higher) | CFG: 7 | Denoising strength: <=0.5 | Hires. fix and Refiner: OFF | Anti Burn: OFF

请使用图生图来放大图片和还原细节。以下是我习惯使用的参数,

文生图 步数:32 | 采样器: DPM++ 2M Karras or Eular a | 分辨率: 512*768 | CFG: 7 | Hires. fix and Refiner: OFF | Anti Burn: OFF

图生图 步数:48 | 采样器: DPM++ 2M Karras or Eular a | 分辨率: 1024*1536 (or higher) | CFG: 7 | 重绘幅度: <=0.5 | Hires. fix and Refiner: OFF | Anti Burn: OFF

Limitation | 局限

1.5 LoRA

1. LoRA have strong influence on face. Well at least it's not ugly,

2. Film grain doesn't work as intended. Some checkpoints will have hard time understanding these concepts. Some checkpoints misplace "film_grain" as dust on lens. In general the film grain effect is very subtle,

3. Text2img quality seems "degraded". Therefore img2img upscale is necessary for this LoRA to work,

4. The lens flare effect only occurs under extreme/strong lighting,

5. Using "back_lighting" in prompt will sometimes result in character turning back against camera, (problem might be within the prompt itself)

6. Have room for captions/images improvements.

At current state of this LoRA I would suggest you use this LoRA on anime checkpoints.

XL LoRA

1. caustic kind of doesn't work. Checkpoints tend to misplace caustic effect as "hologram on clothes",

2. Minor overfitting issue, same as 1.5 version.

Changelog | 更新日志

  • XL_v0.3: First upload of XL1.0 LoRA.

  • v0.4: Minor improvement update. Increased repeats, caption improvement.

  • v0.3: Initial Civitai upload. Manual caption correction, removed some unnecessary images, increased network_dim to 128, reduced lr and unet_lr.

  • v0.1 and v0.2: Never published. Had serious overfitting issue.


If you find this LoRA useful, please share what you've made with it. I would love to see how it performs on different environments. Please consider leaving a like.