🎭 Emotion Puppeteer - For Krea2 and SDXL 🎭

Krea2 - How to use (见下文中文)

Prompting

• Describe the shape of the mouth, eyes, and eybrows

  • example: "mouth is shouting, eyes are wide open, eyebrows raised"

  • example: "mouth is frowning, eyes squinting, eyebrows scrunched"

• Include a basic emotion and a subtle emotion

  • example: "with emotions of sorrow and hopefulness"

  • example: "with a joyful but menacing expression"

• Some helpful keywords

  • 👁️ eyes wide, winking, squinting, scrunched, raised, half-lidded,

  • 👄 smirking, smiling, laughing, singing, shouting, breathing, gasping, pouting, puckering, frowning, sneering, snarling

Troubleshooting

• Problem: The emotions are weak

  • Solution: You must use a refusal reduction lora (most finetune have that lora baked in)

  • Solution: Increase image resolution

• Problem: The face is blurry / plasticy

  • Solution: Increase image resolution (2 megapixel recommended if the face is small in the image)

  • Solution: Decrease the lora's strength (0.7 to 1.0 recommended)

• Question: Can I use this with character loras?

  • Answer: It depends on the lora. Some loras have very inflexible faces. If this lora changes the face identity, turn down the strength.

Krea2 - 如何使用

提示词编写

• 描述嘴巴、眼睛和眉毛的形态

  • 示例：“嘴巴在喊叫，眼睛睁得很大，眉毛扬起”

  • 示例：“嘴角下撇，眼睛眯起，眉毛紧皱”

• 同时包含一种基本情绪和一种细微情绪

  • 示例：“带有悲伤与希冀的情绪”

  • 示例：“带着快乐却暗藏威胁的表情”

• 一些有用的关键词

  • 👁️ 眼睛睁大、眨眼、眯眼、紧皱、扬起、半垂眼睑

  • 👄 坏笑、微笑、大笑、唱歌、喊叫、呼吸、倒吸气、撅嘴、噘起嘴唇、嘴角下撇、冷笑、龇牙咆哮

故障排除

• 问题：情绪表现很弱

  • 解决：必须使用降低拒绝倾向的 LoRA（refusal reduction LoRA；大多数微调模型已内置该 LoRA）

  • 解决：提高图像分辨率

• 问题：脸部模糊 / 有塑料感

  • 解决：提高图像分辨率（如果脸部在画面中所占比例很小，建议 2 百万像素）

  • 解决：降低该 LoRA 的强度（建议 0.7 到 1.0）

• 问题：可以和角色 LoRA 一起使用吗？

  • 回答：取决于该 LoRA。有些 LoRA 的脸部非常固定、可调整空间很小。如果这个 LoRA 改变了角色面部特征，请降低强度。

SDXL lora info

How to use

• Use this visual cheats sheet showing possible 96 eye-mouth combinations

  • 👁️ grieving, glaring, gazing, seething, beaming, eyes wide, winking, squinting

  • 👄 frowning, pouting, smiling, laughing, singing, screaming, sneering, snarling, grimacing, breathing, gasping, puckering, resting, relaxing

• Add one more 👁️ words and/or 👄 mouth words to your prompt

• For a stronger effect, increase the weight of the 👁️ / 👄 words, and/or increase the lora weight up to 1.2

Suggestions

• Best for realism. Most training images were photos

• For character consistency, use a combination of controlnets

• Keep your negative prompt short

Other optional prompts

These words were all used in training, but their effect is weaker:

gnashing, cackling, flirting, glowering, leering, kissing, shrieking, shouting, smooching, sniffling, threatening, tisking, taunting, vomiting, wincing, yelling, accusatory, agony, amused, angry, anguish, annoyed, appalled, approving, aroused, ashamed, astonished, awestruck, bemused, bewildered, bitter, blame, certain, cheerful, cocky, concentrating, concerned, confident, confusion, contempt, contemptuous, content, crazed, crestfallen, crushed, curious, dazed, defiant, delighted, depressed, despairing, determined, disappointed, disapproving, disbelief, disgusted, dismayed, distrust, disturbed, dominant, ecstatic, embarrassed, enraged, envious, euphoric, evil grin, exasperated, excited, flirtatious, frightened, frustrated, furious, gentle, gleeful, happily, happy, hate, heartache, heartbroken, helpless, horrified, hurt, hurting, impatient, impressed, in love, incredulous, insane, insolent, intrigued, jubilant, judgemental, loathing, lustful, merry, misery, mistrust, mocking, nauseated, nonplussed, outraged, overjoyed, passionate, perplexed, petulant, pissed off, pitying, playful, puzzled, regretful, repulsed, revolted, rude, sad, scared, scorn, seductive, seizure, shaken, shocked, sickened, silenced, skeptical, smarmy, sour, startled, stunned, submissive, sultry, surprised, suspicious, terrified, thinking, ticked off, uncertain, unconvinced, unsettled, vexed, violent, wonder