Sign In

Game: Let ChatGPT pick and use LoRAs

3

Jan 18, 2025

(Updated: 5 months ago)

generation guide
Game: Let ChatGPT pick and use LoRAs

... without really telling it that's what you're doing.

Step 1 - Random LoRAs

Ask ChatGPT to "choose four random words", it'll produce something like this:

Sure! Here are four random words:  

1. **Lantern**  
2. **Ripple**  
3. **Velvet**  
4. **Echo**  

For each word, go to https://civitai.com/models and search for the word (my searches were SFW, everything R and above was turned off). Filter the results by the base model you plan to use, in my case I chose Flux.1 D. Also filter by type as LoRA and sort by Relevancy. Choose the first LoRA that appears in the list.

In this case, the word "ripple" returned no results, so I had to ask ChatGPT for a replacement, "ripple is unavailable, choose a replacement word for ripple":

Sure! Here's a replacement for "Ripple":

**Whisper**

This resulted in selecting these four LoRAS:

  1. https://civitai.com/models/695936/ornate-lantern

  2. https://civitai.com/models/770117/whisperaudiosasmr (this was the second one in the list, the first wasn't usable on my machine)

  3. https://civitai.com/models/599757/velvets-mythic-fantasy-styles-or-flux-pony

  4. https://civitai.com/models/1119218/echoes-of-kinship

Step 2 - Random Values

Ask ChatGPT to "choose 4 random numbers between 0.2 and 1.0". These will be the weights you use for your LoRAs:

Here are four random numbers between 0.2 and 1.0:

1. 0.78  
2. 0.43  
3. 0.95  
4. 0.56  

Next ask it to "give me a random 32-bit integer". This will be the seed:

Here is a random 32-bit integer:  

**1,274,628,349**

Next ask it for "a random number between 24 and 40". This is the number of steps. (Seemed like a good range for flux).

Here is a random number between 24 and 40:  

**33**

Finally ask it for "a random number between 2.0 and 6.0". This is the CFG scale.

Here is a random number between 2.0 and 6.0:

**4.27**

Plug all these values into your generator. Now we'll need a prompt. For the LoRAs we're ignoring specific trigger words. Sometimes these will actually coincidentally coincide with the prompt, but I think for this experiment it doesn't matter too much. The selected LoRA will still impact the image, even if not in the way it was intended.

Step 3 - Have it write a prompt via a short story

Ask ChatGPT to "write a short story":

In a quiet village nestled at the edge of a dense forest, there was an old lantern that had been passed down through generations. It was said that the lantern held a secret: it could capture the whispers of the wind and the songs of forgotten dreams.

One evening, a young woman named Elara found herself wandering through the forest, troubled by a restless heart. The cool evening air kissed her skin as the sound of her footsteps seemed to fade beneath the weight of her thoughts. The deeper she ventured into the woods, the more she felt the weight of something ancient surrounding her.

Suddenly, she stumbled upon a small clearing where the lantern stood, glowing faintly. Its soft light beckoned her, and Elara felt an inexplicable pull to it. She reached out and took the lantern in her hands, and as she did, a strange sensation washed over her. A soft whisper, barely audible, seemed to drift through the air. It was the wind, yes, but it carried something more—words, promises, and long-lost memories.

Curious, Elara sat on a nearby stone and listened. The whispers swirled around her, as if the forest itself was speaking to her heart. Each word brought clarity to the questions that had haunted her: about love, purpose, and the fleeting nature of time. The lantern's glow seemed to pulse in rhythm with her heartbeat, guiding her toward understanding.

As dawn broke and the first light of day touched the earth, the whispers faded. Elara rose, the lantern now dimming in her hands. But she was no longer the same. She had found peace in the echo of the forest's secrets and knew that some things—like the whisper of the wind—could never truly be understood, only embraced.

That's good, but a little long and could be more focused on a single image, so now ask it to: "turn that into a briefer description of a visual scene describing an outstanding event of the story".

In the heart of a quiet forest clearing, a young woman named Elara stands holding an ancient lantern, its faint glow casting a soft light on her face. Around her, the air ripples with a mysterious energy as whispers, barely audible, swirl through the trees. The lantern pulses in rhythm with her heartbeat, the forest alive with echoes of forgotten dreams. As dawn's first light breaks through the canopy, the whispers fade, leaving Elara standing in peaceful silence, a quiet understanding settling in her heart. The moment feels timeless, as if the forest itself has shared its secrets with her.

That's it, there's the prompt. Plug that in and generate the image.

Step 4 - Profit?

The generated image is here: https://civitai.com/images/52453529

I suppose I shouldn't be surprised that this resulted in a fantasy style image. But it was still a fun experiment. It's probably not really anything new at this point, I'm sure others have done similar things already. Still it was fun and I think I'll be making a collection of them to see if anything else interesting turns up. If you have any recommendations for making this more interesting, please let me know. Or if you follow a similar process that results in something nice, please share it and I will add it to a collection. Perhaps eventually I'll train a LoRA on the results and then see what that produces!

3