LTX-2.3 Whisper & Soft-Spoken Audio LoRA
Base model: LTX-2.3 · Type: Audio-style LoRA · Rank: 32
---
## What this does
LTX-2.3 can generate dialogue, multi-speaker scenes, and full dynamic range audio including screaming — but it cannot whisper. This LoRA adds two quiet vocal registers to the model:
- Whispering — devoiced, breathy, close-mic delivery
- Soft-spoken — voiced but low-volume, intimate, relaxed
The LoRA targets only the three attention modules that write to the audio branch audio_attn1, audio_attn2, video_to_audio_attn). Video output is provably unchanged — no visual fighting, no style drift.
---
## Usage
Load at strength 1.0. The register is controlled entirely by the manner keyword in your prompt — no special strength tuning needed.
### Trigger words (none, use natural language)
| Whispering | (woman, whispering) | (man, whispering quietly) |
| Soft-spoken | (woman, speaking softly) | (man, speaking softly) |
> Note: Male whisper may requires the extra word quietly to tip the model over. (man, whispering) alone produces soft-spoken, not true whisper.
### Prompt format
Follow the LTX-2.3 dialogue caption style:
```
a [scene description], ([gender], [manner]): "[what they say]", intimate ASMR
```
Examples:
```
a woman sitting close to a microphone in warm dim lighting, (woman, whispering): "close your eyes and listen"
a man at a desk late at night, (man, speaking softly): "I've been thinking about this all day"
a woman doing a skincare routine, (woman, whispering quietly): "this is my favourite step"
```
### Without manner keywords
Using the LoRA without any manner keyword defaults to soft-spoken — a subtle volume-softening effect on whatever the base model would have generated. Useful as a gentle "quieter audio" modifier.
---
## What it can't do
- No intra-clip register mixing. You can't have one character whisper and another speak normally in the same clip. The register applies to the whole generation. For mixed-register dialogue, generate each part separately and cut them together.
- No magic above the vocoder ceiling. The audio chain passes through a mel spectrogram bottleneck. Breathy whisper HF energy gets partially smoothed. Expect intimate and quiet, not studio-crisp ASMR.
- Video is untouched by design. If you want the visuals to also feel ASMR (soft lighting, close-up framing), describe that in the scene prompt — the LoRA won't help or hurt.
---
## Training details
| | |
|---|---|
| Base model | LTX-2.3 dev |
| Steps | 2000 |
| Rank / Alpha | 32 / 32 |
| Target modules | audio_attn1, audio_attn2, video_to_audio_attn |
| Training resolution | 192×192, 97 frames (~4s @ 24fps) |
| Dataset | 74 clips, 8 voices (4F / 4M), 2 registers each |
Clips were 4-second segments sourced from ASMR content across 8 speakers — 4 female (2 soft-spoken, 2 whisper) and 4 male (2 soft-spoken, 2 whisper). Captions used Whisper ASR transcription in (gender, manner): "transcript", intimate ASMR format.