Duplex Anima - 2x2b MoE

Whats new

beta:

Updated the workflow and custom node (both need to be updated).

Thanks to user Hysocs for the tip regarding the Anima timestep_sampling parameter (changed to uniform).

The model is now slightly better at understanding natural language prompting; the default style for natural prompting has improved in some areas but not others, and there are some issues with anatomy—the model is still undergoing training (currently trained on 150,000 images).

Description

an attempt to transition Anime base to an MoE architecture—two 2B models, each trained on a specific noise-reduction range.

The model handles natural language prompting quite well, but the resulting style often leaves something to be desired—I'm thinking about how to fix that. (Maybe it's because I recently increased the maximum prompt length from 512 to 2048.)

This model was used to make image captions: Minthy/ToriiGate-0.5 · Hugging Face

Workflow is included in posted images metadata and optional files

You need to put this into custom_nodes for the workflow to work.

https://huggingface.co/femboysLover/anima-looped-test-diffusion-blocks-idx-0/resolve/main/model_range_wrapper.py?download=true

real time training checkpoints are there:

low noise

https://huggingface.co/femboysLover/anima-looped-test-diffusion-blocks-idx-0

high noise

https://huggingface.co/femboysLover/anima-looped-test-diffusion-blocks-idx-1

the article from which I took the methodology:

[2506.14202] DiffusionBlocks: Block-wise Neural Network Training via Diffusion Interpretation