Sign In
home
models
images
videos
posts
articles
bounties
tools
challenges
events
updates
shop

MistoControlNet-Flux-dev

15
718
13
Updated: Sep 1, 2024
toolcontrolnetflux1.dmistoline
Download (2.6 GB)
Verified:
Other
Type
Controlnet
Stats
718
0
Reviews
(15)
Published
Sep 1, 2024
Base Model
Flux.1 D
Hash
AutoV2
BBA8A63CAA
default creator card background decoration
TheMisto_AI's Avatar
TheMisto_AI
The FLUX.1 [dev] Model is licensed by Black Forest Labs. Inc. under the FLUX.1 [dev] Non-Commercial License. Copyright Black Forest Labs. Inc.
IN NO EVENT SHALL BLACK FOREST LABS, INC. BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.

Summary

by TheMisto.ai @Shenzhen, China
This is a ControlNet network designed for any lineart or outline sketches, compatible with Flux1.dev. The ControlNet model parameters are approximately 1.4B.

This model is not compatible with XLabs loaders and samplers. Please use TheMisto.ai Flux ControlNet ComfyUI suite. This is a Flow matching structure Flux-dev model, utilizing a scalable Transformer module as the backbone of this ControlNet.

We've implemented a dual-stream Transformer structure, which enhances alignment and expressiveness for various types of lineart and outline conditions without increasing inference time. The model has also been trained for alignment with both T5 and clip-l TextEncoders, ensuring balanced performance between conditioning images and text prompts.
For more details on the Flux.dev model structure, visit: https://huggingface.co/black-forest-labs/FLUX.1-dev

This ControlNet is compatible with Flux1.dev's fp16/fp8 and other models quantized with Flux1.dev. ByteDance 8/16-step distilled models have not been tested.

  • The example workflow uses the flux1-dev-Q4_K_S.gguf quantized model.

  • Generation quality: Flux1.dev(fp16)>>Flux1.dev(fp8)>>Other quantized models

  • Generation speed: Flux1.dev(fp16)<<< Flux1.dev(fp8) <<< Other quantized models

Performance

Performance Across Different Sizes and Scenarios

Tested in various common scenarios such as industrial design, architecture, interior design, animation, games, and photography.
Make sure to craft your prompts well—precision is more important than length!
Performance examples are shown below:

Recommended Settings

  • Image resolution: 720px or above on the short edge

  • controlnet strength: 0.6~0.85 (adjust as needed)

  • guidance: 3.0~5.0 (adjust as needed)

  • steps: 30 or more

Usage

  • Download the model from MistoLine_Flux.dev_v1

  • Place the model in the ComfyUI\models\TheMisto_model\ directory

  • The directory will be automatically created the first time you run the ComfyUI's TheMisto.ai Flux ControlNet ComfyUI suite

  • Run using ComfyUI; an example workflow can be found in the workflow folder

  • Note: The length and width of the conditioning image must be divisible by 16, or an error will occur.

License

Align to the FLUX.1 [dev] Non-Commercial License
This ComfyUI node falls under ComfyUI
This model is for research and educational purposes only and may not be used for any form of commercial purposes.

Business Cooperation

For any custom model training, commercial cooperation, AI application development, or other business collaboration matters, please contact us.

Media

International:

Website: https://themisto.ai/
Discord: https://discord.gg/fTyDB2CU
X: https://x.com/AiThemisto79359

Mainland China (中国大陆):

Website: https://themisto.ai/
WeChat Official Account: TheMisto AI (Shenzhen Mixed Tuple Technology Co., Ltd.)
Xiaohongshu: TheMisto.ai (Xiaohongshu ID: 4211745997)