Nvidia released a toolkit that speeds up models by 30%. Works great on SD3.<a target="_blank" rel="ugc" href="https://blogs.nvidia.com/blog/ai-decoded-flux-one/">https://blogs.nvidia.com/blog/ai-decoded-flux-one/</a>I want this for Flux. I do not have enough local VRAM to convert the model. Can a hero get this done? Yes I'm aware of the tradeoffs with loras etc. I just want to improve raw doggin' flux dev. This hasn't been done yet to my knowledge, possibly because a float16 issue. From a HF comment:Could this somehow help? <a target="_blank" rel="ugc" href="https://github.com/microsoft/onnxscript/pull/1492">https://github.com/microsoft/onnxscript/pull/1492</a>See also: <a target="_blank" rel="ugc" href="https://github.com/microsoft/onnxruntime/issues/13001￼and">https://github.com/microsoft/onnxruntime/issues/13001 and</a>: <a target="_blank" rel="ugc" href="https://github.com/microsoft/onnxscript/issues/1462">https://github.com/microsoft/onnxscript/issues/1462</a>To win this bounty:<ol><li>Convert the model and upload the FP16 Dev TensorRT to Civitai</li><li>Post render comparisons using the TensorRT workflow</li></ol>Comfy workflow:<a target="_blank" rel="ugc" href="https://github.com/comfyanonymous/ComfyUI_TensorRT">https://github.com/comfyanonymous/ComfyUI_TensorRT</a>

flux-nv-blog-1280x680-1.jpg

TensorRT Flux.1 Dev conversion

ezyzip (5).zip

flux-nv-blog-1280x680-1.jpeg

sexual situations

physical violence

disturbing

male nudity

hanging

hate symbols

nazi party

revealing clothes

weapon violence

female swimwear or underwear

male swimwear or underwear

partial nudity

white supremacy

adult toys

graphic male nudity

illustrated explicit nudity

nudity

graphic violence or gore

graphic female nudity

pg-13

corpses

wide hips

convenient censoring

peeing

oral invitation

emaciated bodies

exposed female nipple

blowjob

female nudity

sexual activity

sexual intent

undressed

male underwear

female swimwear

genitals

female underwear

thick thighs

breasts out

strapless leotard

vore

breast out

one breast out

huge breasts

gigantic breasts

huge butt

covered nipples

hair over breasts

no panties

sitting on face

anal

dildo riding

downblouse

oral

porn

futanari

hentai

nude

lingerie

nsfw

suggestive

child on child

self injury

extremist

hate speech

diapers

urine

incest

scat

sexy

latex clothing

swimwear

bukkake

fellatio

cumshot

implied fellatio

eat_cum

cumdrip

cum in pussy

cum on face

after fellatio

cum on hair

cum on body

cum on tongue

cum on hands

cum in mouth

triple fellatio

autofellatio

fucked silly

cum on pussy

pov fellatio