PLEASEEE do an INT8 version for 2x speed gains on rtx 3000 & 2000 series
https://github.com/BobJohnson24/ComfyUI-Flux2-INT8
Please check this out sir. I tested the int8 flux on my 3060 and it's really super fast now. I am loving your QIE v22 so far and am downloading v23, but I just have 12gb VRAM and its quite slow.
It made me think it would be super amazing if there was an INT8 version of v23 and above going forward.
Sir you would be doing us 2000/3000 series users a huge favour by releasing an INT8 version alongside the FP8 one because 2000/3000 series can't do native FP8 and upcast it to BF16 (im a noob but I think this is how it works, right? ). From what I've heard there are tensor cores for INT8 on 2000/3000 series, so INT8 is much faster than FP8 for these cards.
Hola, ¿que tan lento te va con la 3060? Porque yo también tengo una RTX 3060 12Gb y por imagen se demora 1 minuto. Estoy usando la v19, a 4 pasos y las imágenes son de 900x1200 aprox.
Hola, ¿que tan lento te va con la 3060? Porque yo también tengo una RTX 3060 12Gb y por imagen se demora 1 minuto. Estoy usando la v19, a 4 pasos y las imágenes son de 900x1200 aprox.
It takes me around 1 minute as well - but the point is that there are lots of performance gains to be had, that 1 minute can become 30 seconds on the 3060 if INT8 is implemented.