New version LTX-2.3-22B-distilled-1.1

#4
by AIIAAN - opened

Hi! First of all, I just wanna say THANK YOU for quantizing nvfp4 of LTX2.3, I have been using LTX-2.3-22B-Distilled-FP4ME on my RTX4060 laptop with 8GB Vram+32GB Ram, it works really really well and fast (Unet loader dequantized as FP8 e4m3 + sage attention2.2). And my previous quantized version was using ltx-2.3-22b-distilled-Q5_K_M by Unsloth, it often causes VRAM Overflows for my poor 8GB Vram, it was such a depressing experience to me. So really, thanks again for making such incredible nvfp4 quantized model.
Yesterday Lightricks has uploaded the newest 1.1 version of LTX-2.3, will you consider using the newing version to make the upcoming LTX-2.3-FP4MEL ? I'll be really looking forward to you next brilliant creations.
Best regards.

+1. This also works faster than both gguf's and fp8 with amd gpu's using rocm (with bitsandbytes) It is definately faster but the existing distill fpme is just a bit below what I get from the kijai's safetensors version.

This is a hidden gem! It is faster on a 3060 too (12GB VRAM).
I thought I would never touch FP4 (for 50XX), and here's a improved version!

just wanted to drop a note, been busy, bouncing in and out of other projects, i am building a new fp4me on distilled v1.1 tonight, so ill be getting that out.
i also do have one built on sulphur (the adult ltx2.3) that ill get posted, but i may adjust it, my problem with it is its too adult by default, it really doesn't like to do normal things, so ill try and get a half sulphur going.
i know i don't get on here much, this is hobby for me and i have other things that pay the bills that i need to focus on.

+1. This also works faster than both gguf's and fp8 with amd gpu's using rocm (with bitsandbytes) It is definately faster but the existing distill fpme is just a bit below what I get from the kijai's safetensors version.

and yes that's by design, not trying to compete with the kijai's or official fp4's in terms of quality, im trying to make them smaller at an acceptable quality loss, and using a good denoise clears up most the quality problems.

just wanted to drop a note, been busy, bouncing in and out of other projects, i am building a new fp4me on distilled v1.1 tonight, so ill be getting that out.
i also do have one built on sulphur (the adult ltx2.3) that ill get posted, but i may adjust it, my problem with it is its too adult by default, it really doesn't like to do normal things, so ill try and get a half sulphur going.
i know i don't get on here much, this is hobby for me and i have other things that pay the bills that i need to focus on.

Yaaaaaaaaaaas!!!!! It's been a while since last update, I thought you might forgot this project, It's so nice to hear some news from you~~ Thank you again for taking your time to make such amazing project. Lots of love~♥♥♥

Sign up or log in to comment