Request for Pixtral Large 2411 GGUF
Eager to try out this 2409 12B version. Could you also make a GGUF of—
mistralai/Pixtral-Large-Instruct-2411
Personally, I had not been planning to GGUF/Quantize the Pixtral-Large, but since there's a request I'll take a look and then write back with wether or not I'll move forward with it.
Thank you for sending in your request and for you message as well, I'll get back to you soon in regards to Pixtral-Large.
Hey, thanks for the response! No rush! Appreciate you...
Hello again @dolphinfan ,
So I did look into Pixtral-Large-Instruct-2411 and I wanted to
inform you that I will try to convert and quantize the model.
I say try because despite my 64GB VRAM and 64GB system RAM
I'm still a good 120GB+ shy of enough RAM to load the model
in one shot.
What I will try to do is loading the model in pieces and convert
it by loading "chunks" sequentially and hopefully my system
can play enough VRAM+RAM musical chairs to do it.
If it doesn't pan out, then I'll let you know that as well but
it's going to be an interesting expirement that's for sure!
Talk to you after I give it a go,
- Jon Z (EnlistedGhost)
Wow! Thanks a lot. I really appreciate your efforts. Again, I can't thank you enough for at least try. Good luck :)