Qwen

/

Qwen3-Reranker-8B

like 205

Follow

Qwen 64.3k

Hello all,

it was easy to create a FP8 quant of the 8b-Embedding Model. The creation of a quant for the Reranker failed for me using Llmcompressor...

The result is technically loadable, but the result of the reranking is always 0.50. Does anybody of you can share the receipt or code to create a FP8 quant of this Model?

Thanks a lot and happy new year 😀