This is LFM2.5-1.2B-JP quantized with llm-compressor to NVFP4. The model is compatible with vLLM (tested: v0.13.0). Tested with an RTX 4090.
- Developed by: The Kaitchup
- License: Apache 2.0 license
How to Support My Work
"buy me a kofi" Subscribe to The Kaitchup. This helps me a lot to continue quantizing and evaluating models for free.
- Downloads last month
- -
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
馃檵
Ask for provider support