Index Translate 9B for AI Pod (vLLM)

This is the complete read-only model snapshot used by the AI Pod Index Translate LPK. Target: Jetson AGX Thor / SM110. The runtime and LPK are published separately at https://huggingface.co/manateelazycat/Index-Translate-AIPod and https://modelscope.cn/models/manateelazycat/Index-Translate-AIPod.

Acquired source: IndexTeam/Index-Translate-9B-FP4@8e676876a2db89fa9e81be991b4fb10dd6d9da8c. The model weights retain Apache-2.0. Orinfer software uses LGPL-3.0-or-later; its matching execution packages and corresponding source are part of the separate runtime delivery. Upstream model: https://github.com/bilibili/Index-Translate

Downloads last month
40
Safetensors
Model size
9B params
Tensor type
BF16
ยท
U8
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for manateelazycat/Index-Translate-9B-vLLM-AIPod

Quantized
(1)
this model