Instructions to use ATH-MaaS/Ovis1.6-Gemma2-9B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ATH-MaaS/Ovis1.6-Gemma2-9B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="ATH-MaaS/Ovis1.6-Gemma2-9B", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("ATH-MaaS/Ovis1.6-Gemma2-9B", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use ATH-MaaS/Ovis1.6-Gemma2-9B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ATH-MaaS/Ovis1.6-Gemma2-9B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ATH-MaaS/Ovis1.6-Gemma2-9B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/ATH-MaaS/Ovis1.6-Gemma2-9B

SGLang

How to use ATH-MaaS/Ovis1.6-Gemma2-9B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ATH-MaaS/Ovis1.6-Gemma2-9B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ATH-MaaS/Ovis1.6-Gemma2-9B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ATH-MaaS/Ovis1.6-Gemma2-9B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ATH-MaaS/Ovis1.6-Gemma2-9B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use ATH-MaaS/Ovis1.6-Gemma2-9B with Docker Model Runner:
```
docker model run hf.co/ATH-MaaS/Ovis1.6-Gemma2-9B
```

Ovis1.6-Gemma2-9B

Commit History

Update README.md

12bef7a
verified

xxyyy123 commited on Aug 15, 2025

Update README.md

40c15fb
verified

runninglsy commited on Feb 26, 2025

Update README.md

80043be
verified

runninglsy commited on Nov 27, 2024

Support transformers>=4.46.0

6ed057e
verified

runninglsy commited on Nov 25, 2024

Update README.md

df84231
verified

xxyyy123 commited on Oct 22, 2024

Update README.md

9a9cfd1
verified

xxyyy123 commited on Oct 21, 2024

Update README.md

626fe59
verified

runninglsy commited on Oct 12, 2024

Update README.md

6829c12
verified

runninglsy commited on Oct 11, 2024

Create NOTICE

ba151c3
verified

runninglsy commited on Oct 11, 2024

Update README.md

15954d6
verified

xxyyy123 commited on Sep 26, 2024

Update README.md

204f597
verified

xxyyy123 commited on Sep 25, 2024

Update README.md

bb10a50
verified

xxyyy123 commited on Sep 25, 2024

Update README.md

cd3fe85
verified

xxyyy123 commited on Sep 25, 2024

Update README.md

446a49d
verified

runninglsy commited on Sep 25, 2024

Update README.md

0898a42
verified

xxyyy123 commited on Sep 25, 2024

Update README.md

1418e34
verified

xxyyy123 commited on Sep 23, 2024

Batch generation

68fded4

root commited on Sep 23, 2024

Update README.md

24af34e
verified

runninglsy commited on Sep 18, 2024

Update README.md

a191227
verified

runninglsy commited on Sep 18, 2024

upload model

3ff2bcd

runninglsy commited on Sep 18, 2024

initial commit

45c9265
verified

runninglsy commited on Sep 18, 2024

Commit History

Update README.md 12bef7a verified

Update README.md 40c15fb verified

Update README.md 80043be verified

Support transformers>=4.46.0 6ed057e verified

Update README.md df84231 verified

Update README.md 9a9cfd1 verified

Update README.md 626fe59 verified

Update README.md 6829c12 verified

Create NOTICE ba151c3 verified

Update README.md 15954d6 verified

Update README.md 204f597 verified

Update README.md bb10a50 verified

Update README.md cd3fe85 verified

Update README.md 446a49d verified

Update README.md 0898a42 verified

Update README.md 1418e34 verified

Batch generation 68fded4

Update README.md 24af34e verified

Update README.md a191227 verified

upload model 3ff2bcd

initial commit 45c9265 verified

Update README.md

12bef7a
verified

Update README.md

40c15fb
verified

Update README.md

80043be
verified

Support transformers>=4.46.0

6ed057e
verified

Update README.md

df84231
verified

Update README.md

9a9cfd1
verified

Update README.md

626fe59
verified

Update README.md

6829c12
verified

Create NOTICE

ba151c3
verified

Update README.md

15954d6
verified

Update README.md

204f597
verified

Update README.md

bb10a50
verified

Update README.md

cd3fe85
verified

Update README.md

446a49d
verified

Update README.md

0898a42
verified

Update README.md

1418e34
verified

Batch generation

68fded4

Update README.md

24af34e
verified

Update README.md

a191227
verified

upload model

3ff2bcd

initial commit

45c9265
verified