HIGGS - a inference-optimization Collection

Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

inference-optimization 's Collections

HIGGS-per-tensor

HIGGS

updated 17 days ago

Mixed Precision Models

meta-llama/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Sep 25, 2024 • 9.76M • • 5.78k
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Mar 19 • 58.2k • 9
RedHatAI/Llama-3.1-8B-Instruct-NVFP4

Text Generation • 5B • Updated Nov 21, 2025 • 19.5k • 1
inference-optimization/Llama-3.1-8B-Instruct_5_bits_mode_hybrid

6B • Updated Mar 12 • 10
inference-optimization/Llama-3.1-8B-Instruct_5_bits_mode_noise

6B • Updated Mar 12 • 8
inference-optimization/Llama-3.1-8B-Instruct_5_bits_mode_heuristic

6B • Updated Mar 12 • 8
inference-optimization/Llama-3.1-8B-Instruct_5.5_bits_mode_hybrid

6B • Updated Mar 12 • 13
inference-optimization/Llama-3.1-8B-Instruct_5.5_bits_mode_noise

6B • Updated Mar 12 • 8
inference-optimization/Llama-3.1-8B-Instruct_5.5_bits_mode_heuristic

6B • Updated Mar 12 • 7
inference-optimization/Llama-3.1-8B-Instruct_6_bits_mode_hybrid

6B • Updated Mar 12 • 9
inference-optimization/Llama-3.1-8B-Instruct_6_bits_mode_noise

6B • Updated Mar 12 • 9
inference-optimization/Llama-3.1-8B-Instruct_6_bits_mode_heuristic

6B • Updated Mar 12 • 7
inference-optimization/Llama-3.1-8B-Instruct_6.5_bits_mode_hybrid

7B • Updated Mar 12 • 6
inference-optimization/Llama-3.1-8B-Instruct_6.5_bits_mode_noise

7B • Updated Mar 12 • 8
inference-optimization/Llama-3.1-8B-Instruct_6.5_bits_mode_heuristic

7B • Updated Mar 12 • 15
inference-optimization/Llama-3.1-8B-Instruct_7_bits_mode_hybrid

7B • Updated Mar 12 • 10
inference-optimization/Llama-3.1-8B-Instruct_7_bits_mode_noise

7B • Updated Mar 12 • 7
inference-optimization/Llama-3.1-8B-Instruct_7_bits_mode_heuristic

7B • Updated Mar 12 • 9
meta-llama/Llama-3.2-1B-Instruct

Text Generation • 1B • Updated Oct 24, 2024 • 6M • • 1.39k
inference-optimization/Llama-3.2-1B-Instruct-FP8-Dynamic

1B • Updated 25 days ago • 45
inference-optimization/Llama-3.2-1B-Instruct-NVFP4

0.8B • Updated 25 days ago • 63
inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_hybrid

1B • Updated Mar 12 • 8
inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_noise

1B • Updated Mar 12 • 6
inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_heuristic

1B • Updated Mar 12 • 8
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_hybrid

1B • Updated Mar 12 • 7
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_noise

1B • Updated Mar 12 • 14
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_heuristic

1B • Updated Mar 12 • 7
inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_hybrid

1B • Updated Mar 12 • 10
inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_noise

1B • Updated Mar 12 • 7
inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_heuristic

1B • Updated Mar 12 • 10
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_hybrid

1B • Updated Mar 12 • 13
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_noise

1B • Updated Mar 12 • 6
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_heuristic

1B • Updated Mar 12 • 14
inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_hybrid

1B • Updated Mar 12 • 9
inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_noise

1B • Updated Mar 12 • 10
inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_heuristic

1B • Updated Mar 12 • 9
meta-llama/Llama-3.2-3B-Instruct

Text Generation • 3B • Updated Oct 24, 2024 • 2.05M • • 2.12k
inference-optimization/Llama-3.2-3B-Instruct-FP8-Dynamic

3B • Updated 25 days ago • 40
inference-optimization/Llama-3.2-3B-Instruct-NVFP4

2B • Updated 25 days ago • 46
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_hybrid

3B • Updated Mar 12 • 7
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_noise

3B • Updated Mar 12 • 8
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_heuristic

3B • Updated Mar 12 • 12
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_hybrid

3B • Updated Mar 12 • 8
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_noise

3B • Updated Mar 12 • 9
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic

3B • Updated Mar 12 • 9
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_hybrid

3B • Updated Mar 12 • 8
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_noise

3B • Updated Mar 12 • 9
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_heuristic

3B • Updated Mar 12 • 8
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_hybrid

3B • Updated Mar 12 • 8
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_noise

3B • Updated Mar 12 • 8
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_heuristic

3B • Updated Mar 12 • 7
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_hybrid

3B • Updated Mar 12 • 9
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_noise

3B • Updated Mar 12 • 7
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_heuristic

3B • Updated Mar 12 • 9
Qwen/Qwen3-8B

Text Generation • 8B • Updated Jul 26, 2025 • 9.87M • • 1.07k
RedHatAI/Qwen3-8B-FP8-dynamic

Text Generation • 8B • Updated 3 days ago • 26.5k • 12
RedHatAI/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Nov 21, 2025 • 2.86k • 2
inference-optimization/Qwen3-8B_5_bits_mode_hybrid

6B • Updated Mar 12 • 8
inference-optimization/Qwen3-8B_5_bits_mode_noise

6B • Updated Mar 12 • 9
inference-optimization/Qwen3-8B_5_bits_mode_heuristic

6B • Updated Mar 12 • 8
inference-optimization/Qwen3-8B_5.5_bits_mode_hybrid

6B • Updated Mar 12 • 8
inference-optimization/Qwen3-8B_5.5_bits_mode_noise

6B • Updated Mar 12 • 9
inference-optimization/Qwen3-8B_5.5_bits_mode_heuristic

6B • Updated Mar 12 • 7
inference-optimization/Qwen3-8B_6_bits_mode_hybrid

7B • Updated Mar 12 • 8
inference-optimization/Qwen3-8B_6_bits_mode_noise

7B • Updated Mar 12 • 13
inference-optimization/Qwen3-8B_6_bits_mode_heuristic

7B • Updated Mar 12 • 8
inference-optimization/Qwen3-8B_6.5_bits_mode_hybrid

7B • Updated Mar 12 • 9
inference-optimization/Qwen3-8B_6.5_bits_mode_noise

7B • Updated Mar 12 • 7
inference-optimization/Qwen3-8B_6.5_bits_mode_heuristic

7B • Updated Mar 12 • 9
inference-optimization/Qwen3-8B_7_bits_mode_hybrid

7B • Updated Mar 12 • 7
inference-optimization/Qwen3-8B_7_bits_mode_noise

7B • Updated Mar 12 • 7
inference-optimization/Qwen3-8B_7_bits_mode_heuristic

7B • Updated Mar 12 • 7
Qwen/Qwen3-30B-A3B

Text Generation • Updated Jul 26, 2025 • 1.33M • • 884
RedHatAI/Qwen3-30B-A3B-FP8-dynamic

Text Generation • 31B • Updated May 13, 2025 • 4.16k • 3
RedHatAI/Qwen3-30B-A3B-NVFP4

Text Generation • 17B • Updated Dec 4, 2025 • 24.1k • 2
inference-optimization/Qwen3-30B-A3B_5.0_bits_mode_hybrid

20B • Updated Mar 31 • 26
inference-optimization/Qwen3-30B-A3B_5.0_bits_mode_noise

20B • Updated Mar 31 • 28
inference-optimization/Qwen3-30B-A3B_5.0_bits_mode_heuristic

20B • Updated Apr 1 • 23
inference-optimization/Qwen3-30B-A3B_5.5_bits_mode_hybrid

22B • Updated Apr 1 • 22
inference-optimization/Qwen3-30B-A3B_5.5_bits_mode_noise

22B • Updated about 1 month ago • 24 • 1
inference-optimization/Qwen3-30B-A3B_5.5_bits_mode_heuristic

22B • Updated 30 days ago • 38
inference-optimization/Qwen3-30B-A3B_6.0_bits_mode_hybrid

23B • Updated about 1 month ago • 22
inference-optimization/Qwen3-30B-A3B_6.0_bits_mode_noise

24B • Updated about 1 month ago • 27
inference-optimization/Qwen3-30B-A3B_6.0_bits_mode_heuristic

23B • Updated about 1 month ago • 22
inference-optimization/Qwen3-30B-A3B_6.5_bits_mode_hybrid

24B • Updated about 1 month ago • 29
inference-optimization/Qwen3-30B-A3B_6.5_bits_mode_noise

25B • Updated about 1 month ago • 42
inference-optimization/Qwen3-30B-A3B_6.5_bits_mode_heuristic

25B • Updated 30 days ago • 38
inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_hybrid

25B • Updated 30 days ago • 39
inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_noise

27B • Updated 30 days ago • 41
inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_heuristic

27B • Updated 30 days ago • 41
Qwen/Qwen3-30B-A3B-Instruct-2507

Text Generation • Updated Sep 17, 2025 • 1.13M • • 805
inference-optimization/Qwen3-30B-A3B-Instruct-2507-FP8-Dynamic

31B • Updated Mar 4 • 47
inference-optimization/Qwen3-30B-A3B-Instruct-2507-NVFP4

17B • Updated Mar 4 • 49
inference-optimization/Qwen3-30B-A3B-Instruct-2507_5.0_bits_mode_hybrid

20B • Updated Mar 27 • 22
inference-optimization/Qwen3-30B-A3B-Instruct-2507_5.0_bits_mode_noise

20B • Updated Mar 28 • 25
inference-optimization/Qwen3-30B-A3B-Instruct-2507_5.0_bits_mode_heuristic

20B • Updated Mar 28 • 27
inference-optimization/Qwen3-30B-A3B-Instruct-2507_5.5_bits_mode_hybrid

22B • Updated Mar 28 • 24
inference-optimization/Qwen3-30B-A3B-Instruct-2507_5.5_bits_mode_noise

22B • Updated Mar 28 • 27
inference-optimization/Qwen3-30B-A3B-Instruct-2507_5.5_bits_mode_heuristic

22B • Updated Mar 28 • 24
inference-optimization/Qwen3-30B-A3B-Instruct-2507_6.0_bits_mode_hybrid

23B • Updated Mar 28 • 21
inference-optimization/Qwen3-30B-A3B-Instruct-2507_6.0_bits_mode_noise

23B • Updated Mar 28 • 17
inference-optimization/Qwen3-30B-A3B-Instruct-2507_6.0_bits_mode_heuristic

23B • Updated Mar 28 • 27
inference-optimization/Qwen3-30B-A3B-Instruct-2507_6.5_bits_mode_hybrid

25B • Updated Mar 28 • 24
inference-optimization/Qwen3-30B-A3B-Instruct-2507_6.5_bits_mode_noise

25B • Updated Mar 28 • 20
inference-optimization/Qwen3-30B-A3B-Instruct-2507_6.5_bits_mode_heuristic

25B • Updated Mar 28 • 26
inference-optimization/Qwen3-30B-A3B-Instruct-2507_7.0_bits_mode_hybrid

26B • Updated Mar 28 • 27
inference-optimization/Qwen3-30B-A3B-Instruct-2507_7.0_bits_mode_noise

26B • Updated Mar 28 • 27
inference-optimization/Qwen3-30B-A3B-Instruct-2507_7.0_bits_mode_heuristic

27B • Updated Mar 28 • 26

Collection guide
Browse collections

Company

TOS Privacy About Careers

Website

Models Datasets Spaces Pricing Docs