Update README.md
Browse files
README.md
CHANGED
|
@@ -41,6 +41,10 @@ This model [leonsarmiento/Hermes-4.3-36B-3bit-mlx](https://huggingface.co/leonsa
|
|
| 41 |
converted to MLX format from [NousResearch/Hermes-4.3-36B](https://huggingface.co/NousResearch/Hermes-4.3-36B)
|
| 42 |
using mlx-lm version **0.28.3**.
|
| 43 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
## Use with mlx
|
| 45 |
|
| 46 |
```bash
|
|
|
|
| 41 |
converted to MLX format from [NousResearch/Hermes-4.3-36B](https://huggingface.co/NousResearch/Hermes-4.3-36B)
|
| 42 |
using mlx-lm version **0.28.3**.
|
| 43 |
|
| 44 |
+
MIXED QUANT: 6-BIT EMBEDDINGS AND PREDICTION LAYERS, 3-BIT EVERYTHING ELSE.
|
| 45 |
+
|
| 46 |
+
|
| 47 |
+
|
| 48 |
## Use with mlx
|
| 49 |
|
| 50 |
```bash
|