Update README.md
Browse files
README.md
CHANGED
|
@@ -41,6 +41,9 @@ This model [leonsarmiento/Hermes-4.3-36B-6bit-mlx](https://huggingface.co/leonsa
|
|
| 41 |
converted to MLX format from [NousResearch/Hermes-4.3-36B](https://huggingface.co/NousResearch/Hermes-4.3-36B)
|
| 42 |
using mlx-lm version **0.28.3**.
|
| 43 |
|
|
|
|
|
|
|
|
|
|
| 44 |
## Use with mlx
|
| 45 |
|
| 46 |
```bash
|
|
|
|
| 41 |
converted to MLX format from [NousResearch/Hermes-4.3-36B](https://huggingface.co/NousResearch/Hermes-4.3-36B)
|
| 42 |
using mlx-lm version **0.28.3**.
|
| 43 |
|
| 44 |
+
MIXED QUANT: 8-BIT EMBEDDINGS AND PREDICTION LAYERS, 6-BIT EVERYTHING ELSE.
|
| 45 |
+
|
| 46 |
+
|
| 47 |
## Use with mlx
|
| 48 |
|
| 49 |
```bash
|