Update README.md
Browse files
README.md
CHANGED
|
@@ -43,6 +43,13 @@ using mlx-lm version **0.28.3**.
|
|
| 43 |
|
| 44 |
MIXED QUANT: 8-BIT EMBEDDINGS AND PREDICTION LAYERS, 6-BIT EVERYTHING ELSE.
|
| 45 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
|
| 47 |
## Use with mlx
|
| 48 |
|
|
|
|
| 43 |
|
| 44 |
MIXED QUANT: 8-BIT EMBEDDINGS AND PREDICTION LAYERS, 6-BIT EVERYTHING ELSE.
|
| 45 |
|
| 46 |
+
Temperature: 0.6 Top K: 20 Repeat penalty: OFF Min P sampling: OFF Top P sampling: 0.95
|
| 47 |
+
|
| 48 |
+
SYSTEM PROMPT:
|
| 49 |
+
|
| 50 |
+
"You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem."
|
| 51 |
+
|
| 52 |
+
|
| 53 |
|
| 54 |
## Use with mlx
|
| 55 |
|