leonsarmiento commited on
Commit
ad80802
·
verified ·
1 Parent(s): 656fafc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -43,6 +43,13 @@ using mlx-lm version **0.28.3**.
43
 
44
  MIXED QUANT: 8-BIT EMBEDDINGS AND PREDICTION LAYERS, 6-BIT EVERYTHING ELSE.
45
 
 
 
 
 
 
 
 
46
 
47
  ## Use with mlx
48
 
 
43
 
44
  MIXED QUANT: 8-BIT EMBEDDINGS AND PREDICTION LAYERS, 6-BIT EVERYTHING ELSE.
45
 
46
+ Temperature: 0.6 Top K: 20 Repeat penalty: OFF Min P sampling: OFF Top P sampling: 0.95
47
+
48
+ SYSTEM PROMPT:
49
+
50
+ "You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem."
51
+
52
+
53
 
54
  ## Use with mlx
55