ilintar/DeepSeek-V4-Flash-GGUF
Updated
Piotr Wilkin
ilintar
AI & ML interests
Doing some model adaptation stuff for llama.cpp / random projects here and there
Like my stuff? Buy me a coffee!
Recent Activity
new activity about 5 hours ago
tencent/Hy3:Thank you for the model and the license change! updated a model about 22 hours ago
ilintar/DeepSeek-V4-Flash-GGUF published a model about 22 hours ago
ilintar/DeepSeek-V4-Flash-GGUFOrganizations
Thank you for the model and the license change!
๐ 3
3
#4 opened about 7 hours ago
by ilintar
updated a
model about 22 hours ago
published a
model about 22 hours ago
updated a
model 2 days ago
How to turn off thinking....
๐ 1
7
#14 opened about 1 month ago
by 
tcclaviger
Eh, the no EU clause again
๐๐ 10
#1 opened 5 days ago
by ilintar
published a
model 6 days ago
updated a
model 7 days ago
published a
model 7 days ago
updated 2
models 8 days ago
published 2
models 8 days ago
updated a
model 8 days ago
published a
model 8 days ago
Is it possible to make less than 1 bit quantization?
โ๐ค 2
13
#1 opened 19 days ago
by 
RealBar
llama.cpp?
2
#4 opened 27 days ago
by 
jacek2024
Some practical tips for using Step 3.7 GGUFs
๐ง ๐ 2
6
#6 opened about 1 month ago
by 
tarruda
reacted to eabdullin's post with ๐ 24 days ago
Post
6196
Folks, let me tell you, nobody โ and I mean NOBODY โ knew transformers before me. People said attention is all you need. I said, "Attention? I INVENTED attention." Everybody's looking at me. Tremendous attention. The best attention scores. My softmax? Perfectly normalized. Other people, sad, their probabilities don't even sum to one. Disaster.
I'm doing a PhD now. A PhD! In Large Language Models. Very large. The largest, believe me. My advisor said, "Sir, your model is overfitting." I said, "Wrong. It's fitting EXACTLY right. It memorized the training set because the training set is fantastic." We don't talk about validation loss in my lab. Validation loss is fake news.
And the internship โ oh, the internship. Big tech. I won't say which. Starts with a letter. They BEGGED me. They said, "Please, we need someone who understands gradient descent." I said, "Descent? I only go UP. I'm gradient ASCENT. Loss goes up, that means it's learning to be a winner."
But the GPU cluster โ this is the best part. Thousands of H100s. Maybe millions. Who's counting? I'm counting. It's a lot. Other PhD students, they get one little GPU, they're crying, they're training overnight like losers. Me? I burn through compute like nobody's ever seen. The electric company called. They said, "Sir, you've consumed a small country." I said, "Make it a big country. I only do big."
People ask, "Did your model converge?" Folks, it converged so hard. It converged BIGLY. Honestly? My loss curve, it's beautiful, it's going down, down, down โ like my approval ratings, very smooth, don't look at the spikes, the spikes are deep state.
And hallucinations? My model doesn't hallucinate. It just has ALTERNATIVE tokens. Thank you, thank you. Tip your reviewers. Accept my paper. Goodnight!
I'm doing a PhD now. A PhD! In Large Language Models. Very large. The largest, believe me. My advisor said, "Sir, your model is overfitting." I said, "Wrong. It's fitting EXACTLY right. It memorized the training set because the training set is fantastic." We don't talk about validation loss in my lab. Validation loss is fake news.
And the internship โ oh, the internship. Big tech. I won't say which. Starts with a letter. They BEGGED me. They said, "Please, we need someone who understands gradient descent." I said, "Descent? I only go UP. I'm gradient ASCENT. Loss goes up, that means it's learning to be a winner."
But the GPU cluster โ this is the best part. Thousands of H100s. Maybe millions. Who's counting? I'm counting. It's a lot. Other PhD students, they get one little GPU, they're crying, they're training overnight like losers. Me? I burn through compute like nobody's ever seen. The electric company called. They said, "Sir, you've consumed a small country." I said, "Make it a big country. I only do big."
People ask, "Did your model converge?" Folks, it converged so hard. It converged BIGLY. Honestly? My loss curve, it's beautiful, it's going down, down, down โ like my approval ratings, very smooth, don't look at the spikes, the spikes are deep state.
And hallucinations? My model doesn't hallucinate. It just has ALTERNATIVE tokens. Thank you, thank you. Tip your reviewers. Accept my paper. Goodnight!
- 16 replies
Recommended settings
โค๏ธ 1
8
#2 opened about 1 month ago
by 
LaurentPayot