Hugging Face's logo

unsloth
/
DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation
Transformers
GGUF
English
llama
deepseek
unsloth
llama-3
meta
imatrix
conversational
Model card Files
xet
Community
2
danielhanchen commited on
Commit
3f97ef3
·
verified ·
1 Parent(s): 890e183

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. .gitattributes +5 -0
  2. DeepSeek-R1-Distill-Llama-70B-IQ4_NL.gguf +3 -0
  3. DeepSeek-R1-Distill-Llama-70B-IQ4_XS.gguf +3 -0
  4. DeepSeek-R1-Distill-Llama-70B-Q2_K_L.gguf +2 -2
  5. DeepSeek-R1-Distill-Llama-70B-Q3_K_S.gguf +3 -0
  6. DeepSeek-R1-Distill-Llama-70B-Q4_0.gguf +3 -0
  7. DeepSeek-R1-Distill-Llama-70B-Q4_1.gguf +3 -0
.gitattributes CHANGED
@@ -55,3 +55,8 @@ DeepSeek-R1-Distill-Llama-70B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -tex
55
  DeepSeek-R1-Distill-Llama-70B-UD-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
56
  Q6_K/DeepSeek-R1-Distill-Llama-70B-Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
57
  Q6_K/DeepSeek-R1-Distill-Llama-70B-Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
55
  DeepSeek-R1-Distill-Llama-70B-UD-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
56
  Q6_K/DeepSeek-R1-Distill-Llama-70B-Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
57
  Q6_K/DeepSeek-R1-Distill-Llama-70B-Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
58
+ DeepSeek-R1-Distill-Llama-70B-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
59
+ DeepSeek-R1-Distill-Llama-70B-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
60
+ DeepSeek-R1-Distill-Llama-70B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
61
+ DeepSeek-R1-Distill-Llama-70B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
62
+ DeepSeek-R1-Distill-Llama-70B-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Llama-70B-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cec649b31da121fb9448249e2184944e7bc84fe62451803e99ab11a102776c22
3
+ size 40053621408
DeepSeek-R1-Distill-Llama-70B-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58b57114dabd6efb1ac9c81db5571099e3a35fea32638fe226da4c3e11b7c83e
3
+ size 37935497888
DeepSeek-R1-Distill-Llama-70B-Q2_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fec176fc627bcf936bad4aa52f7e1a1eac3b3a63e6c6de3f0fd83b79b955b015
3
- size 26621362624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad0706ae66013d80a9d8c7f3f65fd76887456764e053c4efe6b2f17b2268c1c8
3
+ size 26621362848
DeepSeek-R1-Distill-Llama-70B-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79380de921a957d6e42552b048b53c6139ff567ad1f24b17cc5ef7a535d26569
3
+ size 30912053920
DeepSeek-R1-Distill-Llama-70B-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97de86b28911d3b4c53e2e0ef27b5ad877c2a5a54ba97ec09a30e16757d1885b
3
+ size 40116535968
DeepSeek-R1-Distill-Llama-70B-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba210740e740c6908daa6f7ab2669c60bb52f7170f9ffbb0879320cbc4cdda3b
3
+ size 44313592480