TheBloke
/

COTHuginn-4.5-19B-GGUF

Model card Files Files and versions

COTHuginn-4.5-19B-GGUF

147 GB

1 contributor

History: 15 commits

TheBloke's picture

GGUF model commit (made with llama.cpp commit ec2a24f)

7fa3915 over 2 years ago

.gitattributes

2.3 kB

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
LICENSE.txt

7.02 kB

Add Llama 2 license files over 2 years ago
Notice

112 Bytes

Add Llama 2 license files over 2 years ago
USE_POLICY.md

4.77 kB

Add Llama 2 license files over 2 years ago
config.json

29 Bytes

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q2_K.gguf

8.05 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q3_K_L.gguf

10.3 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q3_K_M.gguf

9.39 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q3_K_S.gguf

8.39 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q4_0.gguf

10.9 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q4_K_M.gguf

11.7 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q4_K_S.gguf

11 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q5_0.gguf

13.3 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q5_K_M.gguf

13.7 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q5_K_S.gguf

13.3 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q6_K.gguf

15.9 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago
cothuginn-4.5-19b.Q8_0.gguf

20.6 GB
xet

GGUF model commit (made with llama.cpp commit ec2a24f) over 2 years ago