Hugging Face's logo

second-state
/
Mistral-7B-Instruct-v0.2-GGUF

Text Generation
Transformers
GGUF
mistral
finetuned
conversational
Model card Files
xet
Community
Xin Liu commited on
Commit
61500d7
·
1 Parent(s): 97e0e76

Add models

Browse files

Signed-off-by: Xin Liu <[email protected]>

Files changed (13) hide show
  1. .gitattributes +1 -0
  2. Mistral-7B-Instruct-v0.2-Q2_K.gguf +3 -0
  3. Mistral-7B-Instruct-v0.2-Q3_K_L.gguf +3 -0
  4. Mistral-7B-Instruct-v0.2-Q3_K_M.gguf +3 -0
  5. Mistral-7B-Instruct-v0.2-Q3_K_S.gguf +3 -0
  6. Mistral-7B-Instruct-v0.2-Q4_0.gguf +3 -0
  7. Mistral-7B-Instruct-v0.2-Q4_K_M.gguf +3 -0
  8. Mistral-7B-Instruct-v0.2-Q4_K_S.gguf +3 -0
  9. Mistral-7B-Instruct-v0.2-Q5_0.gguf +3 -0
  10. Mistral-7B-Instruct-v0.2-Q5_K_M.gguf +3 -0
  11. Mistral-7B-Instruct-v0.2-Q5_K_S.gguf +3 -0
  12. Mistral-7B-Instruct-v0.2-Q6_K.gguf +3 -0
  13. Mistral-7B-Instruct-v0.2-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct-v0.2-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:061863aa59c706501c703c785276034a66703f50803b007a533b3df8bdecd9a0
3
+ size 3083098304
Mistral-7B-Instruct-v0.2-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a11cd57a796963d408ed8951b934130def4cab5819962f44c36a76e3c7c1c1a5
3
+ size 3822024896
Mistral-7B-Instruct-v0.2-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4bcf73c2c8b9b1f018e6f278980549b75f8993f0f8f6e3275571fdd3013da51
3
+ size 3518986432
Mistral-7B-Instruct-v0.2-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c57d1204f7e22efcb7f6ea7c4e5ef81b99b1234286d05c1d3804dca80516266
3
+ size 3164567744
Mistral-7B-Instruct-v0.2-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:141da842f1cd9dd6be6cdd0d79cfc1b04a660805f9608c1475e16ce5beb138f2
3
+ size 4108916928
Mistral-7B-Instruct-v0.2-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14268497e591764a76c9f8085448ca97722f27e85bb89c795d292545e1200a97
3
+ size 4368439488
Mistral-7B-Instruct-v0.2-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9b5b4fae8e2461e03411f98f9c7b8fc23cfdf88b63a1222c5021edb338411b9
3
+ size 4140374208
Mistral-7B-Instruct-v0.2-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:562b5f2928928dbd3a65cc5a32190127b62a0fc1a15abd48fc199f679bb4730f
3
+ size 4997716160
Mistral-7B-Instruct-v0.2-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ce9a46d73b47ca1d46aa0f182c12bd18ee2f3bcfffcc397de191ae31c3c3c4e
3
+ size 5131409600
Mistral-7B-Instruct-v0.2-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a917883b9af98183513cb526477096894b548f820aaf5834790b4ec52082b36a
3
+ size 4997716160
Mistral-7B-Instruct-v0.2-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8eae3811bfd827819082fa1c011644dd108e5519f6d1da07ad1db23b6e9d2bac
3
+ size 5942065344
Mistral-7B-Instruct-v0.2-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1909b6abaef7c10378f7795396356ab308a8bd8809373b0016a8334287559e07
3
+ size 7695857856