llmat
/

Mistral-Small-24B-Instruct-2501-NVFP4

Text Generation

8-bit precision

compressed-tensors

Model card Files Files and versions

Mistral-Small-24B-Instruct-2501-NVFP4

15.2 GB

1 contributor

History: 5 commits

llmat's picture

Update README.md

d2b08cb verified 4 months ago

.gitattributes

271 Bytes

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
README.md

1.61 kB

Update README.md 4 months ago
chat_template.jinja

1.6 kB

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
config.json

1.82 kB

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
generation_config.json

155 Bytes

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
model-00001-of-00004.safetensors

5 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
model-00002-of-00004.safetensors

4.99 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
model-00003-of-00004.safetensors

3.86 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
model-00004-of-00004.safetensors

1.34 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
model.safetensors.index.json

109 kB

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
recipe.yaml

130 Bytes

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
special_tokens_map.json

21.3 kB

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
tokenizer.json

17.1 MB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago
tokenizer_config.json

198 kB

Add NVFP4 quantized model (llmcompressor oneshot). 4 months ago