Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Avarok
/
nvidia-nemotron-nano-12b-v2-q4_k_m
like
0
Follow
Avarok Cybersecurity
1
GGUF
llama.cpp
quantized
4-bit precision
Q4_K_M
nemotron
12B
tool-calling
thinking
128k
multilingual
ollama
conversational
License:
other
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
nvidia-nemotron-nano-12b-v2-q4_k_m
7.51 GB
1 contributor
History:
3 commits
nologik
Add GGUF Q4_K_M quantized weights (7GB, SHA256: 82ea4805d2f9f37e3c67b06768141ff58e43fb0dcd3983a82e9c2f481eb7fea8)
e6bc38f
verified
about 1 month ago
.gitattributes
1.62 kB
Add GGUF Q4_K_M quantized weights (7GB, SHA256: 82ea4805d2f9f37e3c67b06768141ff58e43fb0dcd3983a82e9c2f481eb7fea8)
about 1 month ago
README.md
4.02 kB
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
acc-vs-budget.png
Safe
87.3 kB
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
bias.md
Safe
2.28 kB
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
config.json
Safe
1.49 kB
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
configuration_nemotron_h.py
Safe
12.2 kB
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
explainability.md
Safe
2.64 kB
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
generation_config.json
Safe
158 Bytes
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
model-q4.gguf
7.49 GB
xet
Add GGUF Q4_K_M quantized weights (7GB, SHA256: 82ea4805d2f9f37e3c67b06768141ff58e43fb0dcd3983a82e9c2f481eb7fea8)
about 1 month ago
modeling_nemotron_h.py
Safe
78.8 kB
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
nemotron_toolcall_parser_no_streaming.py
Safe
3.72 kB
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
privacy.md
Safe
2.3 kB
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
safety.md
Safe
2.3 kB
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
special_tokens_map.json
Safe
422 Bytes
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
tokenizer.json
Safe
17.1 MB
xet
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
tokenizer_config.json
Safe
181 kB
Add README and supporting files for Nemotron Nano 12B v2 GGUF Q4_K_M
about 1 month ago
