Data-free quantization w/ Q-Palette
updated
bdbj/Llama-3.2-1B-qpal-df-tcq-4bit
0.5B
•
Updated
•
1
bdbj/Llama-3.2-1B-qpal-df-tcq-3.25bit
0.5B
•
Updated
•
2
bdbj/Llama-3.2-1B-qpal-df-tcq-3bit
0.4B
•
Updated
•
1
bdbj/Llama-3.2-1B-qpal-df-msq-4bit
0.5B
•
Updated
•
1
bdbj/Llama-3.2-1B-qpal-df-msq-3.25bit
0.5B
•
Updated
•
1
bdbj/Llama-3.2-1B-qpal-df-msq-3bit
0.4B
•
Updated
•
2
bdbj/Llama-3.2-3B-qpal-df-tcq-4bit
1B
•
Updated
•
1
bdbj/Llama-3.2-3B-qpal-df-tcq-3.25bit
1.0B
•
Updated
•
1
bdbj/Llama-3.2-3B-qpal-df-tcq-3bit
0.9B
•
Updated
bdbj/Llama-3.2-3B-qpal-df-msq-4bit
1B
•
Updated
•
1
bdbj/Llama-3.2-3B-qpal-df-msq-3.25bit
1.0B
•
Updated
•
1
bdbj/Llama-3.2-3B-qpal-df-msq-3bit
0.9B
•
Updated
•
1
bdbj/Llama-3.1-8B-qpal-df-tcq-4bit
3B
•
Updated
•
1
bdbj/Llama-3.1-8B-qpal-df-tcq-3.25bit
2B
•
Updated
•
1
bdbj/Llama-3.1-8B-qpal-df-tcq-3bit
2B
•
Updated
•
1
bdbj/Llama-3.1-8b-qpal-df-msq-4bit
3B
•
Updated
•
1
bdbj/Llama-3.1-8b-qpal-df-msq-3.25bit
2B
•
Updated
bdbj/Llama-3.1-8b-qpal-df-msq-3bit
2B
•
Updated
•
1
bdbj/Qwen2.5-7B-qpal-df-msq-4.25bit
3B
•
Updated
•
1
bdbj/Qwen2.5-7B-qpal-df-msq-4bit
3B
•
Updated
•
1
bdbj/Qwen2.5-7B-qpal-df-msq-3.75bit
3B
•
Updated
•
1
bdbj/Qwen2.5-7B-qpal-df-msq-3.5bit
3B
•
Updated
•
1
bdbj/Qwen2.5-7B-qpal-df-msq-3.25bit
2B
•
Updated
•
2
bdbj/Llama-3.1-70B-qpal-df-msq-4.25bit
20B
•
Updated
•
3
bdbj/Llama-3.1-70B-qpal-df-msq-4bit
19B
•
Updated
•
1
bdbj/Llama-3.1-70B-qpal-df-msq-3.63bit
17B
•
Updated
•
1
bdbj/Llama-3.1-70B-qpal-df-msq-3.4bit
16B
•
Updated
•
2
bdbj/Llama-3.1-70B-qpal-df-msq-3.25bit
16B
•
Updated
•
1
bdbj/Llama-3.1-8b-qpal-df-msq-fig1c
2B
•
Updated
•
1
bdbj/Llama-3.1-8b-qpal-df-msq-fig1d
Updated