John Leimgruber III PRO

ubergarm's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a collection about 21 hours ago

Magic Quant

Collection

Hybrid GGUF quants created via an evolutionary quant algorithm. Want the best TPS? Lowest precision loss? Smallest file size? Welcome to MagicQuant! • 6 items • Updated about 12 hours ago • 1

upvoted a collection about 2 months ago

Draft Models

Collection

Tiny "draft" models for speculative decoding. • 36 items • Updated Oct 29 • 6

upvoted a collection 6 months ago

YAQA

Collection

YAQA hessians (Sketch B) and models with the QTIP quantizer. See https://github.com/Cornell-RelaxML/yaqa/tree/main for more details. • 9 items • Updated Jun 6 • 3

upvoted 2 collections 7 months ago

EXL3 models

Collection

39 items • Updated 3 days ago • 37

Qwen3

Collection

84 items • Updated Aug 6 • 1.47k

upvoted 3 collections 8 months ago

SkyReels-V2

Collection

Infinite-length Film Generative Model • 17 items • Updated Jun 14 • 61

Gemma 3 QAT

Collection

Quantization Aware Trained (QAT) Gemma 3 checkpoints. The model preserves similar quality as half precision while using 3x less memory • 15 items • Updated Jul 10 • 210

GLM-4-0414

Collection

GLM-4-0414 series model • 8 items • Updated Jun 30 • 133

upvoted 2 articles 8 months ago

view article

Article

Introduction to ggml

• 
• 
• +1

Aug 13, 2024

•

255

view article

Article

Comparing sub 50GB Llama 4 Scout quants (KLD/Top P)

• 

Apr 9

•

44

upvoted a collection 9 months ago

FP8 LLMs for vLLM

Collection

Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 44 items • Updated Oct 17, 2024 • 76

upvoted 2 articles 10 months ago

view article

Article

Open-R1: a fully open reproduction of DeepSeek-R1

• 
• 
• +1

Jan 28

•

887

view article

Article

The SOTA Text-to-speech and Zero Shot Voice cloning model that no one knows about...

• 

Jan 20

•

74

upvoted 2 collections 10 months ago

Qwen2.5-1M

Collection

The long-context version of Qwen2.5, supporting 1M-token context lengths • 3 items • Updated Jul 21 • 125

Qwen2.5-VL

Collection

Vision-language model series based on Qwen2.5 • 11 items • Updated Jul 21 • 549

upvoted 3 collections about 1 year ago

Llama 3.2 3B & 1B GGUF Quants

Collection

Llama.cpp compatible quants for Llama 3.2 3B and 1B Instruct models. • 4 items • Updated Sep 26, 2024 • 46

Llama 3.1 GPTQ, AWQ, and BNB Quants

Collection

Optimised Quants for high-throughput deployments! Compatible with Transformers, TGI & VLLM 🤗 • 9 items • Updated Sep 26, 2024 • 57

Qwen2-VL

Collection

Vision-language model series based on Qwen2 • 16 items • Updated Jul 21 • 226

upvoted a collection over 1 year ago

abliterated-v3

Collection

Latest gen of the abliterated models I've produced • 17 items • Updated Jun 3, 2024 • 134