Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

9

Full-text search

Active filters: cpu-offload

MikeKuykendall/gpt-oss-20b-moe-cpu-offload-gguf

Text Generation • 21B • Updated Oct 6 • 79 • 2

MikeKuykendall/phi-3.5-moe-cpu-offload-gguf

Text Generation • 42B • Updated Oct 8 • 8

MikeKuykendall/deepseek-moe-16b-cpu-offload-gguf

Text Generation • 16B • Updated Oct 8 • 37

MikeKuykendall/phi-3.5-moe-q4-k-m-cpu-offload-gguf

Text Generation • 42B • Updated Oct 9 • 11

MikeKuykendall/phi-3.5-moe-q2-k-cpu-offload-gguf

Text Generation • 42B • Updated Oct 9 • 14

MikeKuykendall/phi-3.5-moe-q8-0-cpu-offload-gguf

Text Generation • 42B • Updated Oct 9 • 12

MikeKuykendall/deepseek-moe-16b-q4-k-m-cpu-offload-gguf

Text Generation • 16B • Updated Oct 9 • 54 • 1

MikeKuykendall/deepseek-moe-16b-q2-k-cpu-offload-gguf

Text Generation • 16B • Updated Oct 9 • 17

MikeKuykendall/deepseek-moe-16b-q8-0-cpu-offload-gguf

Text Generation • 16B • Updated Oct 9 • 22