transformers gguf text-generation-inference unsloth mistral trl autoquant en arxiv:2311.07911 arxiv:2210.09261 arxiv:2103.03874 arxiv:2311.12022 arxiv:2310.16049 arxiv:2406.01574 license:apache-2.0 endpoints_compatible region:us
Small (<1GB)