transformers gguf llama-cpp gguf-my-repo base_model:ibivibiv/Llama-3-4B-Instruct-HalfWit base_model:quantized:ibivibiv/Llama-3-4B-Instruct-HalfWit endpoints_compatible region:us conversational
Small (<1GB)