gguf llama-cpp gguf-my-repo dataset:BAAI/Infinity-Instruct base_model:yang31210999/Llama-3.1-Minitron-4B-Depth-Neo-BAAI-100k base_model:quantized:yang31210999/Llama-3.1-Minitron-4B-Depth-Neo-BAAI-100k endpoints_compatible region:us
Small (<1GB)