gguf Llama-3 instruct finetune chatml gpt4 synthetic data distillation function calling json mode axolotl roleplaying chat quantized GGUF quantization imat imatrix static 16bit 8bit 6bit 5bit 4bit 3bit 2bit 1bit text-generation en base_model:NousResearch/Hermes-3-Llama-3.1-70B base_model:quantized:NousResearch/Hermes-3-Llama-3.1-70B license:llama3 region:us conversational
Small (<1GB)