transformers gguf mergekit merge autoquant arxiv:2212.04089 base_model:mlabonne/Hermes-3-Llama-3.1-8B-lorablated base_model:quantized:mlabonne/Hermes-3-Llama-3.1-8B-lorablated endpoints_compatible region:us conversational
Small (<1GB)