transformers gguf mergekit merge en base_model:DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-MADNESS base_model:quantized:DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-MADNESS endpoints_compatible region:us conversational
Small (<1GB)