transformers gguf alignment-handbook trl dpo generated_from_trainer en dataset:princeton-nlp/llama3-ultrafeedback-armorm base_model:Magpie-Align/Llama-3.1-8B-Magpie-Align-v0.1 base_model:quantized:Magpie-Align/Llama-3.1-8B-Magpie-Align-v0.1 license:llama3.1 endpoints_compatible region:us imatrix conversational
Small (<1GB)