transformers gguf generated_from_trainer trl dpo en base_model:AmberYifan/Mistral-7B-v0.1-sft-dpo-1.6k base_model:quantized:AmberYifan/Mistral-7B-v0.1-sft-dpo-1.6k endpoints_compatible region:us conversational
Small (<1GB)