transformers gguf orpo qwen2 rlhf sft en dataset:mlabonne/orpo-dpo-mix-40k base_model:dfurman/Qwen2-72B-Orpo-v0.1 base_model:quantized:dfurman/Qwen2-72B-Orpo-v0.1 license:other endpoints_compatible region:us imatrix conversational
Small (<1GB)