transformers safetensors qwen2 text-generation axolotl dpo trl conversational en dataset:HumanLLMs/Human-Like-DPO-Dataset arxiv:2501.05032 arxiv:2106.09685 arxiv:2305.18290 base_model:Qwen/Qwen2.5-7B-Instruct base_model:finetune:Qwen/Qwen2.5-7B-Instruct license:apache-2.0 model-index autotrain_compatible text-generation-inference endpoints_compatible region:us
Large (5-20GB)