transformers gguf alignment-handbook trl dpo generated_from_trainer TensorBlock GGUF dataset:tanliboy/orca_dpo_pairs base_model:tanliboy/lambda-qwen2.5-32b-dpo-test base_model:quantized:tanliboy/lambda-qwen2.5-32b-dpo-test license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)