transformers gguf alignment-handbook generated_from_trainer trl dpo en dataset:HuggingFaceH4/ultrafeedback_binarized dataset:HuggingFaceH4/cai-conversation-harmless base_model:vwxyzjn/mistral-7b-dpo-constitutional-ai base_model:quantized:vwxyzjn/mistral-7b-dpo-constitutional-ai license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)