transformers gguf alignment-handbook trl orpo generated_from_trainer en dataset:argilla/ultrafeedback-binarized-preferences-cleaned dataset:argilla/distilabel-capybara-dpo-7k-binarized base_model:vain05/stablelm-2-1_6b-orpo-full-v3 base_model:quantized:vain05/stablelm-2-1_6b-orpo-full-v3 license:other endpoints_compatible region:us conversational
Small (<1GB)