peft safetensors trl sft generated_from_trainer text-generation conversational fr dataset:Svngoku/french-multilingual-reward-bench-dpo arxiv:2408.14960 arxiv:2407.02552 arxiv:2406.18682 arxiv:2410.10801 base_model:CohereLabs/aya-expanse-8b base_model:adapter:CohereLabs/aya-expanse-8b license:cc-by-nc-4.0 region:us
Small (<1GB)