transformers safetensors phi text-generation trl fietje alignment-handbook dpo conversational nl dataset:BramVanroy/ultra_feedback_dutch_cleaned dataset:BramVanroy/orca_dpo_pairs_dutch_cleaned arxiv:2412.15450 base_model:BramVanroy/fietje-2-instruct base_model:finetune:BramVanroy/fietje-2-instruct license:mit autotrain_compatible text-generation-inference region:us
Medium (1-5GB)