transformers gguf alignment instruction tuned text generation conversation assistant dpo en dataset:nicholasKluge/instruct-aira-dataset dataset:nicholasKluge/reward-aira-dataset base_model:nicholasKluge/Aira-2-124M-DPO base_model:quantized:nicholasKluge/Aira-2-124M-DPO license:apache-2.0 endpoints_compatible region:us
Small (<1GB)