transformers gguf unsloth trl dpo en base_model:michaelnguyen11/TwinLlama-3.2-3B-DPO base_model:quantized:michaelnguyen11/TwinLlama-3.2-3B-DPO endpoints_compatible region:us conversational
Small (<1GB)