transformers gguf dpo rlhf trl en base_model:yuvraj17/Llama3-8B-SuperNova-Spectrum-Hermes-DPO base_model:quantized:yuvraj17/Llama3-8B-SuperNova-Spectrum-Hermes-DPO license:apache-2.0 endpoints_compatible region:us conversational
Small (<1GB)