transformers gguf axolotl finetune dpo facebook meta pytorch llama llama-3 en dataset:argilla/ultrafeedback-binarized-preferences base_model:MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.2 base_model:quantized:MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.2 license:other endpoints_compatible region:us imatrix conversational
Small (<1GB)