peft tensorboard safetensors trl dpo generated_from_trainer base_model:TheBloke/OpenHermes-2-Mistral-7B-GPTQ base_model:adapter:TheBloke/OpenHermes-2-Mistral-7B-GPTQ license:apache-2.0 region:us
Small (<1GB)