Meta-Llama-3-8B-Instruct: Validation Error "Max_new_tokens"

[John6666]

Switching to another model fixed the issue for me

I wonder if this is it?

Finetuning Meta-Llama-3.1-8B using PEFT

I’ve been working on code to fine-tune (locally) the meta-llama/Meta-Llama-3.1-8B or meta-llama/Meta-Llama-3.1-8B-Instruct model that I downloaded in local server, using the example from the Hugging Face repository at huggingface/huggingface-llama-recipes. I made some adjustments to the code to fit my custom dataset. While the training process seems to complete successfully, I’m encountering an issue during inference: the model generates gibberish responses, even for general questions. Sample …