Unbelievable Error: Help ME!

[John6666]

There seem to be several patterns… I hope it’s not a new bug.

ValueError: Trainer: evaluation requires an eval_dataset

I’m trying to do a finetuning without an evaluation dataset. For that, I’m using the following code: training_args = TrainingArguments( output_dir=resume_from_checkpoint, evaluation_strategy="epoch", per_device_train_batch_size=1, ) def compute_metrics(pred: EvalPrediction): labels = pred.label_ids preds = pred.predictions.argmax(-1) f1 = f1_score(labels, preds, average="weighted") acc = accuracy_score(labels, preds, average="…

You can avoid this error by not specifying evaluation_strategy in TrainingArguments.

How to fix "Trainer: evaluation requires an eval_dataset" in Huggingface Transformers?