Hugging Face Forums
Cuda out of memory during evaluation but training is fine
🤗Transformers
vpetren
October 31, 2020, 5:42pm
6
Thanks, switched over to
finetune_trainer.py
and it works great now.
BART model.generate() RuntimeError: Boolean value of Tensor with more than one value is ambiguous
show post in topic
Related topics
Topic
Replies
Views
Activity
CUDA out of memory only during validation not training
🤗Transformers
3
4624
May 9, 2023
Trainer will evaluate using my entire validation set(60k), which gives me cuda memory usage issue:. Is there a param that allows evaluating only on some batches in validation set?
Beginners
4
1362
April 29, 2022
Evaluation error: CUDA out of memory
🤗Transformers
0
748
August 22, 2022
Finetuning BioGPT: Encountering Out of Memory error during evaluation
Models
1
74
April 15, 2025
CUDA out of memory when using Trainer with compute_metrics
🤗Transformers
26
47713
September 19, 2025