Struggling with fine tuning bert

But i feel no matter what i do the model is just not “learning”.

If there is no change in the model output, it may be because the model layers themselves are frozen and prevented from learning, or because the dataset label names are not in the expected format, effectively rendering the dataset “empty”. In this case, it is probably the latter.

For BERT fine-tuning, how about this video for now?