How was self.loss_function implemented

[John6666]

Maybe this?

Where to look for a loss definition for a pretrained model?

I am using facebook/opt-350m model: model = AutoModelForCausalLM.from_pretrained("facebook/opt-350m") As far as I understand, its default loss is the crossentropy loss. But how can I verify it, and where can I see the implementation details? Thank you.

Having troubel in understanding what loss is currently in use

I was going through this hugging face code and I am having trouble understanding what loss the model is currently using. Although I know most seq2seq models uses CrossEntrophy loss but I don’t see the definition anywhere in the code Actually I want to train the model with a new custom loss. I have trained a baseline model and its working fine. Thank You