Jump to content

Absolute and Relative Error for LLM Training

Recommended Posts

Hi everyone,

I'm currently working with Rulex software to train an LLM model, and I'm facing issues with overfitting. To address this, I'm fine-tuning some parameters, but I need some clarification.

Specifically, I'm trying to understand the difference between the "maximum absolute error" parameter that I can specify in the model and the option to use "relative error." How do these two parameters differ and interact?

Thank you in advance for your assistance!

Best regards,


Link to comment
Share on other sites

  • 2 weeks later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Create New...