Menu
What is the difference between clipnorm and clipval.
Ex: opt = SGD(lr=0.01, momentum=0.9, clipnorm=1.0)
353
asked Oct 12 '25 17:10
Incase of clipnorm, the l2 norm of the gradients is capped at the specified value.
While clipvalue caps the gradient values such that they don't exceed the specified value
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With