Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Difference between MultiplicativeLR and LambdaLR

Can someone explain difference between torch.optim.lr_scheduler.LambdaLR(https://pytorch.org/docs/stable/optim.html) and torch.optim.lr_scheduler.MultiplicativeLR(https://pytorch.org/docs/stable/optim.html)?

Here is brief description of MultiplicativeLR:

enter image description here

and LambdaLR enter image description here

like image 286
AlexM Avatar asked Sep 14 '25 09:09

AlexM


1 Answers

The main difference is that they use a different function for computing the learning rate of the function.

LambdaLR's function is:

enter image description here

While MultiplicativeLR's function is:

enter image description here

Thus they would have a different result for the learning rate. Both are useful for a variety of scenarios.

like image 184
hypadr1v3 Avatar answered Sep 16 '25 23:09

hypadr1v3