To add Adamax algorithm to documentation (#63903)
authorIlqar Ramazanli <iramazanli@fb.com>
Thu, 9 Sep 2021 13:39:14 +0000 (06:39 -0700)
committerFacebook GitHub Bot <facebook-github-bot@users.noreply.github.com>
Thu, 9 Sep 2021 13:42:33 +0000 (06:42 -0700)
commit39ce801d1f5cd0e73d6d3e62986f1ccbee6f6942
tree4f29bedb4895a13aecb055a4be9a87434f84f8c7
parent15c21fa45f5160efd759921fc296a16447431ed6
To add Adamax algorithm to documentation (#63903)

Summary:
It has been discussed before that adding description of Optimization algorithms to PyTorch Core documentation may result in a nice Optimization research tutorial. In the following tracking issue we mentioned about all the necessary algorithms and links to the originally published paper  https://github.com/pytorch/pytorch/issues/63236.

In this PR we are adding description of Adamax Algorithm to the documentation.  For more details, we refer to the paper  https://arxiv.org/abs/1412.6980

<img width="447" alt="Adamx" src="https://user-images.githubusercontent.com/73658284/132577306-878ce64c-627a-4086-808c-d0482868d4a1.png">

Pull Request resolved: https://github.com/pytorch/pytorch/pull/63903

Reviewed By: albanD

Differential Revision: D30819055

Pulled By: iramazanli

fbshipit-source-id: 37f748cbea9f93bf37193ee30fc295fb1a1e9ffd
torch/optim/adamax.py