projects / platform / upstream / tvm.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: 7732873) | patch
[Relay][Training] Add checkpoint annotation for checkpointing memory optimization...
authorAltan Haan <altanh@cs.washington.edu>
Sun, 27 Oct 2019 00:04:42 +0000 (17:04 -0700)
committerJared Roesch <roeschinc@gmail.com>
Sun, 27 Oct 2019 00:04:42 +0000 (17:04 -0700)
commit93d610a19a8fdef0e2dd1513cf07023876e42d74
tree323ac653a2ca52529882bcdb15acf9fab7666c9ctree | snapshot
parent7732873e65269b6d0bb1bd63f3197a976645e75bcommit | diff
[Relay][Training] Add checkpoint annotation for checkpointing memory optimization (#4146)

* add checkpoint annotation for checkpointing memory optimization

* add alpha-equivalence checkpoint test and fix gradient type issue

* fix build issues

* ignore checkpoint annotation when checking missing gradients

* refactor, fix checkpoint compute for tuple and add tests
python/tvm/relay/op/annotation/annotation.py diff | blob | history
src/relay/op/annotation/annotation.cc diff | blob | history
src/relay/pass/de_duplicate.cc diff | blob | history
src/relay/pass/gradient.cc diff | blob | history
tests/python/relay/test_op_grad_level10.py diff | blob | history
tests/python/relay/test_op_level10.py diff | blob | history
Domain: Machine Learning / ML Framework;