Restore LayerNorm numerics test (#64385)
authorRichard Zou <zou3519@gmail.com>
Wed, 1 Sep 2021 22:12:05 +0000 (15:12 -0700)
committerFacebook GitHub Bot <facebook-github-bot@users.noreply.github.com>
Wed, 1 Sep 2021 22:32:49 +0000 (15:32 -0700)
commit535526b95cb26be10c0942129911db7d281d5bd9
tree0f18e605be3dfeaed068fd34c6696e40a1155745
parent7ffcf1550374af29f5b3ce316d4e576423945be0
Restore LayerNorm numerics test (#64385)

Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/64385

It was deleted in https://github.com/pytorch/pytorch/pull/63276.

The numerics test was meant to check LayerNorm behavior on large inputs,
but we deleted it without realizing that.

Test Plan: - wait for tests.

Reviewed By: ngimel

Differential Revision: D30702950

Pulled By: zou3519

fbshipit-source-id: a480e26c45ec38fb628938b70416cdb22d976a46
test/test_nn.py