transformer_engine/pytorch/attention.py · 54e46e21a989ac2808e29ce3c20275738d506afe · OpenDAS / TransformerEngine

Use non-deprecated PyTorch methods to silence warnings (#541) · 54e46e21

Deepak Narayanan authored Nov 28, 2023



Getting warnings of the following form using ToT TE:

```
/usr/local/lib/python3.10/dist-packages/transformer_engine/pytorch/attention.py:852: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly.  To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
   data_ptr = grad_outputs[0].storage().data_ptr()
```
Signed-off-by: Deepak Narayanan <2724038+deepakn94@users.noreply.github.com>

54e46e21

attention.py 132 KB

Replace attention.py