Commit d7dabfef authored by Ari's avatar Ari Committed by Lysandre Debut
Browse files

Fix documentation in ProjectedAdaptiveLogSoftmax

parent 42f08e59
...@@ -90,9 +90,9 @@ class ProjectedAdaptiveLogSoftmax(nn.Module): ...@@ -90,9 +90,9 @@ class ProjectedAdaptiveLogSoftmax(nn.Module):
labels :: [len*bsz] labels :: [len*bsz]
Return: Return:
if labels is None: if labels is None:
out :: [len*bsz] Negative log likelihood
else:
out :: [len*bsz x n_tokens] log probabilities of tokens over the vocabulary out :: [len*bsz x n_tokens] log probabilities of tokens over the vocabulary
else:
out :: [len*bsz] Negative log likelihood
We could replace this implementation by the native PyTorch one We could replace this implementation by the native PyTorch one
if their's had an option to set bias on all clusters in the native one. if their's had an option to set bias on all clusters in the native one.
here: https://github.com/pytorch/pytorch/blob/dbe6a7a9ff1a364a8706bf5df58a1ca96d2fd9da/torch/nn/modules/adaptive.py#L138 here: https://github.com/pytorch/pytorch/blob/dbe6a7a9ff1a364a8706bf5df58a1ca96d2fd9da/torch/nn/modules/adaptive.py#L138
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment