Skip to content

GitLab

Commit 86f9eb6d authored by Woosuk Kwon's avatar Woosuk Kwon
Browse files

Fix typo

parent 1f6c7ef4
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 1 deletion
cacheflow/models/opt.py
View file @ 86f9eb6d
...@@ -179,7 +179,6 @@ class OPTDecoder(OPTPreTrainedModel): ...@@ -179,7 +179,6 @@ class OPTDecoder(OPTPreTrainedModel):
) -> torch.Tensor: ) -> torch.Tensor:
inputs_embeds = self.embed_tokens(input_ids) inputs_embeds = self.embed_tokens(input_ids)
pos_embeds = self.embed_positions(positions) pos_embeds = self.embed_positions(positions)
pos_embeds = None
if self.project_in is not None: if self.project_in is not None:
inputs_embeds = self.project_in(inputs_embeds) inputs_embeds = self.project_in(inputs_embeds)
hidden_states = inputs_embeds + pos_embeds hidden_states = inputs_embeds + pos_embeds
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment