Skip to content

GitLab

Commit 668ec4ef authored by zhuwenwen's avatar zhuwenwen
Browse files

Update refactoring operation

parent 8a325c18
Show whitespace changes
Inline Side-by-side
Showing with 23 additions and 23 deletions
vllm/model_executor/layers/activation.py
View file @ 668ec4ef
...@@ -36,7 +36,7 @@ class SiluAndMul(CustomOp): ...@@ -36,7 +36,7 @@ class SiluAndMul(CustomOp):
output_shape = (x.shape[:-1] + (d, )) output_shape = (x.shape[:-1] + (d, ))
out = torch.empty(output_shape, dtype=x.dtype, device=x.device) out = torch.empty(output_shape, dtype=x.dtype, device=x.device)
if envs.VLLM_USE_OPT_OP: if envs.VLLM_USE_OPT_OP:
ops.silu_and_mul(out, x) ops.silu_and_mul_opt(out, x)
else: else:
ops.silu_and_mul(out, x) ops.silu_and_mul(out, x)
return out return out
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment