Skip to content

GitLab

Unverified Commit 8d2d876f authored by Ying Sheng's avatar Ying Sheng Committed by GitHub
Browse files

[Fix] fix the typo bug for window attention (#1106)

parent 326df4ba
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/model_executor/model_runner.py
View file @ 8d2d876f
...@@ -337,7 +337,7 @@ class ModelRunner: ...@@ -337,7 +337,7 @@ class ModelRunner:
use_tensor_cores=use_tensor_cores, use_tensor_cores=use_tensor_cores,
) )
else: else:
self.flashinfer_workspace_buffers = torch.empty( self.flashinfer_workspace_buffer = torch.empty(
global_config.flashinfer_workspace_size, global_config.flashinfer_workspace_size,
dtype=torch.uint8, dtype=torch.uint8,
device="cuda", device="cuda",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment