[Fix] fix the typo bug for window attention (#1106)

8d2d876f · Ying Sheng · GitHub · 326df4ba · 8d2d876f
Unverified Commit 8d2d876f authored Aug 14, 2024 by Ying Sheng Committed by GitHub Aug 14, 2024
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

python/sglang/srt/model_executor/model_runner.py python/sglang/srt/model_executor/model_runner.py +1 -1

No files found.
--- a/python/sglang/srt/model_executor/model_runner.py
+++ b/python/sglang/srt/model_executor/model_runner.py
@@ -337,7 +337,7 @@ class ModelRunner:
                use_tensor_cores=use_tensor_cores,
            )
        else:
-            self.flashinfer_workspace_buffers = torch.empty(
+            self.flashinfer_workspace_buffer = torch.empty(
                global_config.flashinfer_workspace_size,
                dtype=torch.uint8,
                device="cuda",