Unverified Commit 8983e021 authored by Wentao Ye's avatar Wentao Ye Committed by GitHub
Browse files

[CI] Fix Pre-commit Issue Cannot determine type of "rank" and "world_size" (#26448)


Signed-off-by: default avataryewentao256 <zhyanwentao@126.com>
parent 1ee35382
......@@ -377,6 +377,11 @@ class FlashInferAllToAllManager(All2AllManagerBase):
All2All communication based on flashinfer kernels.
"""
# This type lint could be removed after all of the work in
# https://github.com/vllm-project/vllm/issues/26533 done.
rank: int
world_size: int
def __init__(self, cpu_group):
assert has_flashinfer_all2all(), (
"flashinfer all2all module not found. Please install/check flashinfer"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment