Skip to content

GitLab

Unverified Commit 3b8f0fe5 authored by Richard Zou's avatar Richard Zou Committed by GitHub
Browse files

[torch.compile] Stop assuming 32 bit indexing (#33113) 


Signed-off-by: default avatarRichard Zou <zou3519@gmail.com>
parent c831911b
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
vllm/config/compilation.py
View file @ 3b8f0fe5
...@@ -280,9 +280,10 @@ class DynamicShapesConfig: ...@@ -280,9 +280,10 @@ class DynamicShapesConfig:
until this change picked up https://github.com/pytorch/pytorch/pull/169239. until this change picked up https://github.com/pytorch/pytorch/pull/169239.
""" """
assume_32_bit_indexing: bool = True assume_32_bit_indexing: bool = False
""" """
whether all tensor sizes can use 32 bit indexing. whether all tensor sizes can use 32 bit indexing.
`True` requires PyTorch 2.10+
""" """
def compute_hash(self) -> str: def compute_hash(self) -> str:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment