Skip to content

GitLab

Unverified Commit d5dbdbfc authored by Angela Yi's avatar Angela Yi Committed by GitHub
Browse files

[docs] Fix cudagraph mode config (#29170) 


Signed-off-by: default avatarangelayi <yiangela7@gmail.com>
parent 30d64662
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
docs/design/debug_vllm_compile.md
View file @ d5dbdbfc
...@@ -9,7 +9,7 @@ TL;DR: ...@@ -9,7 +9,7 @@ TL;DR:
|----------|----------|-------------| |----------|----------|-------------|
| --enforce-eager | enforce_eager=True | Turn off torch.compile and CUDAGraphs | | --enforce-eager | enforce_eager=True | Turn off torch.compile and CUDAGraphs |
| -O.mode=0 | mode=CompilationMode.NONE | Turn off torch.compile only | | -O.mode=0 | mode=CompilationMode.NONE | Turn off torch.compile only |
| -O.cudagraph_mode=NONE | compilation_config=CompilationConfig(mode=CompilationMode.NONE) | Turn off CUDAGraphs only | | -O.cudagraph_mode=NONE | compilation_config=CompilationConfig(cudagraph_mode=CUDAGraphMode.NONE) | Turn off CUDAGraphs only |
| -O.backend=eager | compilation_config=CompilationConfig(backend='eager') | Turn off TorchInductor | | -O.backend=eager | compilation_config=CompilationConfig(backend='eager') | Turn off TorchInductor |
## vLLM-torch.compile overview ## vLLM-torch.compile overview
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment