Unverified Commit 43b05fa3 authored by youkaichao's avatar youkaichao Committed by GitHub
Browse files

[torch.compile][misc] fix comments (#10993)


Signed-off-by: default avataryoukaichao <youkaichao@gmail.com>
parent a11f3265
......@@ -2177,8 +2177,8 @@ class CompilationConfig(BaseModel):
TODO: move outside cudagraph logic into compilation.
torch.compile will handle cudagraph capture logic in the future.
- cudagraph_capture_sizes: sizes to capture cudagraph.
- None: capture sizes are inferred from compilation context.
- List[int]: capture sizes are specified.
- None (default): capture sizes are inferred from vllm config.
- List[int]: capture sizes are specified as given.
- cudagraph_num_of_warmups: number of warmup runs for cudagraph.
It means the first several runs will be treated as warmup runs.
Only after that, the execution will be recorded, and the recorded
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment