Skip to content

GitLab

"superbench/vscode:/vscode.git/clone" did not exist on "7cef624e6e8a25351573876bd9bc75d39edcb691"
Unverified Commit e9ae3f80 authored by Kunshang Ji's avatar Kunshang Ji Committed by GitHub
Browse files

[Hardware][XPU] Align memory usage with cuda on xpu (#37029) 


Signed-off-by: default avatarKunshang Ji <jikunshang95@gmail.com>
Signed-off-by: default avatarKunshang Ji <kunshang.ji@intel.com>
parent 04cec4f9
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/platforms/xpu.py
View file @ e9ae3f80
...@@ -236,6 +236,7 @@ class XPUPlatform(Platform): ...@@ -236,6 +236,7 @@ class XPUPlatform(Platform):
def get_current_memory_usage( def get_current_memory_usage(
cls, device: torch.types.Device | None = None cls, device: torch.types.Device | None = None
) -> float: ) -> float:
torch.xpu.empty_cache()
torch.xpu.reset_peak_memory_stats(device) torch.xpu.reset_peak_memory_stats(device)
return torch.xpu.max_memory_allocated(device) return torch.xpu.max_memory_allocated(device)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment