Skip to content

GitLab

Unverified Commit cc88d98a authored by DangKai's avatar DangKai Committed by GitHub
Browse files

fix empty_cache error in pt_weights_iterator (#5151) 


Co-authored-by: default avatardangkai.dk <dangkai.dk@alibaba-inc.com>
parent 3033c11a
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 1 deletion
python/sglang/srt/model_loader/weight_utils.py
View file @ cc88d98a
......@@ -457,7 +457,6 @@ def pt_weights_iterator(
state = torch.load(bin_file, map_location="cpu", weights_only=True)
yield from state.items()
del state
torch.cuda.empty_cache()
def get_gguf_extra_tensor_names(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment