fix empty_cache error in pt_weights_iterator (#5151)

Co-authored-by: dangkai.dk <dangkai.dk@alibaba-inc.com>

fix empty_cache error in pt_weights_iterator (#5151)
Co-authored-by: dangkai.dk <dangkai.dk@alibaba-inc.com>
cc88d98a · DangKai · GitHub · 3033c11a · cc88d98a
Unverified Commit cc88d98a authored Apr 08, 2025 by DangKai Committed by GitHub Apr 08, 2025
Show whitespace changes
Inline Side-by-side

Showing with 0 additions and 1 deletion

python/sglang/srt/model_loader/weight_utils.py python/sglang/srt/model_loader/weight_utils.py +0 -1

No files found.
--- a/python/sglang/srt/model_loader/weight_utils.py
+++ b/python/sglang/srt/model_loader/weight_utils.py
@@ -457,7 +457,6 @@ def pt_weights_iterator(
        state = torch.load(bin_file, map_location="cpu", weights_only=True)
        yield from state.items()
        del state
-        torch.cuda.empty_cache()
 def get_gguf_extra_tensor_names(