python/sglang/srt/layers/attention/flashinfer_backend.py · 8a6906127a81421e06c904273f8e06dff85039a7 · zhaoyu6 / sglang · GitLab

Find file Blame History Permalink

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784) · 8a690612
Lianmin Zheng authored Jan 07, 2025
```
Co-authored-by: SangBin Cho rkooo567@gmail.com
```
8a690612

flashinfer_backend.py 32.5 KB