python/sglang/srt/layers/radix_attention.py · e8a2327d523ce646edf400a2c6da647ca7d8c645 · zhaoyu6 / sglang

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

radix_attention.py 5.68 KB

Replace radix_attention.py