GitLab

修复pp并行+chunked-prefill时kvcache memory leak

See merge request !1

Fix ZMQ bind error on non-zero rank nodes when using SGLANG_BLOCK_NONZERO_RANK_CHILDREN=0

See merge request OpenDAS/sglang!42

低延迟模式支持dispatch int8

See merge request OpenDAS/sglang!41

V0.5.4 dev yiqa

See merge request OpenDAS/sglang!40

添加w_scale=1的判断，消除两处elementwise数乘操作

See merge request OpenDAS/sglang!39

fix compile and op issues

See merge request OpenDAS/sglang!38

设置tbo相关变量 & 修改tbo拷贝

See merge request OpenDAS/sglang!37

add pin_memory

See merge request OpenDAS/sglang!35

w8a8适配continues算子

See merge request OpenDAS/sglang!34

优化量化算子、可设置tp等于dp、优化调度层非pinned memory异步拷贝问题

See merge request OpenDAS/sglang!33

mtp增加dcu_assign_req_to_token_pool、dcu_get_last_loc、dcu_assign_extend_cache_locs、d...

See merge request OpenDAS/sglang!32

支持w8a8 compile，注册自定义算子解决部分断图问题

See merge request OpenDAS/sglang!31

增加dcu_assign_req_to_token_pool、dcu_get_last_loc、dcu_assign_extend_cache_locs、dcu_create_flashmla_kv_indices、dcu_create_chunked_prefix_cache_kv_indices算子

修复w8a8_marlin tp pp

See merge request OpenDAS/sglang!30

V0.5.4 dev linhai

See merge request OpenDAS/sglang!28

sgl_kernel适配torch2.7

See merge request OpenDAS/sglang!26

适配w8a8_marlin 高吞吐模式

See merge request OpenDAS/sglang!25

使用groupgemm完成高吞吐模式适配。

See merge request OpenDAS/sglang!24