Commits · cfe48c59022839596adffa3136b9e2728005aeb3 · change / sglang

"vscode:/vscode.git/clone" did not exist on "3ed0a547b233eaf1153409ba4e59a21da0aa3883"

21 May, 2025 15 commits
- [CPU] Fix build issue (#6419) · cfe48c59
  blzheng authored May 22, 2025
  
  cfe48c59
- [Fix]Fix capture fail bug for DeepSeek (#6275) · d4c038da
  Baizhou Zhang authored May 21, 2025
  
  d4c038da
- Fix bench_one_batch_server (#6503) · 55f6005f
  fzyzcjy authored May 22, 2025
  
  55f6005f
- Let bench_one_batch_server use sharegpt data to make expert distribution more natural (#5573) · 7222e1da
  fzyzcjy authored May 21, 2025
  
  7222e1da
- Tiny make Lint CI show diff (#6445) · 505eec4d
  fzyzcjy authored May 21, 2025
  
  505eec4d
- Support redundant experts in expert parallel (#6461) · ccfe5c00
  fzyzcjy authored May 21, 2025
  
  ccfe5c00
- Tiny add stage assertions to DeepEPDispatcher to avoid misuse (#6467) · a071dc40
  fzyzcjy authored May 21, 2025
  
  a071dc40
- Fix num_qps_per_rank computation when providing custom DeepEP configuration (#6468) · a40aecc5
  fzyzcjy authored May 21, 2025
  
  a40aecc5
- Refactor DeepSeek attention dispatching (#6476) · d6e1d28c
  fzyzcjy authored May 21, 2025
  
  d6e1d28c
- [RL] allow weight updation with dp attention enabled (#6311) · 7c347259
  Zilin Zhu authored May 21, 2025
  
  7c347259
- [router] support http2 in router (#6487) · 669caa0a
  Zilin Zhu authored May 21, 2025
  
  669caa0a
- Implement Siglip Vision model, and support BNB quantization for gemma3-mm (#5339) · 4024e1d2
  Jiajun Li authored May 20, 2025
  
  4024e1d2
- aiter attention-backend (default enabled on AMD/ROCm) (#6381) · 5c0b38f3
  HAI authored May 20, 2025
  
  5c0b38f3
- Refactor group_concurrent_contiguous in NIXL (#6214) · 30ca18f4
  Yuan Luo authored May 21, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  30ca18f4
- Disable all two stream overlap on amd (#6475) · 03886917
  Lianmin Zheng authored May 20, 2025
  
  03886917
20 May, 2025 15 commits
- [docs] Fix torch version (#6472) · 66324895
  Wenxuan Tan authored May 20, 2025
  
  66324895
- Fix master CI for DeepSeek (#6447) · 13feffd0
  fzyzcjy authored May 20, 2025
  
  13feffd0
- Support dispatching logical to physical experts (#6385) · e98afbe0
  fzyzcjy authored May 20, 2025
  
  e98afbe0
- [doc] add note for get_num_kv_splits in triton_backend (#6444) · 69af3ec3
  JieXin Liang authored May 20, 2025
  
  69af3ec3
- Update extend/decode attention kernel for CPU in sgl-kernel and add UTs (#6405) · 32cc66ef
  YanbingJiang authored May 20, 2025
```
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  32cc66ef
- [QuickFix] fix gptq model initialize (#6429) · 83f2d9d4
  PGFLMG authored May 20, 2025
  
  83f2d9d4
- Address performance regression: disable multiple streams on ROCm (#6412) · 6317c5c6
  HAI authored May 19, 2025
  
  6317c5c6
- Support DeepSeek EPLB algorithm with static distributions (#6387) · cba1cdbc
  fzyzcjy authored May 20, 2025
  
  cba1cdbc
- Support loading weights when physical experts are different from logical experts (#6386) · c471d39e
  fzyzcjy authored May 20, 2025
  
  c471d39e
- Refactor DeepSeek logic into atomic operations (#6326) · d0443275
  fzyzcjy authored May 20, 2025
  
  d0443275
- Remove `Cargo.lock`, add it into .gitignore (#6438) · 17d080b7
  Liangsheng Yin authored May 20, 2025
  
  17d080b7
- Refactor communication logic of DeepSeek for extensibility and understandability (#6321) · 1b19df4b
  fzyzcjy authored May 20, 2025
  
  1b19df4b
- Expert distribution recording without overhead for EPLB (#4957) · f0653886
  fzyzcjy authored May 20, 2025
  
  f0653886
- Revert "Implement `return_hidden_states` for the OpenAI API (#6137)" (#6440) · b1465557
  Yineng Zhang authored May 19, 2025
  
  b1465557
- [BUG] fix stop_profile crash (#6431) · b06215da
  Yi Zhang authored May 20, 2025
  
  b06215da
19 May, 2025 6 commits
- [Metrics] Add KV events publishing (#6098) · 7adf245b
  Trevor Morris authored May 19, 2025
  
  7adf245b
- Fix throughput threshold for amd ci test (#6414) · 299fd22f
  Baizhou Zhang authored May 19, 2025
  
  299fd22f
- Improve supported models doc (#6430) · 506e5de8
  simveit authored May 19, 2025
  
  506e5de8
- Fix nodeepgemm init (#6417) · 844e2f22
  lukec authored May 19, 2025
  
  844e2f22
- Implement `return_hidden_states` for the OpenAI API (#6137) · 4f39bcf7
  kyle-pena-kuzco authored May 19, 2025
  
  4f39bcf7
- Fix request id error (#6401) · 31c9569b
  fzyzcjy authored May 19, 2025
  
  31c9569b
18 May, 2025 4 commits
- [Bugfix] Fix field error in v1_embedding_request (#6400) · 1be6956d
  Chang Su authored May 18, 2025
  
  1be6956d
- vlm: tensor hash kernel (#5974) · 626ccb7d
  Mick authored May 19, 2025
  
  626ccb7d
- Refactor DeepSeek MoE layer to unify the two forward branches (#6325) · 72bfb0ba
  fzyzcjy authored May 19, 2025
  
  72bfb0ba
- refactor: Extract repeated member variables in KVCache subclasses to base class. (#6323) · 15521495
  wangxiyu191 authored May 19, 2025
  
  15521495