Commits · 094c116f7dc4a5a4d845ce812406e9514a275266 · zhaoyu6 / sglang · GitLab

18 Jun, 2025 4 commits
- Update python API of activation, topk, norm and rope and remove vllm dependency (#6614) · 094c116f
  YanbingJiang authored Jun 18, 2025
```
Co-authored-by: Wu, Chunyuan <chunyuan.wu@intel.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: sdp <sdp@gnr799219.jf.intel.com>
```
  094c116f
- Upstreaming hicache bug fixes (#7267) · e56685ac
  Zhiqiang Xie authored Jun 17, 2025
  
  e56685ac
- [PD] Add custom memory pool option to support Mooncake PD with NVLink (#7264) · c26d7349
  shangmingc authored Jun 18, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  c26d7349
- [PD] Support get local ip from NIC for PD disaggregation (#7237) · ceaa85c9
  shangmingc authored Jun 18, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  ceaa85c9
17 Jun, 2025 10 commits
- fix: resolve b200 dsv3 mtp issue (#7286) · 4f204db5
  Yineng Zhang authored Jun 17, 2025
  
  4f204db5
- Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842) · 3eb4a800
  AniZpZ authored Jun 18, 2025
  
  3eb4a800
- bugfix(tool call ebnf): Fix EBNF generation for optional function parameters (#7283) · e7261315
  Chang Su authored Jun 17, 2025
  
  e7261315
- Fix Deepseek R1 0528 FP4 tensor name mismatch issue during weights loading. (#7164) · 8c16da33
  Charles Chen authored Jun 17, 2025
  
  8c16da33
- support qwen2 running on ascend npu device (#7022) · a39d9287
  Yijie Zhu authored Jun 18, 2025
```
Co-authored-by: 刁莹煜 <diaoyingyu1@hisilicon.com>
```
  a39d9287
- feat: mtp support dp-attention (#6081) · 10d60cd4
  u4lr451 authored Jun 17, 2025
```
Co-authored-by: austindeng <austindeng@tencent.com>
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  10d60cd4
- [amd] Opt dsv3 moe (#7160) · 405780bc
  kk authored Jun 17, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  405780bc
- OAI Server Skeleton & Core Utility Endpoints (#7179) · 1dffee31
  yhyang201 authored Jun 17, 2025
  
  1dffee31
- [Refactor] OAI Server components (#7167) · 70c471a8
  Xinyuan Tong authored Jun 16, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  70c471a8
- Fix AMD speculative decoding (#7252) · 1a9c2c92
  Lianmin Zheng authored Jun 16, 2025
  
  1a9c2c92
16 Jun, 2025 14 commits
- support custom weight loader for model runner (#7122) · 873ae12c
  KavioYu authored Jun 17, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  873ae12c
- Use seq_len_fill_value in the cuda graph runners (#7233) · c64290dc
  Lianmin Zheng authored Jun 16, 2025
  
  c64290dc
- fix amd EP MoE FP8 issue (#7125) · 8e2363dc
  Alex Sun authored Jun 17, 2025
  
  8e2363dc
- chore: bump v0.4.7.post1 (#7248) · f9dc9dd2
  Yineng Zhang authored Jun 16, 2025
  
  f9dc9dd2
- [fix] fix DeepGEMM blackwell input quant & ut & fix style and log (#7247) · 5ca07eed
  JieXin Liang authored Jun 17, 2025
  
  5ca07eed
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368
- Tiny remove comments about DeepEP on H20 (#7234) · 91a066ec
  fzyzcjy authored Jun 17, 2025
  
  91a066ec
- minor fix (#7245) · c4943867
  Liangsheng Yin authored Jun 16, 2025
  
  c4943867
- [Eagle] Fix kernel call after updating speculative sampling kernels (#7231) · 53a525bf
  Lianmin Zheng authored Jun 16, 2025
  
  53a525bf
- [EAGLE] Fix draft kv cache layout for fa3 and topk > 1 (#7239) · 7ddf8e83
  Lianmin Zheng authored Jun 16, 2025
  
  7ddf8e83
- [EAGLE] Refactor code for page size > 1 & more simplifications (#7213) · b1286a11
  Lianmin Zheng authored Jun 16, 2025
  
  b1286a11
- Minor style and doc fix (#7228) · 21615cc3
  Lianmin Zheng authored Jun 16, 2025
  
  21615cc3
- Implement gather before attn (#6378) · 3c2274fb
  Cheng Wan authored Jun 15, 2025
  
  3c2274fb
- Fix ChunkCache object has no attribute 'disable' (#7217) · d2679f51
  Baizhou Zhang authored Jun 15, 2025
  
  d2679f51
15 Jun, 2025 11 commits
- Minor PD style fix (#7215) · 96be97bf
  Byron Hsu authored Jun 15, 2025
  
  96be97bf
- [PD] use int32 for kv indices & get num_reserved_decode_tokens from server_args (#7214) · 88f9c347
  Byron Hsu authored Jun 15, 2025
  
  88f9c347
- Revert "[EAGLE] Refactor code for page size > 1 & more simplifications" (#7210) · fff10809
  Lianmin Zheng authored Jun 15, 2025
  
  fff10809
- [EAGLE] Refactor code for page size > 1 & more simplifications (#7163) · 5f1ab327
  Lianmin Zheng authored Jun 14, 2025
  
  5f1ab327
- Fix grammar abort & Minor style fixes (#7204) · 38af4f68
  Lianmin Zheng authored Jun 14, 2025
  
  38af4f68
- Lianmin/simplify memory pool (#7202) · a6305c7d
  Lianmin Zheng authored Jun 14, 2025
  
  a6305c7d
- Move host memory pools into a separate file (#7200) · a023856b
  Lianmin Zheng authored Jun 14, 2025
  
  a023856b
- [PD] Support decode retract and update decode.py (#7196) · db0cc57e
  Byron Hsu authored Jun 14, 2025
  
  db0cc57e
- Fix error when disabling new DeepGEMM (#7198) · 349bb2c9
  fzyzcjy authored Jun 15, 2025
  
  349bb2c9
- chore: upgrade sgl-kernel v0.1.8.post2 (#7186) · ed89837c
  JieXin Liang authored Jun 15, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  ed89837c
- [fix] fix determine_num_fused_shared_experts (#7180) · 55561e25
  JieXin Liang authored Jun 15, 2025
  
  55561e25
14 Jun, 2025 1 commit
- Fix a minor bug related to DeepGEMM upgrade (#7191) · 0bd67ba2
  Zhijian Liu authored Jun 14, 2025
  
  0bd67ba2