Commits · 93cf7fc5cd38374a7e21d8f4674518b0f8018a4a · change / sglang

23 Mar, 2025 1 commit
- refactor: bug fixes and refactor for vlm (#4661) · 11577ced
  Mick authored Mar 23, 2025
  
  11577ced
22 Mar, 2025 4 commits
- close gemma2 in test_verl_engine.py temporarily (#4685) · 3c09548d
  Yi Zhang authored Mar 23, 2025
  
  3c09548d
- fix flaky ut (#4670) · e7a8610d
  Yineng Zhang authored Mar 22, 2025
  
  e7a8610d
- [CI fix] test skipping modelopt on AMD (#4677) · a2cc62a6
  Adarsh Shirawalmath authored Mar 23, 2025
  
  a2cc62a6
- [quantization] fix channelwise conversion with scalar weight scale (#4596) · 8cd42504
  Yun Dai authored Mar 22, 2025
  
  8cd42504
20 Mar, 2025 1 commit
- [fix] fix illegal mem access and clean up triton attention backend (#4571) · 9e93ef3f
  JieXin Liang authored Mar 20, 2025
  
  9e93ef3f
19 Mar, 2025 3 commits
- [Feature] Integrate DeepEP into SGLang (#4232) · f44db16c
  Jinyan Chen authored Mar 19, 2025
```
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: Xuting Zhou <xutingz@nvidia.com>
```
  f44db16c
- Optimize Triton decoding kernel for dynamic workload (#4553) · c0e9a36c
  JieXin Liang authored Mar 19, 2025
  
  c0e9a36c
- [Feature] Support Tensor Parallelism and Weight Slicing for Lora (#4274) · 588865f0
  aoshen524 authored Mar 18, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  588865f0
18 Mar, 2025 6 commits
- Reduce computation and communication in DP attention (#4521) · 3196999f
  Cheng Wan authored Mar 18, 2025
  
  3196999f
- [Feature] Support EAGLE 3 (#4247) · 9e0186f3
  James Liu authored Mar 18, 2025
  
  9e0186f3
- use sgl custom all reduce (#4441) · c7872985
  Yineng Zhang authored Mar 18, 2025
  
  c7872985
- Add deepseek v2 torch compile pr test (#4538) · 45212ce1
  Ke Bao authored Mar 18, 2025
  
  45212ce1
- fix: second_per_grid_ts should be used to get mrope position (#3682) · d373a48c
  Mick authored Mar 18, 2025
  
  d373a48c
- Unit test for Hierarchical Caching (#4486) · a98290ae
  Zhiqiang Xie authored Mar 17, 2025
  
  a98290ae
17 Mar, 2025 9 commits
- Remove redundant type conversion (#4513) · 82dec1f7
  Lianmin Zheng authored Mar 17, 2025
  
  82dec1f7
- Fix data parallel + tensor parallel (#4499) · 5493c334
  Lianmin Zheng authored Mar 17, 2025
  
  5493c334
- [Fix] Resolve GPU Memory Leak in update_weights_from_tensor (#4446) · 91ba98fe
  Wei Wu authored Mar 17, 2025
  
  91ba98fe
- Constraint Decoding: Tool call with text (#4067) · 927ca935
  Xihuai Wang authored Mar 17, 2025
  
  927ca935
- Support Online Quantization for W8A8 (#4485) · ef3c2dd0
  Stefan He authored Mar 17, 2025
  
  ef3c2dd0
- [Feature] Support Deepseek-VL2 (#2798) · d6d21640
  萝卜菜 authored Mar 17, 2025
```
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  d6d21640
- Add endpoint for file support, purely to speed up processing of input_embeds. (#2797) · d1112d85
  Rin Intachuen authored Mar 17, 2025
  
  d1112d85
- Feature: support code completion (#3612) · 48efec7b
  woodx authored Mar 17, 2025
  
  48efec7b
- Urgent model support: support gemma-3-it (#4424) · 9d02bb3e
  Mick authored Mar 17, 2025
  
  9d02bb3e
16 Mar, 2025 2 commits
- [Eagle] Remove the greedy branch and some redundant code (#4363) · 1b859295
  Ying Sheng authored Mar 16, 2025
```
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  1b859295
- Fix minor style (#4460) · 2c4f5cca
  Lianmin Zheng authored Mar 15, 2025
  
  2c4f5cca
15 Mar, 2025 1 commit
- Fix test_create_kvindices unit test (#4452) · 21d485f8
  lukec authored Mar 16, 2025
  
  21d485f8
14 Mar, 2025 1 commit

Hierarchical Caching supports MLA (#4009) · 0e0ec702

Lu Changqi authored Mar 14, 2025


Signed-off-by: Changqi Lu <luchangqi.123@bytedance.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0e0ec702

13 Mar, 2025 5 commits
- Add a dummy grok test case (#4399) · f0afaf52
  Lianmin Zheng authored Mar 13, 2025
  
  f0afaf52
- Fix the output of hidden states after HTTP requests (#4269) · 85d2365d
  Qiaolin Yu authored Mar 13, 2025
  
  85d2365d
- Fix auto merge & add back get_flat_data_by_layer (#4393) · a5a892ff
  Lianmin Zheng authored Mar 13, 2025
  
  a5a892ff
- Improve DP attention (#4390) · 8e66fbec
  Lianmin Zheng authored Mar 13, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  8e66fbec
- Support page size > 1 (#4356) · c76040e3
  Lianmin Zheng authored Mar 12, 2025
  
  c76040e3
12 Mar, 2025 2 commits
- Update nightly tests (#4352) · d40ee62b
  Lianmin Zheng authored Mar 12, 2025
  
  d40ee62b
- model: Support Janus-pro (#3203) · 01090e8a
  Mick authored Mar 13, 2025
  
  01090e8a
11 Mar, 2025 2 commits
- refactor: move image processors to separate files (#4229) · ff2ce0b8
  Mick authored Mar 12, 2025
  
  ff2ce0b8
- linear support deepgemm (#4199) · dce303e2
  lukec authored Mar 11, 2025
```
Co-authored-by: yinfan98 <1106310035@qq.com>
```
  dce303e2
10 Mar, 2025 3 commits
- Fix nightly eval for neuralmagic/Mixtral-8x7B-Instruct-v0.1-FP8 (#4279) · 5524e7d0
  Lianmin Zheng authored Mar 10, 2025
  
  5524e7d0
- Amd test fp8 (#4261) · 2ac189ed
  HandH1998 authored Mar 11, 2025
  
  2ac189ed
- Fix quantization and nightly tests (#4258) · 00d25a7f
  Lianmin Zheng authored Mar 10, 2025
  
  00d25a7f