Commits · b044400dd34ecbb7ff3a9dd629d0faf68abaf1b9 · change / sglang · GitLab

03 Jul, 2025 2 commits
- Support non-contiguous query input for extend/decode attention (#7462) · b044400d
  YanbingJiang authored Jul 03, 2025
  
  b044400d
- [RL] support update_weights_from_distributed with different group and multiple weights (#7292) · 0626f678
  Zilin Zhu authored Jul 03, 2025
  
  0626f678
02 Jul, 2025 3 commits
- [AMD] Temporarily disable test_no_overlap_scheduler and test_vision_chunked_prefill (#7717) · b116b21a
  Hubert Lu authored Jul 02, 2025
  
  b116b21a
- [1/n] apply wna16marlin kernel in moe weight only quantization (#7683) · 8e03b641
  AniZpZ authored Jul 02, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>
```
  8e03b641
- Improve error handling for requests with unloaded LoRA path(s) (#7642) · 1a08358a
  Lifu Huang authored Jul 01, 2025
  
  1a08358a
30 Jun, 2025 2 commits
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
- [CPU] add c++ kernel to bind CPU cores and memory node (#7524) · c5131f7a
  Chunyuan WU authored Jun 30, 2025
  
  c5131f7a
29 Jun, 2025 3 commits
- [AMD] Add unit-test-sgl-kernel-amd to AMD CI (#7539) · 3b3f1e3a
  Hubert Lu authored Jun 29, 2025
  
  3b3f1e3a
- Move files related to EPLB (#7580) · 0c9c6c75
  fzyzcjy authored Jun 30, 2025
  
  0c9c6c75
- Fix stream reasoning parser and Adds Kimi reasoning parser (#7432) · 8f335b5b
  Xinyuan Tong authored Jun 29, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  8f335b5b
28 Jun, 2025 3 commits
- fix unit tests (#7618) · a8c10aee
  Yineng Zhang authored Jun 28, 2025
  
  a8c10aee
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
- Fix flakiness in LoRA batch test. (#7552) · 2373faa3
  Lifu Huang authored Jun 27, 2025
  
  2373faa3
27 Jun, 2025 4 commits
- Fix broken CI TestVILAServer (#7610) · d7374d74
  Lifu Huang authored Jun 27, 2025
  
  d7374d74
- Move multimodal processors into a separate folder (#7581) · ce3a3e87
  Lianmin Zheng authored Jun 27, 2025
  
  ce3a3e87
- feat: support compatibility between MTP and two-batch-overlap (#7225) · 41650b0d
  Qiaolin Yu authored Jun 27, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  41650b0d
- Add e2e test for multi instance multi stage memory release/resume occupuation (#7208) · 031f64aa
  Ata Fatahi authored Jun 26, 2025
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  031f64aa
26 Jun, 2025 1 commit
- Update seed in CPU UTs to avoid flaky failure with single test (#7544) · 0e05fe8c
  YanbingJiang authored Jun 26, 2025
  
  0e05fe8c
25 Jun, 2025 4 commits
- Fix FP8 KV Cache Support in FA3 Backend (#7148) · a1c1ebe9
  Yuhong Guo authored Jun 25, 2025
  
  a1c1ebe9
- feat: send kvmetrics from sglang scheduler (#6721) · f3cbd245
  zixuanzhang226 authored Jun 25, 2025
  
  f3cbd245
- [CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel... · 7eb47b0f
  Chunyuan WU authored Jun 25, 2025
```
[CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641)
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  7eb47b0f
- misc: Improvement to serving_chat.py and add more ut (#7489) · 112b496a
  Chang Su authored Jun 24, 2025
  
  112b496a
23 Jun, 2025 2 commits
- ci: Revert openai_server related tests in AMD suites (#7449) · fa42e419
  Chang Su authored Jun 23, 2025
  
  fa42e419
- feat(func_call): Add more check in `BaseFormatDetector.parse_streaming_increment` (#7479) · 34b6b842
  Chang Su authored Jun 23, 2025
  
  34b6b842
22 Jun, 2025 1 commit
- refactor(test): reorganize OpenAI test file structure (#7408) · b7a2df0a
  Chang Su authored Jun 21, 2025
  
  b7a2df0a
21 Jun, 2025 2 commits
- feat(oai refactor): Replace `openai_api` with `entrypoints/openai` (#7351) · 72676cd6
  Chang Su authored Jun 21, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
```
  72676cd6
- [OAI Server Refactor] [ChatCompletions & Completions] Support Return Hidden State (#7329) · 5e7fdc79
  Keyang Ru authored Jun 20, 2025
```
Signed-off-by: keru <rukeyang@gmail.com>
```
  5e7fdc79
20 Jun, 2025 4 commits
- [Feature] Comprehensive Hybrid Parallelism Support (#6389) · e879d8b7
  Cheng Wan authored Jun 20, 2025
  
  e879d8b7
- Refine OpenAI serving entrypoint to remove batch requests (#7372) · 09988080
  Xinyuan Tong authored Jun 20, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Chang Su <csu272@usc.edu>
```
  09988080
- Purge VerlEngine (#7326) · 1ab6be1b
  Ata Fatahi authored Jun 19, 2025
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  1ab6be1b
- Feat/refactor embedding server (#7322) · 4df5fc21
  woodx authored Jun 20, 2025
  
  4df5fc21
19 Jun, 2025 2 commits
- Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099) · 3774f078
  Stefan He authored Jun 19, 2025
  
  3774f078
- add seed in CPU UTs to avoid flaky failure (#7333) · 9179ea15
  Chunyuan WU authored Jun 19, 2025
  
  9179ea15
18 Jun, 2025 2 commits
- Add more refactored openai test & in CI (#7284) · ffd1a26e
  Jinn authored Jun 18, 2025
  
  ffd1a26e
- Update python API of activation, topk, norm and rope and remove vllm dependency (#6614) · 094c116f
  YanbingJiang authored Jun 18, 2025
```
Co-authored-by: Wu, Chunyuan <chunyuan.wu@intel.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: sdp <sdp@gnr799219.jf.intel.com>
```
  094c116f
17 Jun, 2025 4 commits
- ci: Fix test_ebnf_generate_all_optional_function_params (#7288) · fc554105
  Chang Su authored Jun 17, 2025
  
  fc554105
- bugfix(tool call ebnf): Fix EBNF generation for optional function parameters (#7283) · e7261315
  Chang Su authored Jun 17, 2025
  
  e7261315
- feat: mtp support dp-attention (#6081) · 10d60cd4
  u4lr451 authored Jun 17, 2025
```
Co-authored-by: austindeng <austindeng@tencent.com>
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  10d60cd4
- [Refactor] OAI Server components (#7167) · 70c471a8
  Xinyuan Tong authored Jun 16, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  70c471a8
16 Jun, 2025 1 commit
- support custom weight loader for model runner (#7122) · 873ae12c
  KavioYu authored Jun 17, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  873ae12c