Commits · 8f335b5bd6e2656b6fbe03366b4bbcdab50e2cd8 · change / sglang · GitLab

29 Jun, 2025 1 commit
- Fix stream reasoning parser and Adds Kimi reasoning parser (#7432) · 8f335b5b
  Xinyuan Tong authored Jun 29, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  8f335b5b
28 Jun, 2025 3 commits
- fix unit tests (#7618) · a8c10aee
  Yineng Zhang authored Jun 28, 2025
  
  a8c10aee
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
- Fix flakiness in LoRA batch test. (#7552) · 2373faa3
  Lifu Huang authored Jun 27, 2025
  
  2373faa3
27 Jun, 2025 4 commits
- Fix broken CI TestVILAServer (#7610) · d7374d74
  Lifu Huang authored Jun 27, 2025
  
  d7374d74
- Move multimodal processors into a separate folder (#7581) · ce3a3e87
  Lianmin Zheng authored Jun 27, 2025
  
  ce3a3e87
- feat: support compatibility between MTP and two-batch-overlap (#7225) · 41650b0d
  Qiaolin Yu authored Jun 27, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  41650b0d
- Add e2e test for multi instance multi stage memory release/resume occupuation (#7208) · 031f64aa
  Ata Fatahi authored Jun 26, 2025
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  031f64aa
26 Jun, 2025 1 commit
- Update seed in CPU UTs to avoid flaky failure with single test (#7544) · 0e05fe8c
  YanbingJiang authored Jun 26, 2025
  
  0e05fe8c
25 Jun, 2025 4 commits
- Fix FP8 KV Cache Support in FA3 Backend (#7148) · a1c1ebe9
  Yuhong Guo authored Jun 25, 2025
  
  a1c1ebe9
- feat: send kvmetrics from sglang scheduler (#6721) · f3cbd245
  zixuanzhang226 authored Jun 25, 2025
  
  f3cbd245
- [CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel... · 7eb47b0f
  Chunyuan WU authored Jun 25, 2025
```
[CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641)
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  7eb47b0f
- misc: Improvement to serving_chat.py and add more ut (#7489) · 112b496a
  Chang Su authored Jun 24, 2025
  
  112b496a
23 Jun, 2025 2 commits
- ci: Revert openai_server related tests in AMD suites (#7449) · fa42e419
  Chang Su authored Jun 23, 2025
  
  fa42e419
- feat(func_call): Add more check in `BaseFormatDetector.parse_streaming_increment` (#7479) · 34b6b842
  Chang Su authored Jun 23, 2025
  
  34b6b842
22 Jun, 2025 1 commit
- refactor(test): reorganize OpenAI test file structure (#7408) · b7a2df0a
  Chang Su authored Jun 21, 2025
  
  b7a2df0a
21 Jun, 2025 2 commits
- feat(oai refactor): Replace `openai_api` with `entrypoints/openai` (#7351) · 72676cd6
  Chang Su authored Jun 21, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
```
  72676cd6
- [OAI Server Refactor] [ChatCompletions & Completions] Support Return Hidden State (#7329) · 5e7fdc79
  Keyang Ru authored Jun 20, 2025
```
Signed-off-by: keru <rukeyang@gmail.com>
```
  5e7fdc79
20 Jun, 2025 4 commits
- [Feature] Comprehensive Hybrid Parallelism Support (#6389) · e879d8b7
  Cheng Wan authored Jun 20, 2025
  
  e879d8b7
- Refine OpenAI serving entrypoint to remove batch requests (#7372) · 09988080
  Xinyuan Tong authored Jun 20, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Chang Su <csu272@usc.edu>
```
  09988080
- Purge VerlEngine (#7326) · 1ab6be1b
  Ata Fatahi authored Jun 19, 2025
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  1ab6be1b
- Feat/refactor embedding server (#7322) · 4df5fc21
  woodx authored Jun 20, 2025
  
  4df5fc21
19 Jun, 2025 2 commits
- Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099) · 3774f078
  Stefan He authored Jun 19, 2025
  
  3774f078
- add seed in CPU UTs to avoid flaky failure (#7333) · 9179ea15
  Chunyuan WU authored Jun 19, 2025
  
  9179ea15
18 Jun, 2025 2 commits
- Add more refactored openai test & in CI (#7284) · ffd1a26e
  Jinn authored Jun 18, 2025
  
  ffd1a26e
- Update python API of activation, topk, norm and rope and remove vllm dependency (#6614) · 094c116f
  YanbingJiang authored Jun 18, 2025
```
Co-authored-by: Wu, Chunyuan <chunyuan.wu@intel.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: sdp <sdp@gnr799219.jf.intel.com>
```
  094c116f
17 Jun, 2025 4 commits
- ci: Fix test_ebnf_generate_all_optional_function_params (#7288) · fc554105
  Chang Su authored Jun 17, 2025
  
  fc554105
- bugfix(tool call ebnf): Fix EBNF generation for optional function parameters (#7283) · e7261315
  Chang Su authored Jun 17, 2025
  
  e7261315
- feat: mtp support dp-attention (#6081) · 10d60cd4
  u4lr451 authored Jun 17, 2025
```
Co-authored-by: austindeng <austindeng@tencent.com>
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  10d60cd4
- [Refactor] OAI Server components (#7167) · 70c471a8
  Xinyuan Tong authored Jun 16, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  70c471a8
16 Jun, 2025 5 commits
- support custom weight loader for model runner (#7122) · 873ae12c
  KavioYu authored Jun 17, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  873ae12c
- Update CI flakes. (#7244) · 62a7aa2e
  Sai Enduri authored Jun 16, 2025
  
  62a7aa2e
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368
- [Eagle] Fix kernel call after updating speculative sampling kernels (#7231) · 53a525bf
  Lianmin Zheng authored Jun 16, 2025
  
  53a525bf
- [EAGLE] Refactor code for page size > 1 & more simplifications (#7213) · b1286a11
  Lianmin Zheng authored Jun 16, 2025
  
  b1286a11
15 Jun, 2025 4 commits
- Revert "[EAGLE] Refactor code for page size > 1 & more simplifications" (#7210) · fff10809
  Lianmin Zheng authored Jun 15, 2025
  
  fff10809
- [EAGLE] Refactor code for page size > 1 & more simplifications (#7163) · 5f1ab327
  Lianmin Zheng authored Jun 14, 2025
  
  5f1ab327
- Move host memory pools into a separate file (#7200) · a023856b
  Lianmin Zheng authored Jun 14, 2025
  
  a023856b
- [PD] Support decode retract and update decode.py (#7196) · db0cc57e
  Byron Hsu authored Jun 14, 2025
  
  db0cc57e
14 Jun, 2025 1 commit
- Increase timeout in test/srt/test_disaggregation.py (#7175) · f47a1b1d
  Lianmin Zheng authored Jun 13, 2025
  
  f47a1b1d