Commits · 72676cd6c0eead68286cf9c8df5c67f580ff477b · change / sglang · GitLab

21 Jun, 2025 2 commits
- feat(oai refactor): Replace `openai_api` with `entrypoints/openai` (#7351) · 72676cd6
  Chang Su authored Jun 21, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
```
  72676cd6
- [OAI Server Refactor] [ChatCompletions & Completions] Support Return Hidden State (#7329) · 5e7fdc79
  Keyang Ru authored Jun 20, 2025
```
Signed-off-by: keru <rukeyang@gmail.com>
```
  5e7fdc79
20 Jun, 2025 4 commits
- [Feature] Comprehensive Hybrid Parallelism Support (#6389) · e879d8b7
  Cheng Wan authored Jun 20, 2025
  
  e879d8b7
- Refine OpenAI serving entrypoint to remove batch requests (#7372) · 09988080
  Xinyuan Tong authored Jun 20, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Chang Su <csu272@usc.edu>
```
  09988080
- Purge VerlEngine (#7326) · 1ab6be1b
  Ata Fatahi authored Jun 19, 2025
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  1ab6be1b
- Feat/refactor embedding server (#7322) · 4df5fc21
  woodx authored Jun 20, 2025
  
  4df5fc21
19 Jun, 2025 2 commits
- Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099) · 3774f078
  Stefan He authored Jun 19, 2025
  
  3774f078
- add seed in CPU UTs to avoid flaky failure (#7333) · 9179ea15
  Chunyuan WU authored Jun 19, 2025
  
  9179ea15
18 Jun, 2025 2 commits
- Add more refactored openai test & in CI (#7284) · ffd1a26e
  Jinn authored Jun 18, 2025
  
  ffd1a26e
- Update python API of activation, topk, norm and rope and remove vllm dependency (#6614) · 094c116f
  YanbingJiang authored Jun 18, 2025
```
Co-authored-by: Wu, Chunyuan <chunyuan.wu@intel.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: sdp <sdp@gnr799219.jf.intel.com>
```
  094c116f
17 Jun, 2025 4 commits
- ci: Fix test_ebnf_generate_all_optional_function_params (#7288) · fc554105
  Chang Su authored Jun 17, 2025
  
  fc554105
- bugfix(tool call ebnf): Fix EBNF generation for optional function parameters (#7283) · e7261315
  Chang Su authored Jun 17, 2025
  
  e7261315
- feat: mtp support dp-attention (#6081) · 10d60cd4
  u4lr451 authored Jun 17, 2025
```
Co-authored-by: austindeng <austindeng@tencent.com>
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  10d60cd4
- [Refactor] OAI Server components (#7167) · 70c471a8
  Xinyuan Tong authored Jun 16, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  70c471a8
16 Jun, 2025 5 commits
- support custom weight loader for model runner (#7122) · 873ae12c
  KavioYu authored Jun 17, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  873ae12c
- Update CI flakes. (#7244) · 62a7aa2e
  Sai Enduri authored Jun 16, 2025
  
  62a7aa2e
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368
- [Eagle] Fix kernel call after updating speculative sampling kernels (#7231) · 53a525bf
  Lianmin Zheng authored Jun 16, 2025
  
  53a525bf
- [EAGLE] Refactor code for page size > 1 & more simplifications (#7213) · b1286a11
  Lianmin Zheng authored Jun 16, 2025
  
  b1286a11
15 Jun, 2025 4 commits
- Revert "[EAGLE] Refactor code for page size > 1 & more simplifications" (#7210) · fff10809
  Lianmin Zheng authored Jun 15, 2025
  
  fff10809
- [EAGLE] Refactor code for page size > 1 & more simplifications (#7163) · 5f1ab327
  Lianmin Zheng authored Jun 14, 2025
  
  5f1ab327
- Move host memory pools into a separate file (#7200) · a023856b
  Lianmin Zheng authored Jun 14, 2025
  
  a023856b
- [PD] Support decode retract and update decode.py (#7196) · db0cc57e
  Byron Hsu authored Jun 14, 2025
  
  db0cc57e
14 Jun, 2025 4 commits
- Increase timeout in test/srt/test_disaggregation.py (#7175) · f47a1b1d
  Lianmin Zheng authored Jun 13, 2025
  
  f47a1b1d
- Improve test cases for eagle infer (#7173) · ba589b88
  Lianmin Zheng authored Jun 13, 2025
  
  ba589b88
- Add test for refactored openai server (#7161) · 50876abc
  Jinn authored Jun 13, 2025
  
  50876abc
- Split the eagle test into two files (#7170) · 0fc3d992
  Lianmin Zheng authored Jun 13, 2025
  
  0fc3d992
11 Jun, 2025 2 commits
- Support VILA models (#6106) · 31d6dee5
  Zijian authored Jun 12, 2025
  
  31d6dee5
- Fix GGuf and add back test_gguf.py (#7067) · 2a5f0100
  Baizhou Zhang authored Jun 10, 2025
  
  2a5f0100
10 Jun, 2025 7 commits
- [Feature] Add Logit Bias (#6579) · ca929118
  Brayden Zhong authored Jun 10, 2025
```
Co-authored-by: Cinjon Resnick <cinjon.resnick@gmail.com>
```
  ca929118
- Open AI API hidden states (#6716) · b56de8f9
  kyle-pena-kuzco authored Jun 10, 2025
  
  b56de8f9
- Revert "Add sanity checks when a test file is not added to CI (#6947)" (#7063) · 2f584455
  Yineng Zhang authored Jun 10, 2025
  
  2f584455
- Add sanity checks when a test file is not added to CI (#6947) · fe55947a
  fzyzcjy authored Jun 11, 2025
  
  fe55947a
- Fix test_lora.py CI (#7061) · 3b014bc1
  Baizhou Zhang authored Jun 10, 2025
  
  3b014bc1
- Fix eagle on AMD (#7051) · 019851d0
  Lianmin Zheng authored Jun 10, 2025
  
  019851d0
- CPU: map changes from developing branch in sgl-kernel (#6833) · fcde67b0
  YanbingJiang authored Jun 10, 2025
```
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  fcde67b0
09 Jun, 2025 4 commits
- Migrate to assertEqual (#6741) · f40942ad
  Emmanuel Ferdman authored Jun 10, 2025
```
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
```
  f40942ad
- Simplify prepare_extend_after_decode (#6987) · dc0705a5
  Lianmin Zheng authored Jun 09, 2025
  
  dc0705a5
- Update amd nightly models CI. (#6992) · 3465d7ae
  Sai Enduri authored Jun 09, 2025
  
  3465d7ae
- chore: upgrade flashinfer v0.2.6.post1 jit (#6958) · 56ccd3c2
  Yineng Zhang authored Jun 09, 2025
```
Co-authored-by: alcanderian <alcanderian@gmail.com>
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
```
  56ccd3c2