Commits · 2d54d4bb648dea1bcb13af2ddab30fcf4e1fa37f · change / sglang · GitLab

10 Jul, 2025 1 commit
- Feat: Support Phi-3.5-MoE in SGLang (#7907) · 2d54d4bb
  Binyao Jiang authored Jul 09, 2025
  
  2d54d4bb
09 Jul, 2025 3 commits
- chore: bump v0.4.9.post1 (#7882) · 066f4ec9
  Yineng Zhang authored Jul 09, 2025
  
  066f4ec9
- Update native_api doc to match the change in the `get_model_info` endpoint (#7660) · 08702321
  Yikai Zhang authored Jul 09, 2025
```
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  08702321
- [PD] Add guidance for prefill bootstrap timeout (#7846) · 64c5907e
  Shangming Cai authored Jul 09, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  64c5907e
08 Jul, 2025 1 commit
- Support Mimo-VL (#7579) · 43e20c06
  Xinyuan Tong authored Jul 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  43e20c06
06 Jul, 2025 1 commit
- chore: bump v0.4.9 (#7802) · ec5f9c62
  Yineng Zhang authored Jul 05, 2025
  
  ec5f9c62
04 Jul, 2025 1 commit
- fix(docs): fix the broken link in `docs/references/production_metrics.md` (#7741) · 1e3e3add
  Yuchen Cheng authored Jul 04, 2025
```
Signed-off-by: rudeigerc <rudeigerc@gmail.com>
```
  1e3e3add
03 Jul, 2025 2 commits
- fix CI: update native api ipynb (#7754) · 43f93f63
  Xinyuan Tong authored Jul 03, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  43f93f63
- Ascend attention backend(PA&MLA) (#7722) · 1e0e5497
  ronnie_zheng authored Jul 03, 2025
```
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: VDV1985 <vladdv85@mail.ru>
```
  1e0e5497
01 Jul, 2025 2 commits
- add description for llama4 eagle3 (#7688) · 93b6785d
  Yi Zhang authored Jul 01, 2025
  
  93b6785d
- [doc] update lws doc for pd (#7318) · 7349717e
  ybyang authored Jul 01, 2025
  
  7349717e
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
28 Jun, 2025 1 commit

Hybrid kv cache for LLaMA4 (#6563) · eb6c2c16

tarinkk authored Jun 27, 2025


Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: tarinkk <rt572@physics.rutger.edu>
Co-authored-by: tarinkk <rt572@rutgers.physics.edu>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>

eb6c2c16

26 Jun, 2025 2 commits
- chore: bump v0.4.8.post1 (#7559) · 69183f88
  Yineng Zhang authored Jun 26, 2025
  
  69183f88
- [PD] Raise error for incompatible mooncake version and some minor fixes (#7527) · 5c214257
  Shangming Cai authored Jun 26, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  5c214257
24 Jun, 2025 1 commit
- chore: bump v0.4.8 (#7493) · 7c3a12c0
  Yineng Zhang authored Jun 23, 2025
  
  7c3a12c0
23 Jun, 2025 1 commit
- Update hyperparameter_tuning.md (#7454) · 30ceccc7
  Lianmin Zheng authored Jun 22, 2025
  
  30ceccc7
21 Jun, 2025 2 commits
- feat(oai refactor): Replace `openai_api` with `entrypoints/openai` (#7351) · 72676cd6
  Chang Su authored Jun 21, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
```
  72676cd6
- Remove batches api in docs & example (#7400) · ab74f8f0
  Jinn authored Jun 20, 2025
  
  ab74f8f0
20 Jun, 2025 1 commit
- [Doc] add embedding rerank doc (#7364) · 97011abc
  woodx authored Jun 20, 2025
  
  97011abc
19 Jun, 2025 1 commit
- docs: update installation (#7366) · fadf18fd
  Yineng Zhang authored Jun 19, 2025
  
  fadf18fd
18 Jun, 2025 1 commit
- update invalid link in doc (#7297) · 1de4db9b
  linzhuo authored Jun 18, 2025
  
  1de4db9b
17 Jun, 2025 1 commit
- support qwen2 running on ascend npu device (#7022) · a39d9287
  Yijie Zhu authored Jun 18, 2025
```
Co-authored-by: 刁莹煜 <diaoyingyu1@hisilicon.com>
```
  a39d9287
16 Jun, 2025 2 commits
- chore: bump v0.4.7.post1 (#7248) · f9dc9dd2
  Yineng Zhang authored Jun 16, 2025
  
  f9dc9dd2
- Minor style and doc fix (#7228) · 21615cc3
  Lianmin Zheng authored Jun 16, 2025
  
  21615cc3
14 Jun, 2025 1 commit
- Add Phi-4-mm to supported VLM supported model list. (#7178) · 98538822
  Lifu Huang authored Jun 13, 2025
  
  98538822
12 Jun, 2025 1 commit
- [Fix] Reduce busy polling when scheduler is idle (#6026) · bd7cfbd2
  Povilas Kanapickas authored Jun 13, 2025
  
  bd7cfbd2
11 Jun, 2025 4 commits
- Clean up docs for server args and sampling parameters (generated by grok) (#7076) · dbdf76ca
  Lianmin Zheng authored Jun 10, 2025
  
  dbdf76ca
- update doc (#7046) · f2a75a66
  Ximingwang-09 authored Jun 11, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  f2a75a66
- Do not run frontend_reasoning.ipynb to reduce the CI load (#7073) · 0f218731
  Lianmin Zheng authored Jun 10, 2025
  
  0f218731
- Frontend language separate reasoning support (#6031) · 14c18d25
  Yudi Xue authored Jun 10, 2025
  
  14c18d25
10 Jun, 2025 4 commits
- Improve perf tuning docs (#7071) · 90bd3e32
  Lianmin Zheng authored Jun 10, 2025
  
  90bd3e32
- Open AI API hidden states (#6716) · b56de8f9
  kyle-pena-kuzco authored Jun 10, 2025
  
  b56de8f9
- Update README.md (#7040) · bb185b0e
  Lianmin Zheng authored Jun 10, 2025
  
  bb185b0e
- chore: bump v0.4.7 (#7038) · 4f723edd
  Yineng Zhang authored Jun 10, 2025
  
  4f723edd
09 Jun, 2025 1 commit
- Fix torch profiler bugs for bench_offline_throughput.py (#6557) · 98c00a2d
  Yueyang Pan authored Jun 09, 2025
  
  98c00a2d
06 Jun, 2025 1 commit
- AITER backend extension and workload optimizations (#6838) · b819381f
  HAI authored Jun 05, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
```
  b819381f
05 Jun, 2025 2 commits
- [PD] Fix potential perf spike caused by tracker gc and optimize doc (#6764) · dd1012fc
  shangmingc authored Jun 06, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  dd1012fc
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
04 Jun, 2025 1 commit
- [Refactor] Multimodal data processing for VLM (#6659) · cf9815ba
  Xinyuan Tong authored Jun 04, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  cf9815ba