Commits · c480a3f6ea1be75d683551cdc7491aef2cf312e5 · change / sglang

"vscode:/vscode.git/clone" did not exist on "1ae84bc2a2ca4544e08d6ac65aa98a024f190313"

18 Aug, 2025 1 commit
- Minor style fixes for sgl-kernel (#9289) · c480a3f6
  Lianmin Zheng authored Aug 18, 2025
  
  c480a3f6
04 Jul, 2025 1 commit
- [fix] update bench_speculative.py for compatibility (#7764) · 975a5ec6
  Kay Yan authored Jul 04, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  975a5ec6
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
11 Jun, 2025 1 commit
- Do not run frontend_reasoning.ipynb to reduce the CI load (#7073) · 0f218731
  Lianmin Zheng authored Jun 10, 2025
  
  0f218731
26 May, 2025 1 commit
- Auto handle PD disaggregation in bench_serving (#6587) · 25be63d0
  fzyzcjy authored May 26, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  25be63d0
24 May, 2025 1 commit
- [PD] Support structured output (#6560) · 2d831c6e
  Byron Hsu authored May 23, 2025
  
  2d831c6e
23 May, 2025 1 commit
- [PD] Support logprob & Add failure test (#6558) · 8233cc10
  Byron Hsu authored May 23, 2025
  
  8233cc10
18 May, 2025 1 commit
- feat: add long context example (#6391) · eabcf82a
  Yineng Zhang authored May 18, 2025
  
  eabcf82a
22 Apr, 2025 1 commit
- fix: update bench_speculative (#5649) · 7282ab74
  Yineng Zhang authored Apr 22, 2025
  
  7282ab74
21 Apr, 2025 3 commits
- [PD] Support prefill overlap + Ensure no race condition (#5609) · bf98d2e3
  Byron Hsu authored Apr 21, 2025
  
  bf98d2e3
- [PD] Fix edge case and simplify large page size + chunked prefill (#5589) · deded17f
  Byron Hsu authored Apr 21, 2025
  
  deded17f
- [PD] Fix large page size + chunk prefill (#5588) · c951d312
  Byron Hsu authored Apr 20, 2025
  
  c951d312
17 Apr, 2025 1 commit
- Deprecate enable-flashinfer-mla and enable-flashmla (#5480) · 6fb29ffd
  Baizhou Zhang authored Apr 17, 2025
  
  6fb29ffd
16 Mar, 2025 1 commit
- Support FlashMLA backend (#4472) · a53fe428
  lukec authored Mar 17, 2025
```
Co-authored-by: yinfan98 <1106310035@qq.com>
```
  a53fe428
09 Mar, 2025 1 commit
- Update bench speculative script (#4235) · f1d09a65
  Ke Bao authored Mar 10, 2025
  
  f1d09a65
06 Mar, 2025 1 commit
- [docs] fix HF reference script command (#4148) · 19fd57bc
  Adarsh Shirawalmath authored Mar 07, 2025
  
  19fd57bc
03 Mar, 2025 2 commits

Misc clean up; Remove the support of jump forward (#4032) · 935cda94
Lianmin Zheng authored Mar 03, 2025

935cda94

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

05 Jan, 2025 1 commit
- fix lint (#2733) · bc6ad367
  Yineng Zhang authored Jan 05, 2025
  
  bc6ad367
03 Jan, 2025 1 commit
- feat: Support VLM in reference_hf (#2726) · f5d0865b
  Ce Gao authored Jan 03, 2025
```
Signed-off-by: Ce Gao <gaocegege@hotmail.com>
```
  f5d0865b
25 Nov, 2024 1 commit
- [feat] Refactor session control interface and add CI (#2173) · e1e595d7
  Ying Sheng authored Nov 25, 2024
  
  e1e595d7
22 Nov, 2024 2 commits
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
- [router] add base_gpu_id server args & merged radix tree python reference (#2115) · 30af7dfb
  Byron Hsu authored Nov 21, 2024
  
  30af7dfb
20 Nov, 2024 1 commit
- Move test_session_id.py to playground (#2104) · 56a347f7
  Lianmin Zheng authored Nov 20, 2024
  
  56a347f7
18 Nov, 2024 1 commit
- Support cuda graph for DP attention (#2061) · 62832bb2
  Ke Bao authored Nov 18, 2024
  
  62832bb2
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
06 Nov, 2024 1 commit
- minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) · a5e0defb
  Xuehai Pan authored Nov 06, 2024
  
  a5e0defb
03 Nov, 2024 1 commit
- Allow passing dtype and max_new_tokens to HF reference script (#1903) · 916b3cdd
  Jani Monoses authored Nov 03, 2024
  
  916b3cdd
07 Oct, 2024 1 commit
- [Profile] Add pytorch profiler (#1604) · c5325aba
  Ying Sheng authored Oct 07, 2024
  
  c5325aba
25 Sep, 2024 1 commit
- [Fix] Fix clean_up_tokenization_spaces in tokenizer (#1510) · fb2d0680
  Lianmin Zheng authored Sep 24, 2024
  
  fb2d0680
23 Sep, 2024 1 commit
- Fix the overhead due to penalizer in bench_latency (#1496) · 2854a5ea
  Lianmin Zheng authored Sep 23, 2024
  
  2854a5ea
22 Sep, 2024 1 commit
- Better unit tests for adding a new model (#1488) · 167591e8
  Lianmin Zheng authored Sep 22, 2024
  
  167591e8
15 Sep, 2024 1 commit
- [Feature] Support LoRA path renaming and add LoRA serving benchmarks (#1433) · 37963394
  Ying Sheng authored Sep 15, 2024
  
  37963394
12 Sep, 2024 1 commit
- [Feature] Initial support for multi-LoRA serving (#1307) · 71221692
  Ying Sheng authored Sep 12, 2024
  
  71221692
03 Sep, 2024 1 commit
- [Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308) · f64eae3a
  Lianmin Zheng authored Sep 02, 2024
  
  f64eae3a
14 Aug, 2024 1 commit
- [Feat] Add window attention for gemma-2 (#1056) · 0909bb0d
  Ying Sheng authored Aug 13, 2024
  
  0909bb0d
01 Aug, 2024 1 commit
- Add OpenAI backend to the CI test (#869) · 40756776
  Ying Sheng authored Aug 01, 2024
  
  40756776