Commits · fdc4e1e570503ddfc248aaa9ce6526c1eec92da2 · change / sglang

03 Oct, 2025 1 commit
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
09 Jun, 2025 1 commit

chore: upgrade flashinfer v0.2.6.post1 jit (#6958) · 56ccd3c2

Yineng Zhang authored Jun 09, 2025


Co-authored-by: alcanderian <alcanderian@gmail.com>
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>

56ccd3c2

11 May, 2025 1 commit
- Added async_encode method to Engine (#4701) · 03dd785c
  Steven Shimizu authored May 10, 2025
  
  03dd785c
25 Mar, 2025 1 commit
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
20 Jan, 2025 1 commit
- Separate two entry points: Engine and HTTP server (#2996) · 03464890
  Lianmin Zheng authored Jan 19, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  03464890
03 Dec, 2024 1 commit
- Improve torch compile for fused moe (#2327) · 07ec07ad
  Lianmin Zheng authored Dec 03, 2024
  
  07ec07ad
29 Nov, 2024 2 commits
- Revert "Revert "Add simple CPU offloading support"" (#2253) · 8b48496a
  Ying Sheng authored Nov 28, 2024
```
Co-authored-by: Jani Monoses <jani.monoses@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  8b48496a
- Revert "Add simple CPU offloading support" (#2252) · 4057ea82
  Ying Sheng authored Nov 28, 2024
```
We'll re-add the commit to correctly ack Kaichao's authorship
```
  4057ea82
23 Nov, 2024 2 commits
- [CI] Fix test cases (#2137) · a78d8f8d
  Lianmin Zheng authored Nov 23, 2024
  
  a78d8f8d
- Add simple CPU offloading support. (#2081) · d98fa1e9
  Jani Monoses authored Nov 23, 2024
  
  d98fa1e9
19 Nov, 2024 1 commit
- Use cuda event wait and synchronization instead of busy waiting (#2089) · b7a065ea
  Lianmin Zheng authored Nov 19, 2024
  
  b7a065ea
18 Nov, 2024 1 commit
- Fix cuda illegal memory access in overlap mode (#2070) · 11668533
  Lianmin Zheng authored Nov 17, 2024
  
  11668533
15 Nov, 2024 1 commit
- Offline LLM Engine Benchmark Throughput (#1968) · f6dd6486
  zolinthecow authored Nov 14, 2024
```
Co-authored-by: ByronHsu <byronhsu1230@gmail.com>
```
  f6dd6486
11 Nov, 2024 1 commit
- Add engine encode (#1995) · ddeb9d42
  James Xu authored Nov 11, 2024
```
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  ddeb9d42
09 Nov, 2024 1 commit
- Clean up metrics code (#1972) · 9c939a3d
  Lianmin Zheng authored Nov 09, 2024
  
  9c939a3d
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
27 Oct, 2024 1 commit
- Support token ids in `engine.generate` (#1820) · 6fcd6d7d
  Byron Hsu authored Oct 27, 2024
  
  6fcd6d7d
17 Oct, 2024 1 commit
- Fix engine unit test (#1701) · dd3809fa
  Lianmin Zheng authored Oct 17, 2024
  
  dd3809fa
11 Oct, 2024 1 commit
- [engine] support async and streaming (#1614) · 862cd265
  Byron Hsu authored Oct 11, 2024
  
  862cd265
08 Oct, 2024 1 commit
- [Engine] Fix generate hanging issue after the first call (#1606) · e8613df0
  Byron Hsu authored Oct 07, 2024
  
  e8613df0
07 Oct, 2024 1 commit
- Provide an offline engine API (#1567) · 551a3a9d
  Byron Hsu authored Oct 06, 2024
  
  551a3a9d