Commits · 9244f27f0af24deb199921c32e24f2491380e016 · change / sglang · GitLab

06 Oct, 2024 1 commit
- [Minor] Improve the style and fix flaky tests (#1584) · 9244f27f
  Lianmin Zheng authored Oct 06, 2024
  
  9244f27f
05 Oct, 2024 1 commit
- Refine the add request reasons to avoid corner cases. (#1574) · 5d0ba403
  Liangsheng Yin authored Oct 04, 2024
  
  5d0ba403
04 Oct, 2024 3 commits
- [Fix] Fix major performance bug in certain cases (#1563) · 04b262cd
  Ying Sheng authored Oct 04, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  04b262cd
- Use ipc instead of tcp in zmq (#1566) · 114bbc86
  Lianmin Zheng authored Oct 04, 2024
  
  114bbc86
- Organize sampling batch info better (#1562) · 32eb6e96
  Lianmin Zheng authored Oct 03, 2024
  
  32eb6e96
30 Sep, 2024 4 commits
- Clean up batch data structures: Introducing ModelWorkerBatch (#1544) · 63ba2f8d
  Lianmin Zheng authored Sep 30, 2024
  
  63ba2f8d
- Rename InputMetadata -> ForwardBatch (#1543) · 36d5acfc
  Lianmin Zheng authored Sep 30, 2024
  
  36d5acfc
- Let ModelRunner take InputMetadata as input, instead of ScheduleBatch (#1541) · 3f0fe08d
  Lianmin Zheng authored Sep 29, 2024
  
  3f0fe08d
- Move scheduler code from tp_worker.py to scheduler.py (#1538) · f86c1e61
  Lianmin Zheng authored Sep 29, 2024
  
  f86c1e61
29 Sep, 2024 1 commit
- Improve process creation (#1534) · 04868543
  Lianmin Zheng authored Sep 29, 2024
  
  04868543