Commits · d4fc1a70e3187c914043a1ffc619adbb0c3c6860 · change / sglang

28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
19 Nov, 2024 1 commit
- Use cuda event wait and synchronization instead of busy waiting (#2089) · b7a065ea
  Lianmin Zheng authored Nov 19, 2024
  
  b7a065ea
10 Nov, 2024 1 commit
- [CI] balance unit tests (#1977) · 520f0094
  Lianmin Zheng authored Nov 09, 2024
  
  520f0094
09 Nov, 2024 1 commit
- Clean up metrics code (#1972) · 9c939a3d
  Lianmin Zheng authored Nov 09, 2024
  
  9c939a3d
27 Oct, 2024 1 commit
- Add a watch dog thread (#1816) · 86fc0d79
  Lianmin Zheng authored Oct 27, 2024
  
  86fc0d79
26 Oct, 2024 1 commit
- Provide an argument to set the maximum batch size for cuda graph (#1809) · 2b809788
  Lianmin Zheng authored Oct 26, 2024
  
  2b809788
25 Oct, 2024 1 commit
- Enhance the test case for chunked prefill (#1785) · 1701b0db
  Lianmin Zheng authored Oct 24, 2024
  
  1701b0db
11 Oct, 2024 1 commit
- [Fix] Fix the style of test_large_max_new_tokens.py (#1638) · dafb6a52
  Lianmin Zheng authored Oct 11, 2024
  
  dafb6a52
22 Sep, 2024 1 commit
- [API, Feature] Support response prefill for openai API (#1490) · e4780cf8
  Ying Sheng authored Sep 22, 2024
  
  e4780cf8
26 Aug, 2024 1 commit
- improve the threshold and ports in tests (#1215) · 158e8f1e
  Mingyi authored Aug 25, 2024
  
  158e8f1e
13 Aug, 2024 1 commit
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
12 Aug, 2024 1 commit
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
11 Aug, 2024 1 commit
- Test the case when max_new_tokens is very large (#1038) · d84c5e70
  Lianmin Zheng authored Aug 11, 2024
  
  d84c5e70