Commits · 014982b5e00cbcf18caa20dc662a1c09220c3fa7 · change / sglang · GitLab

20 Sep, 2024 1 commit
- Add OLMoE (#1476) · 014982b5
  Niklas Muennighoff authored Sep 19, 2024
  
  014982b5
19 Sep, 2024 6 commits
- minor: add quant eval compared with base (#1475) · a6db8862
  Yineng Zhang authored Sep 20, 2024
  
  a6db8862
- feat: update linear deps 1/N (#1305) · b4408b0d
  Yineng Zhang authored Sep 19, 2024
  
  b4408b0d
- Fix env vars in bench_latency (#1472) · 2cd7e181
  Lianmin Zheng authored Sep 19, 2024
  
  2cd7e181
- Release v0.3.1.post2 (#1470) · 5ce55aee
  Lianmin Zheng authored Sep 19, 2024
  
  5ce55aee
- Fix padding in the cuda graph (#1469) · 2d346a57
  Lianmin Zheng authored Sep 19, 2024
  
  2d346a57
- fix: creat new dict everytime for putting new frame (#1464) · 446ea332
  Li Bo authored Sep 19, 2024
  
  446ea332
18 Sep, 2024 7 commits
- [Event] Add public meeting invite to README (#1458) · 8f527e29
  Ying Sheng authored Sep 18, 2024
  
  8f527e29
- Fuse top_k and top_k in the sampler (#1457) · 7f24ea95
  Lianmin Zheng authored Sep 18, 2024
  
  7f24ea95
- Fix oom issues with fp8 for llama (#1454) · 1acccb36
  Lianmin Zheng authored Sep 18, 2024
  
  1acccb36
- [Bugfix] Enable SGLang on AMD GPUs via PyTorch for ROCm (#1419) (#1453) · aa2750be
  HAI authored Sep 18, 2024
  
  aa2750be
- Add bench_server_latency.py (#1452) · 5e62a6b7
  Lianmin Zheng authored Sep 18, 2024
  
  5e62a6b7
- Fixed n>1 causing list index out of range with VLM (#1449) · 5752f25e
  Xiao Yu authored Sep 18, 2024
  
  5752f25e
- Fix schedule bug (#1451) · 7c162fa9
  Liangsheng Yin authored Sep 17, 2024
  
  7c162fa9
17 Sep, 2024 9 commits
- fix schedule bug (#1450) · 36078fb2
  Liangsheng Yin authored Sep 17, 2024
  
  36078fb2
- Fix attention backend (#1448) · b3710d2c
  Ke Bao authored Sep 17, 2024
  
  b3710d2c
- Enable MLA by default (#1447) · c6b6d2e7
  Ke Bao authored Sep 17, 2024
  
  c6b6d2e7
- Release 0.3.1.post1 (#1445) · 90a26be3
  Lianmin Zheng authored Sep 17, 2024
  
  90a26be3
- Add OLMoE model (#1444) · 1f4b5f77
  Jani Monoses authored Sep 17, 2024
  
  1f4b5f77
- Fix torch compile for deepseek-v2 (#1442) · 76524b70
  Ke Bao authored Sep 17, 2024
  
  76524b70
- [Feature, Hardware] Enable SGLang on AMD GPUs via PyTorch for ROCm (#1420) · 3a6e0418
  HAI authored Sep 17, 2024
  
  3a6e0418
- Simplify sampler and its error handling (#1441) · 2fa5cec7
  Lianmin Zheng authored Sep 16, 2024
  
  2fa5cec7
- Clean up model loader (#1440) · 27b557ae
  Lianmin Zheng authored Sep 16, 2024
  
  27b557ae
16 Sep, 2024 1 commit
- Add constrained_json_whitespace_pattern to ServerArgs (#1438) · 93dffd69
  zifeitong authored Sep 16, 2024
  
  93dffd69
15 Sep, 2024 7 commits
- Revert "[Minor] Raise exception for wrong import (#1409)" (#1432) · 2abe4f1c
  Ying Sheng authored Sep 15, 2024
  
  2abe4f1c
- [Feature] Support LoRA path renaming and add LoRA serving benchmarks (#1433) · 37963394
  Ying Sheng authored Sep 15, 2024
  
  37963394
- Remove deprecated configs (#1431) · 899cf5c4
  Lianmin Zheng authored Sep 15, 2024
  
  899cf5c4
- Release v0.3.1 (#1430) · e79f6cd7
  Lianmin Zheng authored Sep 15, 2024
  
  e79f6cd7
- [Fix] Fix logprob and normalized_logprob (#1428) · 9ba1f097
  Lianmin Zheng authored Sep 15, 2024
  
  9ba1f097
- Update backend.md (#1429) · 282681b8
  Lianmin Zheng authored Sep 15, 2024
  
  282681b8
- Add libibverbs-dev to Dockerfile (#1427) · 58cafe23
  William Arnold authored Sep 15, 2024
  
  58cafe23
14 Sep, 2024 5 commits
- Enable torch.compile for triton backend (#1422) · 9463bc13
  Lianmin Zheng authored Sep 14, 2024
  
  9463bc13
- fix: resolve nightly eval (#1426) · e3fc4658
  Yineng Zhang authored Sep 15, 2024
  
  e3fc4658
- Add pytorch sampling backend ut (#1425) · 33b54e7c
  Ke Bao authored Sep 14, 2024
  
  33b54e7c
- Add torchao quant for mixtral and qwen_moe (#1418) · 30b404ce
  Jerry Zhang authored Sep 13, 2024
  
  30b404ce
- Optimize conflicts between CUDA graph and vocab mask tensors (#1392) · 70b68029
  Liangsheng Yin authored Sep 13, 2024
  
  70b68029
13 Sep, 2024 4 commits
- ci: fix finish (#1414) · f3d32f88
  Yineng Zhang authored Sep 14, 2024
  
  f3d32f88
- Update pr-test.yml (#1412) · 8779da95
  Lianmin Zheng authored Sep 13, 2024
  
  8779da95
- Balance test in CI (#1411) · ad0ff62a
  Lianmin Zheng authored Sep 12, 2024
  
  ad0ff62a
- [Minor] Raise exception for wrong import (#1409) · 9a903a87
  Ying Sheng authored Sep 12, 2024
  
  9a903a87