Commits · fb6e04a0c28bc33996aa3c7da51842012a965ffc · change / sglang · GitLab

27 Nov, 2024 5 commits
- Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it off by default (#2222) · fb6e04a0
  Lianmin Zheng authored Nov 27, 2024
  
  fb6e04a0
- Revert "Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it off by default" (#2221) · 6997e28f
  Lianmin Zheng authored Nov 27, 2024
  
  6997e28f
- Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it off by default (#2217) · a0e58740
  Lianmin Zheng authored Nov 27, 2024
  
  a0e58740
- [feat] Support session control for vision language models (#2210) · 37c8a576
  Ying Sheng authored Nov 27, 2024
  
  37c8a576
- Fix flasky tests (#2212) · c754652f
  Lianmin Zheng authored Nov 26, 2024
  
  c754652f
26 Nov, 2024 15 commits
- Fix rust warning (#2208) · 0b46b951
  Byron Hsu authored Nov 26, 2024
  
  0b46b951
- Bump router to 0.0.9 with better logging (#2207) · 2763c0a7
  Byron Hsu authored Nov 26, 2024
  
  2763c0a7
- docs: update adoption (#2204) · de3b67b7
  Yineng Zhang authored Nov 27, 2024
  
  de3b67b7
- add sglang version to get_server_info (#2206) · 19f33b32
  Yudi Xue authored Nov 26, 2024
  
  19f33b32
- minor: update check_env (#2201) · 30ce5b59
  Yineng Zhang authored Nov 26, 2024
  
  30ce5b59
- fix: add cuda-python for xgrammar (#2199) · bc1f6fda
  Yineng Zhang authored Nov 26, 2024
  
  bc1f6fda
- using `is not` not `!=` to test `None` (#2196) · 867e092f
  Wang Ran (汪然) authored Nov 26, 2024
  
  867e092f
- Remove unresolved reference 'self' (#2198) · 88c7763f
  Andrew Lyu authored Nov 26, 2024
  
  88c7763f
- remove unused imports (#2195) · e4118b15
  Wang Ran (汪然) authored Nov 26, 2024
  
  e4118b15
- Update sampler.py to skip the success check (#2197) · ba4ee37f
  Lianmin Zheng authored Nov 26, 2024
  
  ba4ee37f
- Release v0.3.6.post1 (#2189) · ac5a0f04
  Lianmin Zheng authored Nov 25, 2024
  
  ac5a0f04
- Rename double sparsity config file (#2188) · ea34350d
  Lianmin Zheng authored Nov 25, 2024
  
  ea34350d
- [CI] Minor fix for CI (#2187) · 1605ae12
  Lianmin Zheng authored Nov 25, 2024
  
  1605ae12
- Input_embeds support (#2052) · 1aea19f6
  Rin Intachuen authored Nov 25, 2024
  
  1aea19f6
- [router] Rust e2e test (#2184) · 1f76fc6e
  Byron Hsu authored Nov 25, 2024
  
  1f76fc6e
25 Nov, 2024 14 commits
- Update XGrammar to the latest API (#2176) · 7f076c2c
  Yixin Dong authored Nov 25, 2024
```
Co-authored-by: Ben Gitter <gitterbd@gmail.com>
```
  7f076c2c
- Update CI threshold (#2186) · 3c5538f7
  Lianmin Zheng authored Nov 25, 2024
  
  3c5538f7
- [Performance]: Process affinity to CPU cores with multiple sockets support (#2171) · 10189d08
  HAI authored Nov 25, 2024
  
  10189d08
- Use custom allreduce w/ torch.compile (#2185) · c4336b2b
  Lianmin Zheng authored Nov 25, 2024
  
  c4336b2b
- [router] Replace print with logger (#2183) · 4d62bca5
  Byron Hsu authored Nov 25, 2024
  
  4d62bca5
- [feat] Refactor session control interface and add CI (#2173) · e1e595d7
  Ying Sheng authored Nov 25, 2024
  
  e1e595d7
- Bump rustls from 0.23.16 to 0.23.18 in /rust (#2182) · 5ada33ff
  dependabot[bot] authored Nov 26, 2024
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  5ada33ff
- [CI] Split test cases in CI for better load balancing (#2180) · 254fd130
  Lianmin Zheng authored Nov 25, 2024
  
  254fd130
- [Fix] Avoid calling fill_vocab_mask for terminated requests (#2175) · 538fa0ae
  Yixin Dong authored Nov 25, 2024
  
  538fa0ae
- feat: fused_moe fp8 monkey patch (#2174) · 55842eb8
  Yineng Zhang authored Nov 25, 2024
  
  55842eb8
- Bump rust router to 0.0.8 · a866b65e
  Byron Hsu authored Nov 24, 2024
  
  a866b65e
- Replace prob based with threshold based load balancing (#2170) · 4b0a1c93
  Byron Hsu authored Nov 24, 2024
  
  4b0a1c93
- Allow overwrite flashinfer use_tensorcore (#2169) · 8e1adb84
  Lianmin Zheng authored Nov 24, 2024
  
  8e1adb84
- [Fused moe] add tuning fused configs for qwen2 57b and mixtral 8x7b (#2167) · dd44173d
  Xiaoyu Zhang authored Nov 25, 2024
  
  dd44173d
24 Nov, 2024 6 commits
- Fix docs (#2164) · 8912b763
  Lianmin Zheng authored Nov 24, 2024
  
  8912b763
- Rename triton_fused_moe -> fused_moe_triton (#2163) · be0124bd
  Lianmin Zheng authored Nov 24, 2024
  
  be0124bd
- Balance CI tests (#2162) · fe5d3e81
  Lianmin Zheng authored Nov 24, 2024
  
  fe5d3e81
- Fix mixed chunked prefill in overlap mode (#2158) · 731146f6
  Lianmin Zheng authored Nov 24, 2024
  
  731146f6
- fix: use torch.sum for compatible (#2161) · fa271613
  Yineng Zhang authored Nov 24, 2024
  
  fa271613
- Update CI threshold & Improve code style (#2159) · 5652c565
  Lianmin Zheng authored Nov 24, 2024
  
  5652c565