Commits · 8b48496aaf90fdcd90698dbe9a9e11acdfc4a4d3 · change / sglang

"vscode:/vscode.git/clone" did not exist on "dab7f64b2bea96974b19e31ad346b4fea231d654"

29 Nov, 2024 4 commits
- Revert "Revert "Add simple CPU offloading support"" (#2253) · 8b48496a
  Ying Sheng authored Nov 28, 2024
```
Co-authored-by: Jani Monoses <jani.monoses@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  8b48496a
- Revert "Add simple CPU offloading support" (#2252) · 4057ea82
  Ying Sheng authored Nov 28, 2024
```
We'll re-add the commit to correctly ack Kaichao's authorship
```
  4057ea82
- Update backend.md (#2251) · 4f2ee48e
  Lianmin Zheng authored Nov 28, 2024
  
  4f2ee48e
- Update backend.md (#2250) · 71ff2728
  Lianmin Zheng authored Nov 28, 2024
  
  71ff2728
28 Nov, 2024 9 commits
- [fix] Fix prefix caching for multi-image/video (#2239) · b7038fec
  Ying Sheng authored Nov 28, 2024
  
  b7038fec
- fix missing launch server import (#2242) · 65fdb289
  Enrique Shockwave authored Nov 28, 2024
  
  65fdb289
- Fix memory leak during abort (#2238) · b2ccf36d
  Lianmin Zheng authored Nov 28, 2024
  
  b2ccf36d
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
- Add OLMo2 model. (#2233) · db674e3d
  Jani Monoses authored Nov 28, 2024
  
  db674e3d
- Disable overlap scheduler for multimodal models (#2235) · fb915bd1
  Lianmin Zheng authored Nov 27, 2024
  
  fb915bd1
- Fix chunked prefill size for bench_offline_throughput (#2234) · 09798b36
  Lianmin Zheng authored Nov 27, 2024
  
  09798b36
- Update Install Method 2. From source (#2232) · b79fffdc
  HAI authored Nov 27, 2024
  
  b79fffdc
- Rename tuned MI300X config files for fused_moe_triton (#2228) · cd51758f
  HAI authored Nov 27, 2024
  
  cd51758f
27 Nov, 2024 12 commits
- add profile in offline benchmark & update doc (#2123) · 91e5dbf5
  bjmsong authored Nov 28, 2024
```
Co-authored-by: root <bjmsong@126.com>
```
  91e5dbf5
- Remove fused_moe_grok (#2223) · dd5eba4c
  Lianmin Zheng authored Nov 27, 2024
  
  dd5eba4c
- fix typo prompts (#2224) · a4fd2f9b
  Baoyuan Qi authored Nov 28, 2024
  
  a4fd2f9b
- Bump sglang-router to 0.0.10 for env name change (#2226) · 92d1253e
  Byron Hsu authored Nov 27, 2024
  
  92d1253e
- [3rdparty, document] Updated Documentation that for triton fused_moe kernel... · a9ca297d
  kk authored Nov 28, 2024
```
[3rdparty, document] Updated Documentation that for triton fused_moe kernel tuning for AMD Instinct GPUs (#2191)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
```
  a9ca297d
- Rename DP_RANK to SGLANG_DP_RANK (#2218) · 2a02185c
  Lianmin Zheng authored Nov 27, 2024
  
  2a02185c
- Release v0.3.6.post2 (#2214) · fed4c694
  Lianmin Zheng authored Nov 27, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  fed4c694
- Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it off by default (#2222) · fb6e04a0
  Lianmin Zheng authored Nov 27, 2024
  
  fb6e04a0
- Revert "Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it off by default" (#2221) · 6997e28f
  Lianmin Zheng authored Nov 27, 2024
  
  6997e28f
- Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it off by default (#2217) · a0e58740
  Lianmin Zheng authored Nov 27, 2024
  
  a0e58740
- [feat] Support session control for vision language models (#2210) · 37c8a576
  Ying Sheng authored Nov 27, 2024
  
  37c8a576
- Fix flasky tests (#2212) · c754652f
  Lianmin Zheng authored Nov 26, 2024
  
  c754652f
26 Nov, 2024 15 commits
- Fix rust warning (#2208) · 0b46b951
  Byron Hsu authored Nov 26, 2024
  
  0b46b951
- Bump router to 0.0.9 with better logging (#2207) · 2763c0a7
  Byron Hsu authored Nov 26, 2024
  
  2763c0a7
- docs: update adoption (#2204) · de3b67b7
  Yineng Zhang authored Nov 27, 2024
  
  de3b67b7
- add sglang version to get_server_info (#2206) · 19f33b32
  Yudi Xue authored Nov 26, 2024
  
  19f33b32
- minor: update check_env (#2201) · 30ce5b59
  Yineng Zhang authored Nov 26, 2024
  
  30ce5b59
- fix: add cuda-python for xgrammar (#2199) · bc1f6fda
  Yineng Zhang authored Nov 26, 2024
  
  bc1f6fda
- using `is not` not `!=` to test `None` (#2196) · 867e092f
  Wang Ran (汪然) authored Nov 26, 2024
  
  867e092f
- Remove unresolved reference 'self' (#2198) · 88c7763f
  Andrew Lyu authored Nov 26, 2024
  
  88c7763f
- remove unused imports (#2195) · e4118b15
  Wang Ran (汪然) authored Nov 26, 2024
  
  e4118b15
- Update sampler.py to skip the success check (#2197) · ba4ee37f
  Lianmin Zheng authored Nov 26, 2024
  
  ba4ee37f
- Release v0.3.6.post1 (#2189) · ac5a0f04
  Lianmin Zheng authored Nov 25, 2024
  
  ac5a0f04
- Rename double sparsity config file (#2188) · ea34350d
  Lianmin Zheng authored Nov 25, 2024
  
  ea34350d
- [CI] Minor fix for CI (#2187) · 1605ae12
  Lianmin Zheng authored Nov 25, 2024
  
  1605ae12
- Input_embeds support (#2052) · 1aea19f6
  Rin Intachuen authored Nov 25, 2024
  
  1aea19f6
- [router] Rust e2e test (#2184) · 1f76fc6e
  Byron Hsu authored Nov 25, 2024
  
  1f76fc6e