Commits · d693ec0427bd70c8676316c634e00bd27514b7ec · change / sglang

"vscode:/vscode.git/clone" did not exist on "6bd0463d3403c5c3dfe8ef5efe4ff74ceb86eeda"

05 Dec, 2024 1 commit
- Make torch TP composable with torch.compile (#2352) · d693ec04
  Ke Wen authored Dec 04, 2024
  
  d693ec04
04 Dec, 2024 7 commits
- Add Docs For SGLang Native Router (#2308) · 18ea841f
  Chayenne authored Dec 04, 2024
  
  18ea841f
- Fix Docs CI When Compile Error (#2323) · 786be44d
  Chayenne authored Dec 04, 2024
  
  786be44d
- minor: limit the range of vllm versions (#2350) · 2db44698
  Yineng Zhang authored Dec 05, 2024
  
  2db44698
- Check gpu availability at server args creation (#2340) · ed45e509
  Ata Fatahi authored Dec 04, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  ed45e509
- MLA prefill w/o weight absorption (#2349) · ec52464d
  Ke Bao authored Dec 05, 2024
  
  ec52464d
- docs: add SGLang v0.4 blog (#2341) · eb0c1f53
  Yineng Zhang authored Dec 05, 2024
  
  eb0c1f53
- Adding SGLang FP8 Utils (#2348) · b2986d7a
  HAI authored Dec 04, 2024
  
  b2986d7a
03 Dec, 2024 11 commits
- chore: bump v0.4.0 (#2338) · f8b03269
  Yineng Zhang authored Dec 04, 2024
  
  f8b03269
- [router] Copy license when publishing & bump version (#2339) · 04957965
  Byron Hsu authored Dec 03, 2024
  
  04957965
- Fix gptq for moe layers (#2300) · 1228f7ca
  Lianmin Zheng authored Dec 03, 2024
```
Co-authored-by: root <me@zhyncs.com>
```
  1228f7ca
- fix: resolve cmake url for Dockerfile.dev (#2335) · fda628d8
  Yineng Zhang authored Dec 03, 2024
  
  fda628d8
- Improve torch compile for fused moe (#2327) · 07ec07ad
  Lianmin Zheng authored Dec 03, 2024
  
  07ec07ad
- Add missing license for router wheel (#2324) · 83b340e3
  Ata Fatahi authored Dec 03, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  83b340e3
- ROCm Container: set SGLANG_SET_CPU_AFFINITY=1 (#2328) · 0639bf15
  HAI authored Dec 02, 2024
  
  0639bf15
- Revert "[feat] Enable chunked prefill for llava-onevision" (#2329) · aa47f642
  Ying Sheng authored Dec 02, 2024
  
  aa47f642
- [Minor] Fix logger and style (#2325) · 3ddb1c46
  Lianmin Zheng authored Dec 02, 2024
  
  3ddb1c46
- [feat] Enable chunked prefill for llava-onevision (#2281) · 480e38a7
  Ying Sheng authored Dec 02, 2024
  
  480e38a7
- Relax to include more AMD GPUs (#2319) · 69e2d4fb
  HAI authored Dec 02, 2024
  
  69e2d4fb
02 Dec, 2024 6 commits
- Update model_loader deps and qqq quantization deps (#2220) (#2318) · 85e1a6f3
  Yineng Zhang authored Dec 02, 2024
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  85e1a6f3
- Add more fused moe benchmark utilities (#2314) · 33deca81
  Lianmin Zheng authored Dec 02, 2024
  
  33deca81
- [Minor] Fix code style (#2311) · 18108abe
  Lianmin Zheng authored Dec 02, 2024
  
  18108abe
- Use rocminfo instead of rocm-smi for more OS/WSL support (#2310) · c54bda30
  HAI authored Dec 02, 2024
  
  c54bda30
- [Fix] Fix the padded hash value for image tokens (#2309) · 3c79ad35
  Lianmin Zheng authored Dec 01, 2024
  
  3c79ad35
- Online weight updates from torch.distributed (#2279) · 983bfcf3
  Chayenne authored Dec 01, 2024
  
  983bfcf3
01 Dec, 2024 15 commits
- misc: update build setup (#2306) · 28bc60dc
  Yineng Zhang authored Dec 02, 2024
  
  28bc60dc
- fix: resolve CodeQL cpp issue (#2305) · 7301a39b
  Yineng Zhang authored Dec 01, 2024
  
  7301a39b
- feat: use warp reduce as a simple example (#2304) · 47eb139f
  Yineng Zhang authored Dec 01, 2024
  
  47eb139f
- Fix logprob for completions (#2301) · 5c18a037
  Lianmin Zheng authored Dec 01, 2024
  
  5c18a037
- feat: support sgl-kernel pypi (#2302) · 5c91a315
  Yineng Zhang authored Dec 01, 2024
  
  5c91a315
- minor: rm unused _grouped_size_compiled_for_decode_kernels (#2299) · 3dbd73d3
  Yineng Zhang authored Dec 01, 2024
  
  3dbd73d3
- feat: skip good first issue (#2298) · e9a6203d
  Yineng Zhang authored Dec 01, 2024
  
  e9a6203d
- Add a simple torch native attention backend (#2241) · 62c516ac
  Qun Yang authored Dec 01, 2024
  
  62c516ac
- minor: support flashinfer nightly (#2295) · fc78640e
  Yineng Zhang authored Dec 01, 2024
  
  fc78640e
- Feat: upgrade outlines & support compatibility with the old version (#2292) · 906d795f
  gobraves authored Dec 01, 2024
  
  906d795f
- feat: add should_use_tensor_core (#2179) · 118b6af3
  Yineng Zhang authored Dec 01, 2024
  
  118b6af3
- [CI] Balance CI tests (#2293) · 9449a954
  Lianmin Zheng authored Dec 01, 2024
  
  9449a954
- Fix chunked prefill when ignore eos (#2290) · 5f12f0e7
  Liangsheng Yin authored Dec 01, 2024
  
  5f12f0e7
- adapt vllm distributed module to sglang (#2244) · d5b95cbb
  yizhang2077 authored Dec 01, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  d5b95cbb
- [CI] Fix missing files in run_suite.py (#2288) · 0303ca91
  Lianmin Zheng authored Nov 30, 2024
  
  0303ca91