Commits · 1c96fa86cfa2c8770c9705ba65b65670e8637767 · change / sglang

"vscode:/vscode.git/clone" did not exist on "00d06619a11356a155362013b8fc0bc9d0d8a146"

28 Feb, 2025 2 commits
- [MOE] enable efficient moe_alignment multi-blocks execution (3x~6x) (#3613) · 1c96fa86
  yiakwy-xpu-ml-framework-team authored Feb 28, 2025
  
  1c96fa86
- [feat] Add Vertex AI compatible prediction route for /generate (#3866) · bc20e93f
  KCFindstr authored Feb 27, 2025
  
  bc20e93f
27 Feb, 2025 12 commits
- Fix the doc link for sampling params (#3861) · d3887852
  Qiaolin Yu authored Feb 27, 2025
  
  d3887852
- upgrade flashinfer v0.2.2.post1 (#3934) · 564bdf29
  Yineng Zhang authored Feb 27, 2025
  
  564bdf29
- revert "Docs: Reorngaize dpsk links #3900" (#3933) · 5d860168
  Yineng Zhang authored Feb 27, 2025
  
  5d860168
- Improve: Support xgrammar 0.1.14 (#3593) · d2815879
  Enrique Shockwave authored Feb 27, 2025
  
  d2815879
- Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922) · b0df5d24
  laixin authored Feb 27, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
```
  b0df5d24
- [Doc] Add experimental tag for flashinfer mla (#3925) · 3e02526b
  Baizhou Zhang authored Feb 27, 2025
  
  3e02526b
- [Docs] Improve DPSK docs in dark mode (#3914) · d8a98a2c
  Stefan He authored Feb 27, 2025
  
  d8a98a2c
- [Docs] Disable notebook CI when merge to main (#3905) · 0519269d
  Qing authored Feb 26, 2025
  
  0519269d
- Add return hidden state in the native API (#3897) · d6898dd2
  Qiaolin Yu authored Feb 27, 2025
```
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  d6898dd2
- [doc] Update document for flashinfer mla (#3907) · 71ed0183
  Baizhou Zhang authored Feb 26, 2025
  
  71ed0183
- [Rocm] Fix to the rocm_mla_decode_rope.py returning random result (#3898) · 8b681d77
  Tianxing Wu authored Feb 27, 2025
  
  8b681d77
- [doc] update sponsorship (#3903) · 194eea17
  ybyang authored Feb 27, 2025
  
  194eea17
26 Feb, 2025 8 commits
- Docs: Implemented frontend docs (#3791) · acd1a159
  simveit authored Feb 27, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  acd1a159
- Docs: Reorngaize dpsk links (#3900) · 7c1692aa
  Chayenne authored Feb 26, 2025
  
  7c1692aa
- Docs: Move dpsk docs forward a step (#3894) · 8f019c7d
  Chayenne authored Feb 26, 2025
  
  8f019c7d
- [Feature] Support llguidance for constrained decoding (#3298) · 7551498a
  JC1DA authored Feb 26, 2025
  
  7551498a
- Docs: improve link to docs (#3860) · 44a2c4bd
  simveit authored Feb 26, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  44a2c4bd
- Docs: delete sgl-kernel install in docs (#3845) · c9fc4a9d
  simveit authored Feb 26, 2025
  
  c9fc4a9d
- Expert Parallelism (EP) Support for DeepSeek V3/R1 (#3602) · 21463e32
  lukec authored Feb 26, 2025
```
Co-authored-by: laixin <xielx@shanghaitech.edu.cn>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: laixin <q865809639@gmail.com>
```
  21463e32
- [doc] fixed dpsk quant faq (#3865) · 3dc9ff3c
  Shenggui Li authored Feb 26, 2025
  
  3dc9ff3c
25 Feb, 2025 13 commits
- [doc] added quantization doc for dpsk (#3843) · 06427dfa
  Shenggui Li authored Feb 26, 2025
  
  06427dfa
- [Bug]: Fix maximum recursion depth triggered on exception exit (#3519) · 60524920
  Kebe authored Feb 26, 2025
  
  60524920
- [BugFix] Fix crash when receive a req with structed output in DP attention mode. (#3841) · 10771026
  IAN authored Feb 26, 2025
  
  10771026
- Bug: fix capture_bs (#3857) · 4606e2a3
  who who who authored Feb 26, 2025
  
  4606e2a3
- Fix allgather ops inside cuda graphs (#3709) · 127998cc
  Nicolas Castet authored Feb 25, 2025
  
  127998cc
- [improve] made timeout configurable (#3803) · c0bb9eb3
  Shenggui Li authored Feb 25, 2025
  
  c0bb9eb3
- [Bug]: Add missing clamp to llavavid (#3787) · 7036d6fc
  Yueyang Pan authored Feb 25, 2025
  
  7036d6fc
- [ROCm] Enable Fused MLA Triton kernel for DeepSeekV3 (#3237) · 6ce9dbe8
  Chaitanya Sri Krishna Lolla authored Feb 25, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
```
  6ce9dbe8
- [Doc] Fix typo in server-argument description (#3641) · 3758d209
  Yuanheng Zhao authored Feb 25, 2025
  
  3758d209
- Docs: fix doc site copyright to current year (#3741) · faf29e0b
  Wilson Wu authored Feb 25, 2025
  
  faf29e0b
- Docs: fix dead link in router.md (#3799) · b0743ea0
  He1pa authored Feb 25, 2025
  
  b0743ea0
- Improve: fix typos (#3801) · 60b771c8
  Wang Ran (汪然) authored Feb 25, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  60b771c8
- Fix CI and install docs (#3821) · d7934cde
  Lianmin Zheng authored Feb 24, 2025
  
  d7934cde
24 Feb, 2025 5 commits
- Revert "Extract generation_manager from tokenizer_manager" (#3829) · 62bbd343
  Lianmin Zheng authored Feb 24, 2025
  
  62bbd343
- Revert "Rename TokenizerManager to StdOrchestrator" (#3828) · f2388f6b
  Lianmin Zheng authored Feb 24, 2025
  
  f2388f6b
- Fix pandas dependency in CI (#3818) · c9745ee0
  Lianmin Zheng authored Feb 24, 2025
  
  c9745ee0
- Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730) · 1a6e9757
  laixin authored Feb 24, 2025
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  1a6e9757
- Refactor flashinfer logic for deepseek v3 and fix accuracy bug (#3785) · b1100846
  Baizhou Zhang authored Feb 24, 2025
  
  b1100846