Commits · 5d8601685548ea1fbfd0b290bdba910c394e5c66 · change / sglang · GitLab

27 Feb, 2025 10 commits
- revert "Docs: Reorngaize dpsk links #3900" (#3933) · 5d860168
  Yineng Zhang authored Feb 27, 2025
  
  5d860168
- Improve: Support xgrammar 0.1.14 (#3593) · d2815879
  Enrique Shockwave authored Feb 27, 2025
  
  d2815879
- Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922) · b0df5d24
  laixin authored Feb 27, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
```
  b0df5d24
- [Doc] Add experimental tag for flashinfer mla (#3925) · 3e02526b
  Baizhou Zhang authored Feb 27, 2025
  
  3e02526b
- [Docs] Improve DPSK docs in dark mode (#3914) · d8a98a2c
  Stefan He authored Feb 27, 2025
  
  d8a98a2c
- [Docs] Disable notebook CI when merge to main (#3905) · 0519269d
  Qing authored Feb 26, 2025
  
  0519269d
- Add return hidden state in the native API (#3897) · d6898dd2
  Qiaolin Yu authored Feb 27, 2025
```
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  d6898dd2
- [doc] Update document for flashinfer mla (#3907) · 71ed0183
  Baizhou Zhang authored Feb 26, 2025
  
  71ed0183
- [Rocm] Fix to the rocm_mla_decode_rope.py returning random result (#3898) · 8b681d77
  Tianxing Wu authored Feb 27, 2025
  
  8b681d77
- [doc] update sponsorship (#3903) · 194eea17
  ybyang authored Feb 27, 2025
  
  194eea17
26 Feb, 2025 8 commits
- Docs: Implemented frontend docs (#3791) · acd1a159
  simveit authored Feb 27, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  acd1a159
- Docs: Reorngaize dpsk links (#3900) · 7c1692aa
  Chayenne authored Feb 26, 2025
  
  7c1692aa
- Docs: Move dpsk docs forward a step (#3894) · 8f019c7d
  Chayenne authored Feb 26, 2025
  
  8f019c7d
- [Feature] Support llguidance for constrained decoding (#3298) · 7551498a
  JC1DA authored Feb 26, 2025
  
  7551498a
- Docs: improve link to docs (#3860) · 44a2c4bd
  simveit authored Feb 26, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  44a2c4bd
- Docs: delete sgl-kernel install in docs (#3845) · c9fc4a9d
  simveit authored Feb 26, 2025
  
  c9fc4a9d
- Expert Parallelism (EP) Support for DeepSeek V3/R1 (#3602) · 21463e32
  lukec authored Feb 26, 2025
```
Co-authored-by: laixin <xielx@shanghaitech.edu.cn>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: laixin <q865809639@gmail.com>
```
  21463e32
- [doc] fixed dpsk quant faq (#3865) · 3dc9ff3c
  Shenggui Li authored Feb 26, 2025
  
  3dc9ff3c
25 Feb, 2025 13 commits
- [doc] added quantization doc for dpsk (#3843) · 06427dfa
  Shenggui Li authored Feb 26, 2025
  
  06427dfa
- [Bug]: Fix maximum recursion depth triggered on exception exit (#3519) · 60524920
  Kebe authored Feb 26, 2025
  
  60524920
- [BugFix] Fix crash when receive a req with structed output in DP attention mode. (#3841) · 10771026
  IAN authored Feb 26, 2025
  
  10771026
- Bug: fix capture_bs (#3857) · 4606e2a3
  who who who authored Feb 26, 2025
  
  4606e2a3
- Fix allgather ops inside cuda graphs (#3709) · 127998cc
  Nicolas Castet authored Feb 25, 2025
  
  127998cc
- [improve] made timeout configurable (#3803) · c0bb9eb3
  Shenggui Li authored Feb 25, 2025
  
  c0bb9eb3
- [Bug]: Add missing clamp to llavavid (#3787) · 7036d6fc
  Yueyang Pan authored Feb 25, 2025
  
  7036d6fc
- [ROCm] Enable Fused MLA Triton kernel for DeepSeekV3 (#3237) · 6ce9dbe8
  Chaitanya Sri Krishna Lolla authored Feb 25, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
```
  6ce9dbe8
- [Doc] Fix typo in server-argument description (#3641) · 3758d209
  Yuanheng Zhao authored Feb 25, 2025
  
  3758d209
- Docs: fix doc site copyright to current year (#3741) · faf29e0b
  Wilson Wu authored Feb 25, 2025
  
  faf29e0b
- Docs: fix dead link in router.md (#3799) · b0743ea0
  He1pa authored Feb 25, 2025
  
  b0743ea0
- Improve: fix typos (#3801) · 60b771c8
  Wang Ran (汪然) authored Feb 25, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  60b771c8
- Fix CI and install docs (#3821) · d7934cde
  Lianmin Zheng authored Feb 24, 2025
  
  d7934cde
24 Feb, 2025 8 commits
- Revert "Extract generation_manager from tokenizer_manager" (#3829) · 62bbd343
  Lianmin Zheng authored Feb 24, 2025
  
  62bbd343
- Revert "Rename TokenizerManager to StdOrchestrator" (#3828) · f2388f6b
  Lianmin Zheng authored Feb 24, 2025
  
  f2388f6b
- Fix pandas dependency in CI (#3818) · c9745ee0
  Lianmin Zheng authored Feb 24, 2025
  
  c9745ee0
- Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730) · 1a6e9757
  laixin authored Feb 24, 2025
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  1a6e9757
- Refactor flashinfer logic for deepseek v3 and fix accuracy bug (#3785) · b1100846
  Baizhou Zhang authored Feb 24, 2025
  
  b1100846
- Fix dependency (#3813) · 27a46317
  Lianmin Zheng authored Feb 24, 2025
  
  27a46317
- Update readme (#3809) · c9795808
  Lianmin Zheng authored Feb 24, 2025
  
  c9795808
- Hierarchical Caching for SGLang (#2693) · 6c7a152c
  Zhiqiang Xie authored Feb 23, 2025
```
Co-authored-by: Wenxuan Tan <wenxuan.tan@wisc.edu>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  6c7a152c
23 Feb, 2025 1 commit
- [Docs]Add instruction for manually stopping nsys profiler (#3795) · 4d2a88bd
  Baizhou Zhang authored Feb 23, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  4d2a88bd