Commits · 0519269d2060e7484b82866afe676aee7dd2361d · change / sglang

"vscode:/vscode.git/clone" did not exist on "0babd487368165b682fb25d4af6ad8b42927976e"

27 Feb, 2025 5 commits
- [Docs] Disable notebook CI when merge to main (#3905) · 0519269d
  Qing authored Feb 26, 2025
  
  0519269d
- Add return hidden state in the native API (#3897) · d6898dd2
  Qiaolin Yu authored Feb 27, 2025
```
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  d6898dd2
- [doc] Update document for flashinfer mla (#3907) · 71ed0183
  Baizhou Zhang authored Feb 26, 2025
  
  71ed0183
- [Rocm] Fix to the rocm_mla_decode_rope.py returning random result (#3898) · 8b681d77
  Tianxing Wu authored Feb 27, 2025
  
  8b681d77
- [doc] update sponsorship (#3903) · 194eea17
  ybyang authored Feb 27, 2025
  
  194eea17
26 Feb, 2025 8 commits
- Docs: Implemented frontend docs (#3791) · acd1a159
  simveit authored Feb 27, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  acd1a159
- Docs: Reorngaize dpsk links (#3900) · 7c1692aa
  Chayenne authored Feb 26, 2025
  
  7c1692aa
- Docs: Move dpsk docs forward a step (#3894) · 8f019c7d
  Chayenne authored Feb 26, 2025
  
  8f019c7d
- [Feature] Support llguidance for constrained decoding (#3298) · 7551498a
  JC1DA authored Feb 26, 2025
  
  7551498a
- Docs: improve link to docs (#3860) · 44a2c4bd
  simveit authored Feb 26, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  44a2c4bd
- Docs: delete sgl-kernel install in docs (#3845) · c9fc4a9d
  simveit authored Feb 26, 2025
  
  c9fc4a9d
- Expert Parallelism (EP) Support for DeepSeek V3/R1 (#3602) · 21463e32
  lukec authored Feb 26, 2025
```
Co-authored-by: laixin <xielx@shanghaitech.edu.cn>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: laixin <q865809639@gmail.com>
```
  21463e32
- [doc] fixed dpsk quant faq (#3865) · 3dc9ff3c
  Shenggui Li authored Feb 26, 2025
  
  3dc9ff3c
25 Feb, 2025 13 commits
- [doc] added quantization doc for dpsk (#3843) · 06427dfa
  Shenggui Li authored Feb 26, 2025
  
  06427dfa
- [Bug]: Fix maximum recursion depth triggered on exception exit (#3519) · 60524920
  Kebe authored Feb 26, 2025
  
  60524920
- [BugFix] Fix crash when receive a req with structed output in DP attention mode. (#3841) · 10771026
  IAN authored Feb 26, 2025
  
  10771026
- Bug: fix capture_bs (#3857) · 4606e2a3
  who who who authored Feb 26, 2025
  
  4606e2a3
- Fix allgather ops inside cuda graphs (#3709) · 127998cc
  Nicolas Castet authored Feb 25, 2025
  
  127998cc
- [improve] made timeout configurable (#3803) · c0bb9eb3
  Shenggui Li authored Feb 25, 2025
  
  c0bb9eb3
- [Bug]: Add missing clamp to llavavid (#3787) · 7036d6fc
  Yueyang Pan authored Feb 25, 2025
  
  7036d6fc
- [ROCm] Enable Fused MLA Triton kernel for DeepSeekV3 (#3237) · 6ce9dbe8
  Chaitanya Sri Krishna Lolla authored Feb 25, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
```
  6ce9dbe8
- [Doc] Fix typo in server-argument description (#3641) · 3758d209
  Yuanheng Zhao authored Feb 25, 2025
  
  3758d209
- Docs: fix doc site copyright to current year (#3741) · faf29e0b
  Wilson Wu authored Feb 25, 2025
  
  faf29e0b
- Docs: fix dead link in router.md (#3799) · b0743ea0
  He1pa authored Feb 25, 2025
  
  b0743ea0
- Improve: fix typos (#3801) · 60b771c8
  Wang Ran (汪然) authored Feb 25, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  60b771c8
- Fix CI and install docs (#3821) · d7934cde
  Lianmin Zheng authored Feb 24, 2025
  
  d7934cde
24 Feb, 2025 8 commits
- Revert "Extract generation_manager from tokenizer_manager" (#3829) · 62bbd343
  Lianmin Zheng authored Feb 24, 2025
  
  62bbd343
- Revert "Rename TokenizerManager to StdOrchestrator" (#3828) · f2388f6b
  Lianmin Zheng authored Feb 24, 2025
  
  f2388f6b
- Fix pandas dependency in CI (#3818) · c9745ee0
  Lianmin Zheng authored Feb 24, 2025
  
  c9745ee0
- Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730) · 1a6e9757
  laixin authored Feb 24, 2025
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  1a6e9757
- Refactor flashinfer logic for deepseek v3 and fix accuracy bug (#3785) · b1100846
  Baizhou Zhang authored Feb 24, 2025
  
  b1100846
- Fix dependency (#3813) · 27a46317
  Lianmin Zheng authored Feb 24, 2025
  
  27a46317
- Update readme (#3809) · c9795808
  Lianmin Zheng authored Feb 24, 2025
  
  c9795808
- Hierarchical Caching for SGLang (#2693) · 6c7a152c
  Zhiqiang Xie authored Feb 23, 2025
```
Co-authored-by: Wenxuan Tan <wenxuan.tan@wisc.edu>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  6c7a152c
23 Feb, 2025 3 commits
- [Docs]Add instruction for manually stopping nsys profiler (#3795) · 4d2a88bd
  Baizhou Zhang authored Feb 23, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  4d2a88bd
- Improve: Rename TokenizerManager to StdOrchestrator (#3116) · 45360b2f
  fzyzcjy authored Feb 23, 2025
  
  45360b2f
- Improve: Extract generation_manager from tokenizer_manager (#3115) · 3f41b184
  fzyzcjy authored Feb 23, 2025
  
  3f41b184
22 Feb, 2025 3 commits
- bench: Add MMMU benchmark for vLM (#3562) · 45205d88
  Mick authored Feb 23, 2025
  
  45205d88
- Improve: Use TypeBasedDispatcher in DetokenizerManager (#3117) · 90876940
  fzyzcjy authored Feb 22, 2025
  
  90876940
- Bug: Fix weight loader error when LM head weights are tied (#3766) · a3339d8c
  fzyzcjy authored Feb 22, 2025
  
  a3339d8c