Commits · 5be8f1ed987fe49030acc51c62bdd6898720aa83 · change / sglang

"docs/doxygen/Doxyfile" did not exist on "e6cda9f8ff8baa58d61905239a70f93db1933eb5"

05 Mar, 2025 1 commit
- example: add vlm to token in & out example (#3941) · 583d6af7
  Mick authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  583d6af7
04 Mar, 2025 1 commit
- Simplify eagle tests and TP sync in grammar backend (#4066) · 77a3954b
  Lianmin Zheng authored Mar 04, 2025
  
  77a3954b
03 Mar, 2025 3 commits
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Improve code styles (#4021) · 66301e12
  Lianmin Zheng authored Mar 03, 2025
  
  66301e12
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
02 Mar, 2025 1 commit
- Refactor: Move return_hidden_states to the generate input (#3985) · 40782f05
  Qiaolin Yu authored Mar 01, 2025
```
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
```
  40782f05
28 Feb, 2025 3 commits
- [Feature] SPMD for SGLang + Verl (#3852) · e3e0bc50
  fzyzcjy authored Mar 01, 2025
  
  e3e0bc50
- [Feature] integrate Structural Tag in xgrammar backend for function calling (#3566) · bac414ab
  mlmz authored Feb 28, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  bac414ab
- [Bugfix] Fix tokenizer_manager not getting 400 when req is too long (#3678) · eec3f6d1
  Chang Su authored Feb 27, 2025
```
Co-authored-by: voidxb <unkown>
```
  eec3f6d1
27 Feb, 2025 1 commit

Add return hidden state in the native API (#3897) · d6898dd2

Qiaolin Yu authored Feb 27, 2025


Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>

d6898dd2

25 Feb, 2025 3 commits
- [BugFix] Fix crash when receive a req with structed output in DP attention mode. (#3841) · 10771026
  IAN authored Feb 26, 2025
  
  10771026
- Improve: fix typos (#3801) · 60b771c8
  Wang Ran (汪然) authored Feb 25, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  60b771c8
- Fix CI and install docs (#3821) · d7934cde
  Lianmin Zheng authored Feb 24, 2025
  
  d7934cde
24 Feb, 2025 2 commits
- Revert "Rename TokenizerManager to StdOrchestrator" (#3828) · f2388f6b
  Lianmin Zheng authored Feb 24, 2025
  
  f2388f6b
- Hierarchical Caching for SGLang (#2693) · 6c7a152c
  Zhiqiang Xie authored Feb 23, 2025
```
Co-authored-by: Wenxuan Tan <wenxuan.tan@wisc.edu>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  6c7a152c
23 Feb, 2025 1 commit
- Improve: Rename TokenizerManager to StdOrchestrator (#3116) · 45360b2f
  fzyzcjy authored Feb 23, 2025
  
  45360b2f
10 Feb, 2025 1 commit
- [Feat] Return hidden states (experimental) (#3364) · 5f0e7de3
  Jackmin801 authored Feb 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  5f0e7de3
27 Jan, 2025 2 commits
- Sanity check to prevent performance regression (#3171) · 08104b56
  Zhiqiang Xie authored Jan 27, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  08104b56
- Improve weight loading and code style (#3174) · 53cef815
  Lianmin Zheng authored Jan 27, 2025
  
  53cef815
26 Jan, 2025 2 commits
- Return more infos for computing average acceptance length (#3152) · 1dda8c5e
  Lianmin Zheng authored Jan 26, 2025
  
  1dda8c5e
- Add a test case for cached_tokens (#3145) · d1a08632
  Lianmin Zheng authored Jan 26, 2025
  
  d1a08632
21 Jan, 2025 1 commit
- Misc fixes for eagle (flush_cache, CPU overhead) (#3014) · 287d07a6
  Lianmin Zheng authored Jan 20, 2025
  
  287d07a6
20 Jan, 2025 3 commits
- [Enhancement] Custom Logit Processor Improvement (#2998) · 583697cd
  Hongpeng Guo authored Jan 20, 2025
```
Signed-off-by: Hongpeng Guo <hpguo@anyscale.com>
```
  583697cd
- Improve metrics, logging, and importing orders (#2992) · cd493b5a
  Lianmin Zheng authored Jan 19, 2025
  
  cd493b5a
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
19 Jan, 2025 4 commits
- [Feature] Add sampler custom logits processor (#2396) · e403d237
  Hongpeng Guo authored Jan 19, 2025
```
Signed-off-by: Hongpeng Guo <hpguo@anyscale.com>
```
  e403d237
- fix missing revision arg when loading tokenizer (#2982) · 8b6a4486
  giorgiopiatti-dfinity authored Jan 19, 2025
  
  8b6a4486
- Refactor to add TypeBasedDispatcher to simplify dispatching (#2958) · 81d27c8e
  fzyzcjy authored Jan 19, 2025
  
  81d27c8e
- Frontend: better error message handling for FINISH_ABORT in scheduler.py (#2956) · 4d4cdb3f
  Chang Su authored Jan 18, 2025
  
  4d4cdb3f
18 Jan, 2025 2 commits
- [Feature] Support minicpmv v2.6 (#2785) · 3d93f84a
  Mick authored Jan 19, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  3d93f84a
- Query remaining memory dynamically for PrefillAdder (#2941) · 8af7048d
  Zhiqiang Xie authored Jan 17, 2025
  
  8af7048d
17 Jan, 2025 1 commit
- Enable CPU device on SGLang (#2806) · 63051738
  Chunyuan WU authored Jan 17, 2025
  
  63051738
16 Jan, 2025 5 commits
- [Frontend] Fix request length check and add option to disallow auto truncation in scheduler (#2876) · a8ccacc8
  Chang Su authored Jan 16, 2025
  
  a8ccacc8
- Fix zmq binding (#2930) · 0427416b
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: Chunyuan WU <chunyuan.wu@intel.com>
```
  0427416b
- Improve type annotation and styles (#2926) · bc6915e3
  Lianmin Zheng authored Jan 16, 2025
  
  bc6915e3
- Support multi-node DP attention (#2925) · 8b6ce52e
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
```
  8b6ce52e
- Improve benchmark scripts and error message printing (#2922) · 8f2c522a
  Lianmin Zheng authored Jan 16, 2025
  
  8f2c522a
15 Jan, 2025 1 commit
- Remove normalized_prompt_logprobs from the engine to make code easier to maintain (#2902) · f65c13b5
  Lianmin Zheng authored Jan 15, 2025
  
  f65c13b5
13 Jan, 2025 2 commits
- Add a new api configure_logging to allow dumping the requests (#2875) · 46d44318
  Lianmin Zheng authored Jan 13, 2025
  
  46d44318
- CUDA-graph-compatible releasing and resuming KV cache and model weight memory (#2630) · 923f5183
  fzyzcjy authored Jan 14, 2025
  
  923f5183