Commits · 05625b979279fbfb8d6144c0c1e0f917d137f62c · change / sglang · GitLab

29 Mar, 2025 9 commits
- [Docs] Update DeepGEMM at README.md (#4886) · 05625b97
  yinfan98 authored Mar 30, 2025
  
  05625b97
- Tiny fix doc error (#4795) · 736502d4
  fzyzcjy authored Mar 29, 2025
  
  736502d4
- Improve stack trace of retry errors (#4845) · 8690c40b
  fzyzcjy authored Mar 29, 2025
  
  8690c40b
- Fix BadRequestError wrong arguments and remove openai dependency (#4882) · b1cfb4e9
  fzyzcjy authored Mar 29, 2025
  
  b1cfb4e9
- bump v0.4.4.post3 (#4878) · 19e96e59
  Yineng Zhang authored Mar 28, 2025
  
  19e96e59
- update torch compile doc (#4874) · aa08aeac
  Ke Bao authored Mar 29, 2025
  
  aa08aeac
- upgrade sgl-kernel 0.0.5.post4 (#4873) · d8a136a1
  Yineng Zhang authored Mar 28, 2025
  
  d8a136a1
- [Feature] Support FA3 backend for MLA (#4831) · 20c90be2
  Baizhou Zhang authored Mar 28, 2025
  
  20c90be2
- fix sgl-kernel cu118 build (#4872) · ec3ee028
  Yineng Zhang authored Mar 28, 2025
  
  ec3ee028
28 Mar, 2025 31 commits
- bump sgl-kernel 0.0.5.post4 (#4768) · 92941ce7
  Yineng Zhang authored Mar 28, 2025
  
  92941ce7
- fix sampling issue (#4871) · 2bb0e7cf
  Yineng Zhang authored Mar 28, 2025
  
  2bb0e7cf
- update sgl-kernel test ci (#4866) · 72549263
  Yineng Zhang authored Mar 28, 2025
  
  72549263
- Make torch compile configurable for biased_grouped_topk (#4749) · 044c3159
  Qingquan Song authored Mar 28, 2025
  
  044c3159
- [Feat] support deepgemm for cmake (#4864) · 4db29e82
  yinfan98 authored Mar 29, 2025
  
  4db29e82
- Fix wrong variable name when stopping memory profile (#4772) · c483377e
  Fr4nk1in authored Mar 29, 2025
  
  c483377e
- Clean up `import vllm` in quantization/__init__.py (#4834) · 74e0ac1d
  Lianmin Zheng authored Mar 28, 2025
  
  74e0ac1d
- [Feature] add multi-rank support for Lora (#4492) · ef9a378a
  chaobo jia authored Mar 29, 2025
```
Co-authored-by: rudy152 <czh1137892874@gmail.com>
```
  ef9a378a
- Revert "get the python version from env (#4729)" (#4863) · 6dea5c96
  Yineng Zhang authored Mar 28, 2025
  
  6dea5c96
- Fix fa3 cuda graph page_size > 1 precision and page_size=1 speed (#4855) · 6ffb6bd4
  Qingquan Song authored Mar 28, 2025
  
  6ffb6bd4
- Fix CI tests (#4853) · 47e6628a
  Lianmin Zheng authored Mar 28, 2025
  
  47e6628a
- test: reduce `mem_fraction_static` for gemma3 vision test (#4840) · 7907f9eb
  Juwan Yoo authored Mar 27, 2025
  
  7907f9eb
- Support with_stack and record_shapes in profiler (#4740) · 8c04f0f2
  fzyzcjy authored Mar 28, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  8c04f0f2
- Super tiny remove unused code (#4750) · 265e7564
  fzyzcjy authored Mar 28, 2025
  
  265e7564
- Fix torch.cuda.MemPool() internal assertion failure (#4687) · d3f71f5e
  fzyzcjy authored Mar 28, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  d3f71f5e
- get the python version from env (#4729) · 5eae67cb
  DavidChan authored Mar 28, 2025
  
  5eae67cb
- Fix missing arguments in SchedulePolicy and RadixCache initialization in tests. (#4712) · 6dbf9998
  vikram singh shekhawat authored Mar 28, 2025
  
  6dbf9998
- Remove empty tool function name (#4704) · e0166f8a
  Kebe authored Mar 28, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  e0166f8a
- Support controlling nsys start and end range programmatically (#4688) · 53a2c3b4
  fzyzcjy authored Mar 28, 2025
  
  53a2c3b4
- fix: Inappropriate lack of Optional type on OpenAI ChatCompletionRequest (#4681) · 550586ef
  BroadbentJim authored Mar 28, 2025
  
  550586ef
- Fix Engine error when enabling DP attention (#4648) · cf29fe9e
  fzyzcjy authored Mar 28, 2025
  
  cf29fe9e
- Support Page Size > 1 for FA3 (#4832) · 26c0f131
  Stefan He authored Mar 27, 2025
```
Co-authored-by: Qingquan Song <ustcsqq@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  26c0f131
- fix: when use SGLANG_PORT this env,port is str (#4528) · f9970bd1
  rongfu.leng authored Mar 28, 2025
```
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
```
  f9970bd1
- [Fix] fix output_top_logprobs is not exist (#4597) · 2e0f94ab
  lambert0312 authored Mar 28, 2025
  
  2e0f94ab
- ci: add condition for daily docker build (#4487) · 18317ddc
  warjiang authored Mar 28, 2025
  
  18317ddc
- IPv6 support (#3949) · e2e2ab70
  Vincent authored Mar 28, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  e2e2ab70
- Fix CI of test_patch_torch (#4844) · 0d3e3072
  fzyzcjy authored Mar 28, 2025
  
  0d3e3072
- Remove retry in nightly tests (#4846) · 62dd9587
  fzyzcjy authored Mar 28, 2025
  
  62dd9587
- fix: fix typo of comments in w8a8_fp8.py (#4843) · 72031173
  Jiaqi authored Mar 28, 2025
  
  72031173
- Fix the lora adapter when lora path is none (#4799) · 9fdc6d6a
  Qiaolin Yu authored Mar 28, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  9fdc6d6a
- [Fix] `self.worker` assignment in `TpModelWorker` and refactor references (#4788) · 42a45df0
  XinyuanTong authored Mar 27, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  42a45df0