Commits · 3a22a303d1db773455e1371bbff4f5ed65e683c6 · zhaoyu6 / sglang

"vscode:/vscode.git/clone" did not exist on "14522e6a26e7dfb6e27c0b79f211f11d190259fe"

05 Jan, 2025 1 commit
- Revert the GLOO_SOCKET_IFNAME change (#2731) · 3a22a303
  Lianmin Zheng authored Jan 04, 2025
  
  3a22a303
03 Jan, 2025 6 commits
- Refactor SchedulePolicy to improve code organization (#2571) · bdb3929d
  libra authored Jan 04, 2025
  
  bdb3929d
- feat: Support VLM in reference_hf (#2726) · f5d0865b
  Ce Gao authored Jan 03, 2025
```
Signed-off-by: Ce Gao <gaocegege@hotmail.com>
```
  f5d0865b
- [Docs] fix 404 - Contributor Guide, again (#2727) · afdee7b1
  Ce Gao authored Jan 03, 2025
```
Signed-off-by: Ce Gao <gaocegege@hotmail.com>
```
  afdee7b1
- Update README.md (#2722) · cb34d848
  Lianmin Zheng authored Jan 03, 2025
```
Co-authored-by: Yangmin Li <2682000734@qq.com>
Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu>
Co-authored-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  cb34d848
- Fix package loss for small models (#2717) · 0f9cc6d8
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: sdli1995 < mmlmonkey@163.com>
```
  0f9cc6d8
- [Feature, Hardware] Enable DeepseekV3 on AMD GPUs (#2601) · c7ae474a
  yigex authored Jan 03, 2025
```
Co-authored-by: root <root@banff-cyxtera-s83-5.amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Bruce Xue <yigex@xilinx.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  c7ae474a
02 Jan, 2025 10 commits
- Support loading pre-sharded moe weights (#2716) · bdf946bf
  Lianmin Zheng authored Jan 02, 2025
  
  bdf946bf
- [Fix] fix retract error in eagle speculative decoding (#2711) · 8c8779cd
  yukavio authored Jan 03, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  8c8779cd
- [Fix] fix incorrectly overwriting the port specified in ServerArgs (#2714) · 1775b963
  Mick authored Jan 03, 2025
  
  1775b963
- Docs: Update documentation workflow and contribution guide (#2704) · dd2e2d27
  Shi Shuai authored Jan 02, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  dd2e2d27
- Included multi-node DeepSeekv3 example (#2707) · a990daff
  Rodrigo Garcia authored Jan 02, 2025
  
  a990daff
- feat: support moe_align_block_size_triton (#2712) · ba5112ff
  Yineng Zhang authored Jan 02, 2025
```
Co-authored-by: WANDY666 <1060304770@qq.com>
```
  ba5112ff
- Eagle speculative decoding part 4: Add EAGLE2 worker (#2150) · 815dce05
  yukavio authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  815dce05
- Eagle speculative decoding part 3: small modifications to the general scheduler (#2709) · ad20b795
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  ad20b795
- Speed up `update_weights_from_tensor` (#2695) · 9183c23e
  fzyzcjy authored Jan 02, 2025
  
  9183c23e
- Improve moe reduce sum kernel performance (#2705) · 148254d4
  kk authored Jan 02, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  148254d4
01 Jan, 2025 3 commits
- [feat]: Add math eval to CI nightly run (#2663) · a4d6d6f1
  Xiaotong Jiang authored Jan 01, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  a4d6d6f1
- [Docs] Add Support for Pydantic Structured Output Format (#2697) · 062c48d2
  Shi Shuai authored Jan 01, 2025
  
  062c48d2
- ROCm base image update (#2692) · b6e0cfb5
  kk authored Jan 01, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  b6e0cfb5
31 Dec, 2024 13 commits
- Doc: Rename contribution_guide.md (#2691) · 0d8d97b8
  Chayenne authored Dec 31, 2024
  
  0d8d97b8
- Docs: Refactor Contribution Guide (#2690) · 0a765bbc
  Shi Shuai authored Dec 31, 2024
  
  0a765bbc
- h200 tuning fused_moe_triton config for Mixtral 8x7B/8x22B and Qwen2 57BA14B (#2689) · 286cad3e
  Xiaoyu Zhang authored Dec 31, 2024
  
  286cad3e
- [Fix] fix openai adapter (#2685) · dc7eb01f
  Ying Sheng authored Dec 31, 2024
  
  dc7eb01f
- Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684) · b0524c37
  Lianmin Zheng authored Dec 31, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  b0524c37
- Update README.md (#2683) · 6c42fa22
  Lianmin Zheng authored Dec 31, 2024
  
  6c42fa22
- feat: use CUDA 12.4 by default (for FA3) (#2682) · d49b13c6
  Yineng Zhang authored Dec 31, 2024
  
  d49b13c6
- misc: update CODEOWNERS (#2680) · bedc4c7a
  Yineng Zhang authored Dec 31, 2024
  
  bedc4c7a
- Support target model verification in the attention backend (#2678) · f44d1439
  Lianmin Zheng authored Dec 30, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  f44d1439
- minor: cleanup sgl-kernel (#2679) · b6b57fc2
  Yineng Zhang authored Dec 31, 2024
  
  b6b57fc2
- Add cutlass submodule for sgl-kernel (#2676) · b4403985
  Ke Bao authored Dec 31, 2024
  
  b4403985
- Improve the computation for time_per_output_token Prometheus metrics (#2674) · 339c69a2
  Lianmin Zheng authored Dec 30, 2024
  
  339c69a2
- CI: Update scripts to fail fast (#2672) · f7074700
  fzyzcjy authored Dec 31, 2024
  
  f7074700
30 Dec, 2024 7 commits
- Minor follow-up fixes for the logprob refactor (#2670) · 21ec66e5
  Lianmin Zheng authored Dec 30, 2024
  
  21ec66e5
- AMD DeepSeek_V3 FP8 Numerical fix (#2667) · c5210dfa
  HAI authored Dec 30, 2024
  
  c5210dfa
- Add GemLite caching after each capture (#2669) · a29dd950
  mobicham authored Dec 30, 2024
  
  a29dd950
- Refactor logprob computation to return the real logprob used in sampling (#2664) · 9c6ba248
  Lianmin Zheng authored Dec 30, 2024
  
  9c6ba248
- Refactor sgl-kernel build (#2642) · b02da24a
  Ke Bao authored Dec 30, 2024
  
  b02da24a
- Update structured_outputs.ipynb (#2666) · bdd2827a
  Lianmin Zheng authored Dec 30, 2024
  
  bdd2827a
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e