Commits · f5d0865b252ff9eb95cec73caa784194463ea03a · change / sglang

"vscode:/vscode.git/clone" did not exist on "371e3f397a45914afc83b79403cabe1d9a41b931"

03 Jan, 2025 5 commits

feat: Support VLM in reference_hf (#2726) · f5d0865b
Ce Gao authored Jan 03, 2025
```
Signed-off-by: Ce Gao <gaocegege@hotmail.com>
```
f5d0865b
[Docs] fix 404 - Contributor Guide, again (#2727) · afdee7b1
Ce Gao authored Jan 03, 2025
```
Signed-off-by: Ce Gao <gaocegege@hotmail.com>
```
afdee7b1

Lianmin Zheng authored Jan 03, 2025


Co-authored-by: Yangmin Li <2682000734@qq.com>
Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu>
Co-authored-by: Zhiyu Cheng <zhiyuc@nvidia.com>

cb34d848

Fix package loss for small models (#2717) · 0f9cc6d8
Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: sdli1995 < mmlmonkey@163.com>
```
0f9cc6d8

[Feature, Hardware] Enable DeepseekV3 on AMD GPUs (#2601) · c7ae474a

yigex authored Jan 03, 2025


Co-authored-by: root <root@banff-cyxtera-s83-5.amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Bruce Xue <yigex@xilinx.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

c7ae474a

02 Jan, 2025 10 commits
- Support loading pre-sharded moe weights (#2716) · bdf946bf
  Lianmin Zheng authored Jan 02, 2025
  
  bdf946bf
- [Fix] fix retract error in eagle speculative decoding (#2711) · 8c8779cd
  yukavio authored Jan 03, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  8c8779cd
- [Fix] fix incorrectly overwriting the port specified in ServerArgs (#2714) · 1775b963
  Mick authored Jan 03, 2025
  
  1775b963
- Docs: Update documentation workflow and contribution guide (#2704) · dd2e2d27
  Shi Shuai authored Jan 02, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  dd2e2d27
- Included multi-node DeepSeekv3 example (#2707) · a990daff
  Rodrigo Garcia authored Jan 02, 2025
  
  a990daff
- feat: support moe_align_block_size_triton (#2712) · ba5112ff
  Yineng Zhang authored Jan 02, 2025
```
Co-authored-by: WANDY666 <1060304770@qq.com>
```
  ba5112ff
- Eagle speculative decoding part 4: Add EAGLE2 worker (#2150) · 815dce05
  yukavio authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  815dce05
- Eagle speculative decoding part 3: small modifications to the general scheduler (#2709) · ad20b795
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  ad20b795
- Speed up `update_weights_from_tensor` (#2695) · 9183c23e
  fzyzcjy authored Jan 02, 2025
  
  9183c23e
- Improve moe reduce sum kernel performance (#2705) · 148254d4
  kk authored Jan 02, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  148254d4
01 Jan, 2025 3 commits
- [feat]: Add math eval to CI nightly run (#2663) · a4d6d6f1
  Xiaotong Jiang authored Jan 01, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  a4d6d6f1
- [Docs] Add Support for Pydantic Structured Output Format (#2697) · 062c48d2
  Shi Shuai authored Jan 01, 2025
  
  062c48d2
- ROCm base image update (#2692) · b6e0cfb5
  kk authored Jan 01, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  b6e0cfb5
31 Dec, 2024 13 commits
- Doc: Rename contribution_guide.md (#2691) · 0d8d97b8
  Chayenne authored Dec 31, 2024
  
  0d8d97b8
- Docs: Refactor Contribution Guide (#2690) · 0a765bbc
  Shi Shuai authored Dec 31, 2024
  
  0a765bbc
- h200 tuning fused_moe_triton config for Mixtral 8x7B/8x22B and Qwen2 57BA14B (#2689) · 286cad3e
  Xiaoyu Zhang authored Dec 31, 2024
  
  286cad3e
- [Fix] fix openai adapter (#2685) · dc7eb01f
  Ying Sheng authored Dec 31, 2024
  
  dc7eb01f
- Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684) · b0524c37
  Lianmin Zheng authored Dec 31, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  b0524c37
- Update README.md (#2683) · 6c42fa22
  Lianmin Zheng authored Dec 31, 2024
  
  6c42fa22
- feat: use CUDA 12.4 by default (for FA3) (#2682) · d49b13c6
  Yineng Zhang authored Dec 31, 2024
  
  d49b13c6
- misc: update CODEOWNERS (#2680) · bedc4c7a
  Yineng Zhang authored Dec 31, 2024
  
  bedc4c7a
- Support target model verification in the attention backend (#2678) · f44d1439
  Lianmin Zheng authored Dec 30, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  f44d1439
- minor: cleanup sgl-kernel (#2679) · b6b57fc2
  Yineng Zhang authored Dec 31, 2024
  
  b6b57fc2
- Add cutlass submodule for sgl-kernel (#2676) · b4403985
  Ke Bao authored Dec 31, 2024
  
  b4403985
- Improve the computation for time_per_output_token Prometheus metrics (#2674) · 339c69a2
  Lianmin Zheng authored Dec 30, 2024
  
  339c69a2
- CI: Update scripts to fail fast (#2672) · f7074700
  fzyzcjy authored Dec 31, 2024
  
  f7074700
30 Dec, 2024 9 commits
- Minor follow-up fixes for the logprob refactor (#2670) · 21ec66e5
  Lianmin Zheng authored Dec 30, 2024
  
  21ec66e5
- AMD DeepSeek_V3 FP8 Numerical fix (#2667) · c5210dfa
  HAI authored Dec 30, 2024
  
  c5210dfa
- Add GemLite caching after each capture (#2669) · a29dd950
  mobicham authored Dec 30, 2024
  
  a29dd950
- Refactor logprob computation to return the real logprob used in sampling (#2664) · 9c6ba248
  Lianmin Zheng authored Dec 30, 2024
  
  9c6ba248
- Refactor sgl-kernel build (#2642) · b02da24a
  Ke Bao authored Dec 30, 2024
  
  b02da24a
- Update structured_outputs.ipynb (#2666) · bdd2827a
  Lianmin Zheng authored Dec 30, 2024
  
  bdd2827a
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
- fix typo in python/sglang/srt/layers/quantization/fp8.py (#2655) · e6f523b5
  HAI authored Dec 29, 2024
  
  e6f523b5
- Revert "[feat] Add math eval to CI" (#2656) · 32318178
  Lianmin Zheng authored Dec 29, 2024
  
  32318178