Commits · 475e2e378a3cb2de38a40a316c4afba3584c7e9e · change / sglang

04 Apr, 2025 1 commit

[2/3] fix dsv3 awq issue (#4625) · d95269f9

AniZpZ authored Apr 04, 2025


Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>

d95269f9

17 Mar, 2025 1 commit
- Support serving DeepSeek-R1-Channel-INT8 with 32 L40S. (#4418) · 75b65648
  Wenbo Yang authored Mar 17, 2025
  
  75b65648
14 Mar, 2025 1 commit
- [Doc] fix wrong flag in deepseek documentation (#4427) · 660305c3
  Zhan Lu authored Mar 14, 2025
  
  660305c3
13 Mar, 2025 1 commit
- add INT8 example into dsv3 README (#4079) · 0c020860
  laixin authored Mar 13, 2025
  
  0c020860
07 Mar, 2025 1 commit
- Add an example of using deepseekv3 int8 sglang. (#4177) · ffa1b3e3
  lukec authored Mar 07, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  ffa1b3e3
27 Feb, 2025 1 commit
- revert "Docs: Reorngaize dpsk links #3900" (#3933) · 5d860168
  Yineng Zhang authored Feb 27, 2025
  
  5d860168
26 Feb, 2025 1 commit
- Docs: Reorngaize dpsk links (#3900) · 7c1692aa
  Chayenne authored Feb 26, 2025
  
  7c1692aa
19 Feb, 2025 2 commits
- [Docs] Add SkyPilot DeepSeek example (#3706) · f93e9158
  Zhanghao Wu authored Feb 19, 2025
  
  f93e9158
- set NCCL_IB_GID_INDEX=3 for multi node NVIDIA InfiniBand if needed (#3698) · fe0673f1
  Yineng Zhang authored Feb 19, 2025
  
  fe0673f1
17 Feb, 2025 1 commit
- [docker] added rdma support (#3619) · c9565e49
  Shenggui Li authored Feb 17, 2025
  
  c9565e49
14 Feb, 2025 2 commits
- update flashinfer-python (#3557) · ac963be2
  Yineng Zhang authored Feb 14, 2025
  
  ac963be2
- chore: bump v0.4.3 (#3556) · e0b9a423
  Yineng Zhang authored Feb 14, 2025
  
  e0b9a423
13 Feb, 2025 2 commits
- update README (#3543) · 20de05a7
  Yineng Zhang authored Feb 13, 2025
  
  20de05a7
- Update DeepSeek V3 Doc (#3541) · bf2a7087
  Jhin authored Feb 13, 2025
  
  bf2a7087
12 Feb, 2025 1 commit
- refine deepseek_v3 launch server doc (#3522) · 693c2600
  Xiaoyu Zhang authored Feb 12, 2025
  
  693c2600
10 Feb, 2025 1 commit
- chore: bump v0.4.2.post4 (#3459) · cddb1cdf
  Yineng Zhang authored Feb 10, 2025
  
  cddb1cdf
08 Feb, 2025 2 commits
- fix typo · f90db8bc
  Yineng Zhang authored Feb 08, 2025
  
  f90db8bc
- Add deepseek-v3 a100 serving example (#3404) · d8ad5970
  Ke Bao authored Feb 08, 2025
  
  d8ad5970
07 Feb, 2025 1 commit
- chore: bump v0.4.2.post3 (#3369) · c1f5f99f
  Yineng Zhang authored Feb 08, 2025
  
  c1f5f99f
06 Feb, 2025 2 commits
- [Doc] Add optimization option guide for deepseek v3 (#3349) · 6792411e
  Ke Bao authored Feb 06, 2025
  
  6792411e
- add AMD guide for DeepSeek-R1 (#3338) · 7348d962
  Yineng Zhang authored Feb 06, 2025
  
  7348d962
05 Feb, 2025 1 commit
- update README (#3324) · 07e58a2d
  Yineng Zhang authored Feb 06, 2025
  
  07e58a2d
14 Jan, 2025 1 commit
- docs: update README (#2878) · 80002562
  Yineng Zhang authored Jan 14, 2025
  
  80002562
13 Jan, 2025 2 commits
- docs: update link (#2857) · 41d7e5b7
  Yineng Zhang authored Jan 13, 2025
  
  41d7e5b7
- Fix linear.py and improve weight loading (#2851) · 72c77763
  Lianmin Zheng authored Jan 13, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  72c77763
11 Jan, 2025 2 commits
- docs: update README (#2841) · 197cbf9b
  Yineng Zhang authored Jan 11, 2025
  
  197cbf9b
- chore: bump v0.4.1.post5 (#2840) · f624901c
  Yineng Zhang authored Jan 11, 2025
  
  f624901c
02 Jan, 2025 2 commits
- Included multi-node DeepSeekv3 example (#2707) · a990daff
  Rodrigo Garcia authored Jan 02, 2025
  
  a990daff
- Eagle speculative decoding part 3: small modifications to the general scheduler (#2709) · ad20b795
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  ad20b795
30 Dec, 2024 3 commits
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
- docs: update README (#2651) · 098d659c
  Yineng Zhang authored Dec 30, 2024
  
  098d659c
- add 2*h20 node serving example for deepseek v3 (#2650) · 76d14f8c
  Lzhang-hub authored Dec 30, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  76d14f8c
29 Dec, 2024 2 commits
- Release 0.4.1.post3 - upload the config.json to PyPI (#2647) · 03d5fbfd
  Lianmin Zheng authored Dec 29, 2024
  
  03d5fbfd
- docs: update README (#2644) · 763dd55d
  Yineng Zhang authored Dec 30, 2024
  
  763dd55d
28 Dec, 2024 1 commit
- Update readme (#2625) · 8a2681e2
  Ke Bao authored Dec 28, 2024
  
  8a2681e2
27 Dec, 2024 1 commit
- docs: update README (#2618) · d9e6ee38
  Yineng Zhang authored Dec 28, 2024
  
  d9e6ee38
26 Dec, 2024 4 commits
- Update README.md (#2605) · f46f394f
  Lianmin Zheng authored Dec 26, 2024
  
  f46f394f
- Fix logprob_start_len for multi modal models (#2597) · 77395154
  Lianmin Zheng authored Dec 26, 2024
```
Co-authored-by: libra <lihu723@gmail.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Wang, Haoyu <haoyu.wang@intel.com>
```
  77395154
- update readme of DeepSeek V3 (#2596) · 637de9e8
  fsygd authored Dec 26, 2024
  
  637de9e8
- docs: update deepseek v3 example (#2592) · 635a0426
  Yineng Zhang authored Dec 26, 2024
  
  635a0426