Commits · 4c33d6732148fdaeb9780fa86fca1f87f2a93c19 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "0ce0539d4750f9ebcd9b19d7085ca3b934b9ec67"

02 May, 2025 16 commits
- [Bugfix] fix tmp_out and exp_sums dimensions (#17438) · 4c33d673
  Hui Liu authored May 02, 2025
```
Signed-off-by: Hui Liu <96135754+hliuca@users.noreply.github.com>
```
  4c33d673
- [Misc] Clean up input processing (#17582) · cb234955
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cb234955
- Support W8A8 INT8 MoE for compressed-tensors (#16745) · 868c546d
  Michael Goin authored May 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  868c546d
- [Security] Fix image hash collision (#17378) · 99404f53
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  99404f53
- Automatically tell users that dict args must be valid JSON in CLI (#17577) · 785d75a0
  Harry Mellor authored May 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  785d75a0
- add more pytorch related tests for torch nightly (#17422) · b8b0859b
  Yang Wang authored May 02, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  b8b0859b
- [Misc] Rename assets for testing (#17575) · d7543862
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d7543862
- [BugFix] Fix Memory Leak (#17567) · c777df79
  Robert Shaw authored May 02, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  c777df79
- [Core] [Bugfix] Add Input Embeddings (#15428) · cc2a77d7
  Andrew Sansom authored May 02, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cc2a77d7
- [Bugifx] Remove TritonPlaceholder from sys.modules (#17317) · 9e2de9b9
  Isotr0py authored May 02, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  9e2de9b9
- Add `pt_load_map_location` to allow loading to cuda (#16869) · 109e15a3
  Jerry Zhang authored May 01, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  109e15a3
- Fix PixtralHF missing spatial_merge_size (#17571) · f192ca90
  Michael Goin authored May 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f192ca90
- [Misc] Continue refactoring model tests (#17573) · f89d0e11
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f89d0e11
- Check if bitblas is installed during support check (#17572) · b4003d11
  Michael Goin authored May 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b4003d11
- [Attention] MLA move o_proj q_proj into cuda-graph region (#17484) · afcb3f88
  Lucas Wilkinson authored May 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  afcb3f88
- [Bugfix] Disable gptq_bitblas for <SM80 to fix GPTQ on V100/T4 (#17541) · 24aebae1
  Michael Goin authored May 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  24aebae1
01 May, 2025 24 commits
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE3 (#17504) · 39c0813a
  qizixi authored May 01, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
```
  39c0813a
- [Bug]change the position of cuda_graph_sizes in dataclasses (#17548) · 173daac1
  Chen Xia authored May 01, 2025
```
Signed-off-by: CXIAAAAA <cxia0209@gmail.com>
```
  173daac1
- Remove duplicate code from dbrx.py (#17550) · 04f2cfc8
  sstamenk authored May 01, 2025
  
  04f2cfc8
- [ROCM] Add gfx950 to the custom attention archs (#16034) · 811a6c09
  Juan Villamizar authored May 01, 2025
```
Signed-off-by: jpvillam <Juan.Villamizar@amd.com>
Signed-off-by: seungrokjung <seungrok.jung@amd.com>
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: seungrokjung <seungrok.jung@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  811a6c09
- [Bugfix] Fix lint error (#17547) · 9b1769dd
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9b1769dd
- [Misc]add configurable cuda graph size (#17201) · 61c299f8
  Chen Xia authored May 01, 2025
```
Signed-off-by: CXIAAAAA <cxia0209@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  61c299f8
- [Model] Refactor Ovis2 to support original tokenizer (#17537) · 88c83041
  Isotr0py authored May 02, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  88c83041
- Move the last arguments in `arg_utils.py` to be in their final groups (#17531) · 6768ff4a
  Harry Mellor authored May 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6768ff4a
- [torch.compile] Add torch inductor pass for fusing silu_and_mul with... · 460a2b11
  Sage Moore authored May 01, 2025
```
[torch.compile] Add torch inductor pass for fusing silu_and_mul with subsequent scaled_fp8_quant operations (#10867)
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  460a2b11
- [ROCm] remove unsupported archs from rocm triton flash-attention supported list (#17536) · 28566d73
  Hongxia Yang authored May 01, 2025
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
  28566d73
- [Feature][Frontend]: Deprecate --enable-reasoning (#17452) · 98060b00
  Chauncey authored May 01, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  98060b00
- [FEAT] [ROCm]: Add Qwen/Qwen3-235B-A22B-FP8 TP4 triton fused moe config (#17535) · f5a3c655
  TJian authored May 01, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  f5a3c655
- Fix more broken speculative decode tests (#17450) · b74d888c
  Huy Do authored May 01, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  b74d888c
- [FEAT] [ROCm]: Add Qwen/Qwen3-30B-A3B-FP8 fused moe config for MI300X (#17530) · 2007d4d5
  TJian authored May 01, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  2007d4d5
- [Frontend] Show progress bar for adding requests (#17525) · 1903c0b8
  Cyrus Leung authored May 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1903c0b8
- Improve configs - `ObservabilityConfig` (#17453) · a257d9bc
  Harry Mellor authored May 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a257d9bc
- [Misc] Optimize the Qwen3_ReasoningParser extract_reasoning_content (#17515) · 015069b0
  Chauncey authored May 01, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  015069b0
- [Core] Enable IPv6 with vllm.utils.make_zmq_socket() (#16506) · fbefc8a7
  Russell Bryant authored May 01, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  fbefc8a7
- Avoid overwriting vllm_compile_cache.py (#17418) · 26bc4bbc
  Keyun Tong authored May 01, 2025
```
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
```
  26bc4bbc
- [BugFix] Fix mla cpu - missing 3 required positional arguments (#17494) · 3c3d7672
  Lucas Wilkinson authored May 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  3c3d7672
- [BugFix] fix speculative decoding memory leak when speculation is disabled (#15506) · 13cf6b62
  Noah Yoshida authored Apr 30, 2025
```
Signed-off-by: Noah Yoshida <noahcy117@gmail.com>
```
  13cf6b62
- FIxing the AMD test failures caused by PR#16457 (#17511) · 7ab643e4
  Alexei-V-Ivanov-AMD authored May 01, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  7ab643e4
- [CI/Build] Reorganize models tests (#17459) · afb4429b
  Cyrus Leung authored May 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afb4429b
- [Bugfix] Temporarily disable gptq_bitblas on ROCm (#17411) · 1144a8ef
  NaLan ZeYu authored May 01, 2025
```
Signed-off-by: Yan Cangang <nalanzeyu@gmail.com>
```
  1144a8ef