Commits · 61e0a506a3a30445fddff21355936e9f83725c97 · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "01513a334a451e53162a2526ae28caba7fa868d4"

13 May, 2025 8 commits
- [Bugfix] Avoid repeatedly creating dummy data during engine startup (#17935) · 61e0a506
  Cyrus Leung authored May 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61e0a506
- [Bugfix] Fixes for new marlin moe usage (#18017) · 1df491c5
  Michael Goin authored May 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1df491c5
- [ROCm]: Fix build from source failure with gcc14 and ROCm 6.3 (#13779) · d8487ef5
  Arjun Kathuria authored May 13, 2025
```
Signed-off-by: Arjun Kathuria <arjun.kathuria8@gmail.com>
```
  d8487ef5
- [Misc] Slight spelling modification (#18039) · c06af9a9
  Jee Jee Li authored May 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c06af9a9
- Implements dual-chunk-flash-attn backend for dual chunk attention with sparse... · 60f76243
  Tao He authored May 13, 2025
```
Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)
```
  60f76243
- [ROCm] Skip tests for quantizations incompatible with ROCm (#17905) · f6518b2b
  hissu-hyvarinen authored May 13, 2025
```
Signed-off-by: Hissu Hyvarinen <hissu.hyvarinen@amd.com>
```
  f6518b2b
- Remove noisy warnings from `SchedulerConfig` (#17995) · d67085c2
  Harry Mellor authored May 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d67085c2
- Use NVFP4 Marlin for CompressedTensorsW4A16Fp4 (#18000) · 307939f2
  Michael Goin authored May 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Dipika <dipikasikka1@gmail.com>
```
  307939f2
12 May, 2025 25 commits
- Update some more deprecated type hinting (#17998) · 9d7ea9db
  Harry Mellor authored May 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9d7ea9db
- [Model] Support MiMo-7B inference with MTP (#17433) · acee8f48
  bwshen-mi authored May 13, 2025
```
Signed-off-by: wp-alpha <wangpeng66@xiaomi.com>
Co-authored-by: wangpeng66 <wangpeng66@xiaomi.com>
```
  acee8f48
- Fix FBGEMM integration (#18002) · f065de4e
  Michael Goin authored May 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f065de4e
- [V1][Spec Decode] Eagle unit tests (#17350) · dc990536
  wwl2755 authored May 12, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  dc990536
- [CI] Make JSON output tests less likely to fail (#17859) · ebab1ac3
  Russell Bryant authored May 12, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ebab1ac3
- Enable standard language model for torhc nightly (#18004) · 2b0db9b0
  Yang Wang authored May 12, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  2b0db9b0
- [Chore] Remove unused method (#18024) · 195adb47
  Robert Shaw authored May 12, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  195adb47
- [v1][KVCacheManager] Change prefix caching metric from counting blocks to counting tokens (#18003) · 302f3aca
  Chen Zhang authored May 13, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  302f3aca
- Enabling "Weight Loading Multiple GPU Test - Large Models" (#18020) · e9c730c9
  Alexei-V-Ivanov-AMD authored May 12, 2025
  
  e9c730c9
- [Core] Use platform-agnostic device control for DP engine core (#17245) · 289199fe
  Jade Zheng authored May 13, 2025
```
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
```
  289199fe
- [CI/Build] Fix TPU V1 Test mixed use of & and && across tests (#17968) · b9fd0d7a
  Carol Zheng authored May 12, 2025
  
  b9fd0d7a
- Construct `KVTransferConfig` properly from Python instead of using JSON blobs without CLI (#17994) · 72a3f6b8
  Harry Mellor authored May 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  72a3f6b8
- [Lora][Frontend]Add default local directory LoRA resolver plugin. (#16855) · 98ea3560
  Jonathan Berkhahn authored May 12, 2025
```
Signed-off-by: jberkhahn <jaberkha@us.ibm.com>
```
  98ea3560
- [P/D] NIXL Integration (#17751) · d1911020
  Robert Shaw authored May 12, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Brent Salisbury <bsalisbu@redhat.com>
```
  d1911020
- Initialize the delta tool call fields explicitly (#17340) · 05a4324f
  Maximilien de Bayser authored May 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: igmainc <igmainc@icloud.com>
```
  05a4324f
- [Misc] Improve modelscope import error (#17983) · 7ea6cb28
  Jee Jee Li authored May 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7ea6cb28
- Correcting testcases in builkite job for IBM Power (#17675) · 9fbf2bfb
  Aaruni Aggarwal authored May 12, 2025
```
Signed-off-by: Aaruni Aggarwal <aaruniagg@gmail.com>
```
  9fbf2bfb
- [Feature] Support DeepSeekV3 Function Call (#17784) · 3a5ea751
  Xu Wenqing authored May 12, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
```
  3a5ea751
- [Fix] Benchmark `"EngineClient" has no attribute "model_config"` (#17976) · 891b9d33
  Brayden Zhong authored May 12, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  891b9d33
- [Bugfix][TPU] Use np array when updating cache slot_mapping (#17971) · 43078301
  Siyuan Liu authored May 11, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  43078301
- [Bugfix] Fix pydantic.errors.PydanticUserError (#17962) · 19a3c78d
  Li Wang authored May 12, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  19a3c78d
- [bugfix] fix the wrong parser (#17958) · ada50aa2
  Reid authored May 12, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  ada50aa2
- [Bugfix] validate grammar and throw 400 error instead of crashing the engine... · 08bf7840
  Cheng Kuan Yong Jason authored May 12, 2025
```
[Bugfix] validate grammar and throw 400 error instead of crashing the engine when xgrammar validation fails (#17623)
Signed-off-by: Jason Cheng <jasoncky96@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  08bf7840
- [misc] add instructions on how to install nvshmem/pplx/deepep (#17964) · d45fe333
  youkaichao authored May 12, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d45fe333
- [Model] Broadcast Ovis2 implementation to fit Ovis1.6 (#17861) · 021c16c7
  Isotr0py authored May 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  021c16c7
11 May, 2025 7 commits
- [BUG] [ROCm] [MLA] Fix variable name bug due to change in variable name in PR #17483 (#17961) · 7de18d54
  TJian authored May 12, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  7de18d54
- [BugFix] [ROCm]: Bugfix and handle addition case of input for `rocm_aiter_rms_norm` (#17857) · a810b5b0
  TJian authored May 11, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  a810b5b0
- [Misc] not show --model in vllm serve --help (#16691) · 009b3d53
  Reid authored May 11, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  009b3d53
- [New Model]: nomic-embed-text-v2-moe (#17785) · e4b87133
  wang.yuqi authored May 11, 2025
  
  e4b87133
- [FP8][ROCm][Attention] Enable FP8 KV cache on ROCm for V1 (#17870) · 06c0922a
  Gregory Shtrasberg authored May 11, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  06c0922a
- [Misc] Add compressed-tensors NVFP4A16 emulation support (#17914) · cd3edfc9
  Dipika Sikka authored May 11, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  cd3edfc9
- [Frontend] Add /classify endpoint (#17032) · 9cea90ea
  Frieda Huang authored May 11, 2025
```
Signed-off-by: Frieda (Jingying) Huang <jingyingfhuang@gmail.com>
```
  9cea90ea