Commits · d085a4408244502dd496cae0ccbc524352e87ef8 · OpenDAS / vllm_cscc · GitLab

13 Apr, 2025 2 commits
- Enable PTPC FP8 for CompressedTensorsW8A8Fp8MoEMethod (triton fused_moe) (#16537) · d085a440
  Michael Goin authored Apr 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d085a440
- [V1][Spec Decode] KV cache slots for eagle heads (#16370) · f49e5aff
  Lily Liu authored Apr 12, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  f49e5aff
12 Apr, 2025 16 commits
- [Bugfix] Validate logit biases to prevent out of vocab ids crashing engine (#16529) · 6c11ecf8
  Ryan McConville authored Apr 12, 2025
```
Signed-off-by: Ryan McConville <ryan@ryanmcconville.com>
```
  6c11ecf8
- [Perf] Optimize Preparing Inputs for GPU Model Runner (#16484) · 93e5f3c5
  SnowCharm authored Apr 12, 2025
```
Signed-off-by: snowcharm <snowcharmqq@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  93e5f3c5
- Fix syntaxWarning: invalid escape sequence '\s' (#16532) · 70363bcc
  Jie Fu (傅杰) authored Apr 12, 2025
```
Signed-off-by: Jie Fu <jiefu@tencent.com>
```
  70363bcc
- [Misc] Delete redundant code (#16530) · 3cdc5766
  Jee Jee Li authored Apr 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3cdc5766
- [MISC] Make GroupCoordinator compatible with out-of-tree devices (#16464) · 68bb122e
  Huazhong Ji authored Apr 12, 2025
```
Signed-off-by: hzji210@gmail.com <hzji210@gmail.com>
```
  68bb122e
- [V1] Enable multi-input by default (#15799) · d9fc8cd9
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9fc8cd9
- [Misc] Openai transcription client example use same Whisper model (#16487) · f069f3ea
  Nicolò Lucchesi authored Apr 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f069f3ea
- [Misc] Update chat utils tests (#16520) · c5bc0e7f
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c5bc0e7f
- fix: spelling (#16466) · 4a3a5187
  Tianer Zhou authored Apr 12, 2025
```
Signed-off-by: Tianer Zhou <ezhoureal@gmail.com>
```
  4a3a5187
- [Frontend] support matryoshka representation / support embedding API dimensions (#16331) · fbf722c6
  wang.yuqi authored Apr 12, 2025
  
  fbf722c6
- [Feature][V1] Add xgrammar to support minLength, maxLength with test (#16516) · e92d7085
  leon-seidel authored Apr 12, 2025
```
Signed-off-by: Leon Seidel <leon.seidel@fau.de>
```
  e92d7085
- Optimized topk for topk=1 (Llama-4) (#16512) · bd6028d6
  Michael Goin authored Apr 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bd6028d6
- [Doc] Update Llama4 Model Names in Supported Models (#16509) · 802329de
  Ye (Charlotte) Qi authored Apr 11, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  802329de
- [BugFix] Handle non-contiguous tensors properly when serializing (#16492) · 41cc883c
  Nick Hill authored Apr 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  41cc883c
- [CI][Bugfix] Add mistral_tool_use to Ci (#16517) · 57504a4b
  Michael Goin authored Apr 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  57504a4b
- [Doc] Fix link to vLLM blog (#16519) · ed4792c9
  Yuan Tang authored Apr 11, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  ed4792c9
11 Apr, 2025 22 commits
- Bugfix for PixtralHF models without spatial_merge_size (#16513) · 87b836ba
  Michael Goin authored Apr 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  87b836ba
- [Bugfix] clean up duplicated code (#16485) · 56c76c2e
  rongfu.leng authored Apr 12, 2025
```
Signed-off-by: Gogs <gogs@fake.local>
Co-authored-by: Gogs <gogs@fake.local>
```
  56c76c2e
- Update openai_compatible_server.md (#16507) · c09632a6
  Christian Sears authored Apr 11, 2025
```
Signed-off-by: Christian Sears <csears@redhat.com>
```
  c09632a6
- [Kernel] Add tuned FusedMoE kernel config for Llama4 Scout, TP=8 on H100 (#16488) · a3bf8d4a
  Yong Hoon Shin authored Apr 11, 2025
  
  a3bf8d4a
- [Frontend] Added chat templates for LLaMa4 pythonic tool calling (#16463) · 16eda8c4
  Ye (Charlotte) Qi authored Apr 11, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Kai Wu <kaiwu@meta.com>
```
  16eda8c4
- Improve configs - `LoadConfig` (#16422) · cd77382a
  Harry Mellor authored Apr 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cd77382a
- [Bugfix] handle alignment of encoder_seq_lens in mllama.py (#14784) · 71b9cde0
  Travis Johnson authored Apr 11, 2025
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  71b9cde0
- [Doc] Document InternVL3 support (#16495) · 5285589f
  Isotr0py authored Apr 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  5285589f
- [Kernel] Support W8A8 channel-wise weights and per-token activations in triton... · f41647ee
  Michael Goin authored Apr 11, 2025
```
[Kernel] Support W8A8 channel-wise weights and per-token activations in triton fused_moe_kernel (#16366)
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f41647ee
- [TPU][V1] Make `--disable_chunked_mm_input` mandatory for serving MM models (#16483) · 4d022cbc
  Nicolò Lucchesi authored Apr 11, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4d022cbc
- Fix erroneous "model doesn't support compile" warning (#16486) · 70de35a8
  Richard Zou authored Apr 11, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  70de35a8
- [Hardware][Intel-Gaudi] Multi-step scheduling implementation for HPU (#12779) · 34b2cf3b
  Tomasz Zielinski authored Apr 11, 2025
```
Signed-off-by: Tomasz Zielinski <tomasz.zielinski@intel.com>
```
  34b2cf3b
- [Bugfix] Fix bugs of running Quark quantized models (#16236) · 9e90c9f7
  chaow-amd authored Apr 11, 2025
```
Signed-off-by: chaow <chaow@amd.com>
```
  9e90c9f7
- [Kernel] support merge_attn_states CUDA kernel, 3x speedup (#16173) · e9528f6d
  DefTruth authored Apr 11, 2025
```
Signed-off-by: DefTruth <qiustudent_r@163.com>
```
  e9528f6d
- Don't install triton on `ppc64le` platform (#16470) · 51baa9c3
  Harry Mellor authored Apr 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51baa9c3
- [Misc] update api_client example (#16459) · 35e076b3
  Reid authored Apr 11, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  35e076b3
- [Misc] Raise error for V1 not supporting Long LoRA. (#16415) · a26f59cc
  Jee Jee Li authored Apr 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a26f59cc
- Enforce valid max_num_batched_tokens when disable_chunked_mm_input=True (#16447) · aa3b3d76
  Michael Goin authored Apr 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  aa3b3d76
- [Core][LoRA][1/N] Add LoRA for EncoderDecoderModelRunner (#15990) · f7030df3
  Jee Jee Li authored Apr 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f7030df3
- Revert "[Model] use AutoWeightsLoader for deepseek_v2, internlm2" (#16453) · 905e91e9
  DefTruth authored Apr 11, 2025
  
  905e91e9
- [Bugfix] Don't set an upper bound on repetition penalty (#16403) · f8f9c0ba
  Alex Brooks authored Apr 11, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  f8f9c0ba
- [CPU][Bugfix] Fix CPU docker issues (#16454) · dda81102
  Li, Jiang authored Apr 11, 2025
```
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  dda81102