Commits · 6f1229f91ddbc8c12b77929b4eae4006d3a46ca5 · OpenDAS / vllm_cscc

"tests/entrypoints/llm/__init__.py" did not exist on "0b98ba15c744f1dfb0ea4f2135e85ca23d572ae1"

03 Jul, 2025 5 commits
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
- [Bugfix][CI/CD][CPU] Fix CPU CI tests (#20383) · 0ec3779d
  Li, Jiang authored Jul 03, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0ec3779d
- [Bugfix] Fix import of CutlassExpertsFp8 in compressed_tensors_moe.py (#20381) · 2e25bb12
  bnellnm authored Jul 02, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  2e25bb12
02 Jul, 2025 9 commits
- [Kernels] MoE refactor (#19636) · c1909e7e
  bnellnm authored Jul 02, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
```
  c1909e7e
- [Model] Adds support for SlimMoE models Phi-tiny-MoE-instruct (#20286) · 706ff132
  zichongli5 authored Jul 02, 2025
```
Signed-off-by: Zichong Li <t-lizichong@microsoft.com@Reasoning-H100-VM3.drbuo4tcjzruhloch3eo0b25ef.cx.internal.cloudapp.net>
Co-authored-by: Zichong Li <t-lizichong@microsoft.com@Reasoning-H100-VM3.drbuo4tcjzruhloch3eo0b25ef.cx.internal.cloudapp.net>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  706ff132
- [Model] Add Ernie4.5 and Ernie4.5MoE Model Support (#20220) · e303dcf5
  CSWYF3634076 authored Jul 02, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  e303dcf5
- [Bugfix] Keye-VL compatibility with `tok_kwargs` (#20058) (#20353) · ba51aea6
  Cyrus Leung authored Jul 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba51aea6
- [Model][VLM] Support Keye-VL-8B-Preview (#20126) · 8452946c
  Kwai-Keye authored Jul 02, 2025
```
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
```
  8452946c
- [Bugfix] Fix dynamic rotary embedding (#20343) · 1a03dd49
  Cyrus Leung authored Jul 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1a03dd49
- [Refactor] Remove Unused Env `VLLM_ENABLE_MOE_ALIGN_BLOCK_SIZE_TRITON` (#20334) · 9dae7d46
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  9dae7d46
- [Refactor] Remove duplicate `find_free_port` (#20333) · 7058d7dd
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7058d7dd
- Enable group size 64 for Machete (#20290) · 3abfe221
  czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  3abfe221
01 Jul, 2025 7 commits

[V1] [ROCm] Enable EP with AITER Fused MoE (#20270) · 02cabff2
TJian authored Jul 01, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
02cabff2

[Model]Add Tencent HunYuanMoEV1 Model Support (#20114) · ecad851c

aiyiwang2025 authored Jul 01, 2025


Signed-off-by: aiyiwang <aiyiwang@tencent.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: quinnrong <quinnrong@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

ecad851c

Add GLM4.1V model (Draft) (#19331) · ed70f3c6

Yuxuan Zhang authored Jul 01, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

ed70f3c6

[Quant] [Bugfix] Fix quantization config matching with `hf_to_vllm_mapper` (#20046) · 9025a9a7
Kyle Sayers authored Jul 01, 2025

9025a9a7
[CPU] Update custom ops for the CPU backend (#20255) · 6cc1e7d9
Li, Jiang authored Jul 01, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
6cc1e7d9
Enable ZP Support for Machete (#20268) · 9909726d
czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
9909726d

[Feature] A calibration-free RTN-based quantization for accurate and... · 27949354

Alex Kogan authored Jul 01, 2025


[Feature] A calibration-free RTN-based quantization for accurate and accelerated INT4/INT8 inference (#18768)
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

27949354

30 Jun, 2025 7 commits
- [Refactor] Remove useless pdb comment (#20266) · 97d9524f
  Wentao Ye authored Jun 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  97d9524f
- [Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058) · d8cf819a
  Kyle Sayers authored Jun 30, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d8cf819a
- [Bugfix] fix quark ptpc (#20251) · 1c50e100
  li haoyang authored Jun 30, 2025
```
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: Haoyang Li <307790822@qq.com>
```
  1c50e100
- [Quantization] Improve BitsAndBytesModelLoader (#20242) · 8fe7fc86
  Jee Jee Li authored Jun 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8fe7fc86
- [Bugfix] Skip loading extra parameters for modelopt Qwen3 MoE model (#19598) · f5dfa075
  noiji authored Jun 30, 2025
```
Signed-off-by: noiji <>
```
  f5dfa075
- [BUGFIX][DEEPSEEK][MODEL_LOAD] fix w13, w2 weight not initialized assert (#20202) · 5a52f389
  Chendi.Xue authored Jun 29, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  5a52f389
- [Model] support dots1 (#18254) · 65b1cbb1
  redmoe-moutain authored Jun 30, 2025
```
Signed-off-by: redmoe-moutain <agiredmoe@gmail.com>
```
  65b1cbb1
29 Jun, 2025 1 commit
- [Quantization] Add compressed-tensors NVFP4 MoE Support (#19990) · 6f2f53a8
  Dipika Sikka authored Jun 30, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  6f2f53a8
28 Jun, 2025 3 commits
- [Refactor] Create a function util and cache the results for `has_deepgemm`,... · 4d366936
  Wentao Ye authored Jun 28, 2025
```
[Refactor] Create a function util and cache the results for `has_deepgemm`, `has_deepep`, `has_pplx` (#20187)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4d366936
- [Bugfix] Correct behavior of GraniteMoeHybrid for TensorParallel execution (#20137) · daec9dea
  Stan Wozniak authored Jun 28, 2025
```
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
  daec9dea
- [Frontend] Generalize `v1/audio/transcriptions` endpoint (#20179) · daceac57
  Nicolò Lucchesi authored Jun 28, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  daceac57
27 Jun, 2025 4 commits
- [Bugfix] Mark 'hidden_states' as mutable in moe_forward registration. (#20152) · c6c98305
  bnellnm authored Jun 27, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  c6c98305
- [Fix][torch.compile] Enable custom ops by default when Inductor off (#20102) · aafabaa0
  Luka Govedič authored Jun 27, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  aafabaa0
- Gemma3n (Text-only) (#20134) · d1c956dc
  Robert Shaw authored Jun 27, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  d1c956dc
- [Model][1/N] Automatic conversion of CrossEncoding model (#20012) · cd4cfee6
  wang.yuqi authored Jun 27, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  cd4cfee6
26 Jun, 2025 3 commits
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
- [Bug Fix] Fix address/port already in use error for deep_ep test (#20094) · c894c5dc
  Wentao Ye authored Jun 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c894c5dc
- [CPU] Fix torch version in x86 CPU backend (#19258) · 0567c824
  Li, Jiang authored Jun 26, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0567c824
25 Jun, 2025 1 commit
- [Fix] Support cls pooling in ModernBertPooler (#20067) · 23a04e08
  lsz05 authored Jun 26, 2025
```
Signed-off-by: shengzhe.li <shengzhe.li@sbintuitions.co.jp>
```
  23a04e08