Commits · 14fdd21d39b634b4c13f7aadbe60e83080b59ebd · OpenDAS / vllm_cscc

18 Jun, 2025 2 commits
- [Core] More fixes to MultiModalEmbeddings type handling (#19715) · 14fdd21d
  Russell Bryant authored Jun 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  14fdd21d
- [v1] Support mamba2 (#19327) · a89209b7
  Chen Zhang authored Jun 19, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  a89209b7
17 Jun, 2025 3 commits
- [Perf] Optimize `moe_align_block_size` CUDA kernel (#19572) · ffb2cd6b
  Wentao Ye authored Jun 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  ffb2cd6b
- [Bugfix] Update multimodel models mapping to fit new checkpoint after Transformers v4.52 (#19151) · ca94d7fa
  Isotr0py authored Jun 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ca94d7fa
- [DOC] fix doc typos (#19600) · 5b3ad5ec
  Di Liu authored Jun 17, 2025
```
Signed-off-by: Di Liu <liu-di@sjtu.edu.cn>
```
  5b3ad5ec
16 Jun, 2025 7 commits
- [Quantization] Remove FP4 emulation; Fall-back to marlin for device < 100 (#19563) · 6bc7b573
  Dipika Sikka authored Jun 16, 2025
  
  6bc7b573
- [V1] Change return type on get_multimodal_embeddings() (#19446) · 90f9c2eb
  Russell Bryant authored Jun 16, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  90f9c2eb
- [Model] Add support for MiniMaxM1ForCausalLM (shares architecture with... · 387bdf0a
  qscqesze authored Jun 17, 2025
```
[Model] Add support for MiniMaxM1ForCausalLM (shares architecture with MiniMaxText01ForCausalLM) (#19677)
Signed-off-by: QscQ <qscqesze@gmail.com>
```
  387bdf0a
- [Kernels] Use empty for modular MoE workspaces (#19667) · 5e5baa91
  bnellnm authored Jun 16, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  5e5baa91
- [Feature]:Allow for Granite MoE Hybrid models with _only_ shared experts. (#19652) · 4d542402
  Shawn Tan authored Jun 16, 2025
```
Signed-off-by: Shawn Tan <shawntan@ibm.com>
```
  4d542402
- [Kernel] GGUF MMVQ kernel for multiple input vectors (#18754) · dec66d25
  Szymon Ożóg authored Jun 16, 2025
```
Signed-off-by: SzymonOzog <szymon.ozog@gmail.com>
```
  dec66d25
- [CI] Add mteb testing for rerank models (#19344) · f40f763f
  wang.yuqi authored Jun 16, 2025
  
  f40f763f
15 Jun, 2025 1 commit
- [Bugfix][2/n] Fix speculative decoding CI - Fix test_ngram_e2e_greedy_correctness (#19644) · ee1531bc
  Lu Fang authored Jun 15, 2025
  
  ee1531bc
14 Jun, 2025 1 commit
- [Bugfix] Fix auto dtype casting for BatchFeature (#19316) · 2db9044a
  Isotr0py authored Jun 14, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2db9044a
13 Jun, 2025 4 commits
- [Model] Fix minimax model cache & lm_head precision (#19592) · a24cb916
  qscqesze authored Jun 13, 2025
```
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  a24cb916
- [torch.compile] reorganize the cache directory to support compiling multiple models (#19064) · d70bc7c0
  youkaichao authored Jun 13, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d70bc7c0
- use base version for version comparison (#19587) · ce688ad4
  Boyuan Feng authored Jun 13, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  ce688ad4
- [BugFix] : Fix Batched DeepGemm Experts (#19515) · e3b12667
  Varun Sundar Rabindranath authored Jun 12, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e3b12667
12 Jun, 2025 7 commits
- [Misc] Turn MOE_DP_CHUNK_SIZE into an env var (#19506) · 9d880f59
  Varun Sundar Rabindranath authored Jun 12, 2025
  
  9d880f59
- Fix TorchAOConfig skip layers (#19265) · 96846bb3
  mobicham authored Jun 12, 2025
```
Signed-off-by: mobicham <hicham@mobiuslabs.com>
```
  96846bb3
- [Quantization] Improve AWQ logic (#19431) · 73e2e011
  Jee Jee Li authored Jun 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  73e2e011
- [AMD][Kernel][BugFix] fix test_rocm_compressed_tensors_w8a8 for rocm (#19509) · 2e090bd5
  rasmith authored Jun 12, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  2e090bd5
- Add Triton Fused MoE kernel config for E=16 on B200 (#19518) · 3f6341bf
  Brayden Zhong authored Jun 12, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  3f6341bf
- [BugFix] Force registration of w8a8_block_fp8_matmul_deepgemm via lazy import (#19514) · e5d35d62
  Varun Sundar Rabindranath authored Jun 12, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e5d35d62
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
11 Jun, 2025 5 commits
- [Kernels] Add activation chunking logic to FusedMoEModularKernel (#19168) · 29fa5cac
  bnellnm authored Jun 11, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  29fa5cac
- Fix some typo (#19475) · 3c8694ea
  Ximingwang-09 authored Jun 11, 2025
```
Signed-off-by: ximing.wxm <ximing.wxm@antgroup.com>
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  3c8694ea
- [Kernel] Support deep_gemm for linear methods (#19085) · b8e809a0
  artetaout authored Jun 11, 2025
```
Signed-off-by: artetaout <lulala341@gmail.com>
```
  b8e809a0
- Add fused MOE config for Qwen3 30B A3B on B200 (#19455) · 2d40665f
  Junhao Li authored Jun 11, 2025
```
Signed-off-by: Junhao Li <junhao@ubicloud.com>
```
  2d40665f
- [New Model]: Support Qwen3 Embedding & Reranker (#19260) · 3952731e
  wang.yuqi authored Jun 11, 2025
  
  3952731e
10 Jun, 2025 3 commits
- Add H20-3e fused MoE kernel tuning configs for Qwen3-235B-A22B-FP8 (#19401) · 22c3c0aa
  Xu Wenqing authored Jun 11, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  22c3c0aa
- [Model] use AutoWeightsLoader for commandr (#19399) · 33f8dba7
  py-andy-c authored Jun 10, 2025
```
Signed-off-by: py-andy-c <pychen1017@gmail.com>
```
  33f8dba7
- [Misc] Slight improvement of the BNB (#19418) · b6553be1
  Jee Jee Li authored Jun 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b6553be1
09 Jun, 2025 1 commit
- [Misc] Fixes and Optimizations for DeepEP + DeepGEMM combination. (#19298) · 5cf2daea
  Varun Sundar Rabindranath authored Jun 09, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  5cf2daea
08 Jun, 2025 2 commits
- [Quantization] Add compressed-tensors NVFP4 support (#18312) · c123bc33
  Dipika Sikka authored Jun 08, 2025
  
  c123bc33
- Add H20-3e fused MoE kernel tuning configs for Qwen3-235B-A22B (#19315) · 989dcee9
  Xu Wenqing authored Jun 08, 2025
```
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
```
  989dcee9
07 Jun, 2025 1 commit

[Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762) · 84166fee

ElizaWszola authored Jun 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

84166fee

06 Jun, 2025 3 commits
- [Model] Optimize nemotron_h implementation (#19249) · 7661e92e
  Jee Jee Li authored Jun 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7661e92e
- [Quantization] Bump compressed-tensors version; update NVFP4A16 test model (#19224) · 94870359
  Dipika Sikka authored Jun 06, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  94870359
- [Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033) · 3465b87e
  Benjamin Chislett authored Jun 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  3465b87e