Commits · 2b93162fb0bc91c8e1e397cb2a385e8febce11e2 · OpenDAS / vllm_cscc · GitLab

01 Apr, 2025 6 commits
- [Model] Support Mistral3 in the HF Transformers format (#15505) · 51d7c6a2
  Michael Goin authored Apr 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  51d7c6a2
- [V1] TPU - Fix fused MOE (#15834) · 7e4e709b
  Alexander Matveev authored Apr 01, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  7e4e709b
- [Bugfix]: Fix is_embedding_layer condition in VocabParallelEmbedding (#15824) · 63d8eabe
  Alexey Kiryushin authored Apr 01, 2025
```
Signed-off-by: alexwl <alexey.a.kiryushin@gmail.com>
```
  63d8eabe
- [Bugfix] Fix extra comma (#15851) · e830b013
  Percy authored Apr 01, 2025
```
Signed-off-by: haochengxia <xhc_1007@163.com>
```
  e830b013
- [Bugfix][Model] fix mllama multi-image (#14883) · ff647398
  Yan Ma authored Apr 01, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  ff647398
- Rename fallback model and refactor supported models section (#15829) · a76f547e
  Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a76f547e
31 Mar, 2025 6 commits
- Fix Transformers backend compatibility check (#15290) · d4bfc23e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d4bfc23e
- [Bugfix] Check dimensions of multimodal embeddings in V1 (#15816) · 09e974d4
  Cyrus Leung authored Apr 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09e974d4
- [Bugfix] Fix missing return value in load_weights method of adapters.py (#15542) · 037bcd94
  Mrm authored Mar 31, 2025
```
Signed-off-by: noc-turne <2270929247@qq.com>
```
  037bcd94
- [Bugfix] Fix Crashing When Loading Modules With Batchnorm Stats (#15813) · c2e7507a
  Alex Brooks authored Mar 31, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  c2e7507a
- [Model] Update support for NemotronNAS models (#15008) · 3aa2b6a6
  Naveassaf authored Mar 31, 2025
```
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
```
  3aa2b6a6
- [V1] Fully Transparent Implementation of CPU Offloading (#15354) · 555aa219
  youkaichao authored Mar 31, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  555aa219
30 Mar, 2025 4 commits
- fix: Comments to English for better dev experience (#15768) · 70fedd0f
  yihong authored Mar 31, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  70fedd0f
- [Bugfix] Added `embed_is_patch` mask for fuyu model (#15731) · bb103b29
  kYLe authored Mar 30, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
```
  bb103b29
- [V1] Override `mm_counts` for dummy data creation (#15703) · 803d5c35
  Cyrus Leung authored Mar 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  803d5c35
- fix test_phi3v (#15321) · 7fd8c0f8
  pansicheng authored Mar 30, 2025
```
Signed-off-by: pansicheng <sicheng.pan.chn@gmail.com>
```
  7fd8c0f8
29 Mar, 2025 4 commits
- [Bugfix] Fix Mllama interleaved images input support (#15564) · 3c0ff914
  Isotr0py authored Mar 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  3c0ff914
- [FEAT] [ROCm] Add AITER int8 scaled gemm kernel (#15433) · 4965ec42
  TJian authored Mar 29, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  4965ec42
- [TPU][V1][Bugfix] Fix w8a8 recompiilation with GSM8K (#15714) · da461f3c
  Nicolò Lucchesi authored Mar 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  da461f3c
- [Model] Support Skywork-R1V (#15397) · de1cb387
  pengyuange authored Mar 29, 2025
```
Signed-off-by: jiacai.liu <932997367@qq.com>
Co-authored-by: jiacai.liu <932997367@qq.com>
```
  de1cb387
28 Mar, 2025 8 commits
- [V1] Support disable_any_whtespace for guidance backend (#15584) · 7329ff54
  Russell Bryant authored Mar 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7329ff54
- [Bugfix] `embed_is_patch` for Idefics3 (#15696) · 541d1df4
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  541d1df4
- [Model] Adding torch compile annotations to chatglm (#15624) · 91276c57
  Jee Jee Li authored Mar 28, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  91276c57
- [Refactor][Frontend] Keep all logic about reasoning into one class (#14428) · 32b14baf
  Ce Gao authored Mar 28, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  32b14baf
- [Bugfix] Fix `mm_hashes` forgetting to be passed (#15668) · 8693e47e
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8693e47e
- [Quantization][FP8] Adding support for fp8 gemm layer input in fp8 (#14578) · 4d0ec372
  Gregory Shtrasberg authored Mar 27, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  4d0ec372
- Revert "Use Cache Hinting for fused_moe kernel (#15511)" (#15645) · 4ae17bf1
  Wes authored Mar 27, 2025
```
Signed-off-by: Wes Medford <wryanmedford@gmail.com>
```
  4ae17bf1
- [Quantization][V1] BitsAndBytes support V1 (#15611) · 726efc6a
  Jee Jee Li authored Mar 28, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  726efc6a
27 Mar, 2025 8 commits
- [Misc] Replace `is_encoder_decoder_inputs` with `split_enc_dec_inputs` (#15620) · 24718153
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  24718153
- [Model] MiniCPM-V/O supports V1 (#15487) · ac5bc615
  Cyrus Leung authored Mar 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ac5bc615
- [Misc] Clean up `scatter_patch_features` (#15559) · e6c9053f
  Cyrus Leung authored Mar 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e6c9053f
- [Quantization] Fp8 Channelwise Dynamic Per Token GroupedGEMM (#15587) · 43ed4143
  Robert Shaw authored Mar 27, 2025
```
Signed-off-by: ElizaWszola <eliza@neuralmagic.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <wilkinson.lucas@gmail.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
```
  43ed4143
- [TPU] Avoid Triton Import (#15589) · e1e0fd75
  Robert Shaw authored Mar 27, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  e1e0fd75
- Allow torchao quantization in SiglipMLP (#15575) · dcf2a590
  Jerry Zhang authored Mar 26, 2025
  
  dcf2a590
- [moe][quant] add weight name case for offset (#15515) · fb22be58
  Mengqing Cao authored Mar 27, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  fb22be58
- [Kernel] CUTLASS grouped gemm fp8 MoE kernel (#13972) · 9239bf71
  ElizaWszola authored Mar 27, 2025
```
Signed-off-by: ElizaWszola <eliza@neuralmagic.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Lucas Wilkinson <wilkinson.lucas@gmail.com>
```
  9239bf71
26 Mar, 2025 4 commits
- Use Cache Hinting for fused_moe kernel (#15511) · 7a888271
  Wes authored Mar 26, 2025
  
  7a888271
- Fix weight loading for some models in Transformers backend (#15544) · 0af4d764
  Harry Mellor authored Mar 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0af4d764
- [Model] Add Reasoning Parser for Granite Models (#14202) · 1711b929
  Alex Brooks authored Mar 26, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
```
  1711b929
- Improve validation of TP in Transformers backend (#15540) · c091c0a5
  Harry Mellor authored Mar 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c091c0a5