Commits · afcb3f8863ee060f8464901a1cf0dfdf57465a90 · OpenDAS / vllm_cscc

"docs/kubernetes/inference-gateway.md" did not exist on "8e3c0d269dafaa2b86d3cf11de2fad73a21183d2"

02 May, 2025 2 commits
- [Attention] MLA move o_proj q_proj into cuda-graph region (#17484) · afcb3f88
  Lucas Wilkinson authored May 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  afcb3f88
- [Bugfix] Disable gptq_bitblas for <SM80 to fix GPTQ on V100/T4 (#17541) · 24aebae1
  Michael Goin authored May 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  24aebae1
01 May, 2025 11 commits
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE3 (#17504) · 39c0813a
  qizixi authored May 01, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
```
  39c0813a
- Remove duplicate code from dbrx.py (#17550) · 04f2cfc8
  sstamenk authored May 01, 2025
  
  04f2cfc8
- [Model] Refactor Ovis2 to support original tokenizer (#17537) · 88c83041
  Isotr0py authored May 02, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  88c83041
- [Feature][Frontend]: Deprecate --enable-reasoning (#17452) · 98060b00
  Chauncey authored May 01, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  98060b00
- [FEAT] [ROCm]: Add Qwen/Qwen3-235B-A22B-FP8 TP4 triton fused moe config (#17535) · f5a3c655
  TJian authored May 01, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  f5a3c655
- [FEAT] [ROCm]: Add Qwen/Qwen3-30B-A3B-FP8 fused moe config for MI300X (#17530) · 2007d4d5
  TJian authored May 01, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  2007d4d5
- FIxing the AMD test failures caused by PR#16457 (#17511) · 7ab643e4
  Alexei-V-Ivanov-AMD authored May 01, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  7ab643e4
- [CI/Build] Reorganize models tests (#17459) · afb4429b
  Cyrus Leung authored May 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afb4429b
- [Bugfix] Temporarily disable gptq_bitblas on ROCm (#17411) · 1144a8ef
  NaLan ZeYu authored May 01, 2025
```
Signed-off-by: Yan Cangang <nalanzeyu@gmail.com>
```
  1144a8ef
- [Bugfix][ROCm] Fix import error on ROCm (#17495) · 08fb5587
  Gregory Shtrasberg authored Apr 30, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  08fb5587
- [Misc] Rename Audios -> Audio in Qwen2audio Processing (#17507) · 02bd6548
  Alex Brooks authored Apr 30, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  02bd6548
30 Apr, 2025 7 commits
- [Fix] Support passing args to logger (#17425) · da4e7687
  Aaron Pham authored Apr 30, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  da4e7687
- [Misc] Remove deprecated files (#17447) · 1534d389
  Chauncey authored Apr 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  1534d389
- Make the _apply_rotary_emb compatible with dynamo (#17435) · ece5a8b0
  Lu Fang authored Apr 30, 2025
  
  ece5a8b0
- [MODEL ADDITION] Ovis2 Model Addition (#15826) · 54072f31
  Marco authored Apr 30, 2025
```
Signed-off-by: Marco <121761685+mlinmg@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  54072f31
- Support LoRA for Mistral3 (#17428) · a44c4f1d
  Michael Goin authored Apr 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a44c4f1d
- Fix call to `logger.info_once` (#17416) · d1f569b1
  Harry Mellor authored Apr 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d1f569b1
- Improve configs - `ModelConfig` (#17130) · 13698db6
  Harry Mellor authored Apr 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  13698db6
29 Apr, 2025 12 commits
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE (#17211) · 70788bdb
  Bryan Lu authored Apr 29, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  70788bdb
- Simplify (and fix) passing of guided decoding backend options (#17008) · a6977dbd
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a6977dbd
- [Bugfix] Fix Minicpm-O-int4 GPTQ model inference (#17397) · 2fa2a50b
  Isotr0py authored Apr 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2fa2a50b
- fix gemma3 results all zero (#17364) · d3cf61b8
  Qiming Zhang authored Apr 29, 2025
```
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
```
  d3cf61b8
- Fix: Spelling of inference (#17387) · 0ed27ef6
  a2q1p authored Apr 30, 2025
  
  0ed27ef6
- Transformers backend tweaks (#17365) · 900edfa8
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  900edfa8
- [Bugfix] Clean up MiniMax-VL and fix processing (#17354) · 00ee37ef
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  00ee37ef
- [Model] Ignore rotary embed load for Cohere model (#17319) · 97cc8729
  Ekagra Ranjan authored Apr 29, 2025
  
  97cc8729
- [Misc] Move config fields to MultiModalConfig (#17343) · ebb3930d
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebb3930d
- [Model] support MiniMax-VL-01 model (#16328) · cde384cd
  qscqesze authored Apr 29, 2025
```
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  cde384cd
- [model] make llama4 compatible with pure dense layers (#17315) · b4ac4fa0
  Lucia Fang authored Apr 28, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  b4ac4fa0
- [Optim] Compute multimodal hash only once per item (#17314) · 506475de
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  506475de
28 Apr, 2025 8 commits
- [Model] Add tuned triton fused_moe configs for Qwen3Moe (#17328) · 8fc88d63
  Michael Goin authored Apr 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8fc88d63
- Support loading transformers models with named parameters (#16868) · 6e74fd49
  Alex Wu authored Apr 28, 2025
```
Signed-off-by: Alex <alexwu@character.ai>
```
  6e74fd49
- [Model] Qwen3 Dense FP8 Compat Fixes (#17318) · dcbac4cb
  Simon Mo authored Apr 28, 2025
```
Signed-off-by: simon-mo <xmo@berkeley.edu>
```
  dcbac4cb
- [Bugfix] Fix moe weight losing all extra attrs after `process_weights_after_loading`. (#16854) · ed246203
  Charlie Fu authored Apr 28, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  ed246203
- Explicitly explain quant method override ordering and ensure all overrides are ordered (#17256) · c7941cca
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c7941cca
- Make name of `compressed-tensors` quant method consistent across vLLM (#17255) · b6dd32aa
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b6dd32aa
- [Misc] Clean up Qwen2.5-Omni code (#17301) · 8b464d96
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8b464d96
- [Bugfix] Add missing `get_language_model` to new MLLMs (#17300) · 344e193b
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  344e193b