Commits · 6f170f11dddcfafa061785d4fb4993f7bcb16107 · OpenDAS / vllm_cscc · GitLab

21 Jun, 2025 1 commit
- [Bugfix] Fix bnb 8bit model weights loading (#19917) · 6f170f11
  Isotr0py authored Jun 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  6f170f11
20 Jun, 2025 18 commits
- Fix: Check the type of params to be a Sequence not list. (#19910) · 8ca81bb0
  Rabin Adhikari authored Jun 21, 2025
```
Signed-off-by: Rabin Adhikari <rabin.adk1@gmail.com>
```
  8ca81bb0
- [Misc] Clean up useless code (#19889) · e773a9e1
  wangxiyuan authored Jun 21, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  e773a9e1
- [Kernel] mark TorchSDPABackend swap_blocks NotImplementedError (#19749) · 71baf85a
  Ning Xie authored Jun 21, 2025
  
  71baf85a
- [CPU][CI] Fallback sliding window to v0 and fix CPU pooling model tests (#19901) · 79f2f1c2
  Li, Jiang authored Jun 20, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  79f2f1c2
- Export NaNs in logits to scheduler_stats if output is corrupted (#18777) · 2e3e3c86
  Vlad Tiberiu Mihailescu authored Jun 20, 2025
```
Signed-off-by: Vlad Mihailescu <vtmihailescu@gmail.com>
```
  2e3e3c86
- [custom_op][vllm-plugin] update custom_op class to use op_registry (#19164) · 7e8977fc
  Chendi.Xue authored Jun 20, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  7e8977fc
- [Model] GPT2ForSequenceClassification model (#19663) · f1e840e8
  Adrian authored Jun 20, 2025
```
Signed-off-by: nie3e <adrcwiek@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  f1e840e8
- [Fix] import regex instead of re (#19875) · 7771d1de
  Thomas Parnell authored Jun 20, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  7771d1de
- [Kernel] correct cpu worker function parameter type (#19745) · 71d12195
  Ning Xie authored Jun 20, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  71d12195
- [Misc] refactor example - openai_transcription_client (#19851) · e384f2f1
  Reid authored Jun 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  e384f2f1
- [Misc] update cuda version (#19526) · 089a306f
  Reid authored Jun 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  089a306f
- [Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583) · 5e666f72
  kourosh hakhamaneshi authored Jun 19, 2025
  
  5e666f72
- [Bugfix] Enable PP with AITER+V1 (#19822) · e3a3e4db
  qli88 authored Jun 19, 2025
```
Signed-off-by: Qiang Li <qiang.li2@amd.com>
```
  e3a3e4db
- [Chore]: qwen3-moe-type-hints-mistake (#19860) · e41bf15c
  Xerxes authored Jun 20, 2025
```
Co-authored-by: xinnan.hou <hxn02029096@alibaba-inc.com>
```
  e41bf15c
- [Benchmark] Fix `Value of type "SampleRequest" is not indexable` (#18032) · 5aa4a015
  Brayden Zhong authored Jun 20, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  5aa4a015
- [CI][Neuron] Fail and exit on first error (#19622) · b6bad3d1
  Elaine Zhao authored Jun 19, 2025
```
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b6bad3d1
- [CI/Build][Bugfix] Fix deadlock on v1 engine test CI (#19872) · ee9a1531
  Isotr0py authored Jun 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ee9a1531
- [Benchmark][Bugfix] Fix Dataset Length Calculation (#19868) · 10d82f9a
  Robert Shaw authored Jun 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  10d82f9a
19 Jun, 2025 20 commits
- [Frontend] early return chat format resolution when specified (#19735) · ea10dd9d
  xzbdmw authored Jun 20, 2025
  
  ea10dd9d
- [Core][Bugfix] Fix Online MM Beam Search (#19688) · ead21102
  Alex Brooks authored Jun 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  ead21102
- [CI][CPU] Improve dummy Triton interfaces and fix the CPU CI (#19838) · 01220ce8
  Li, Jiang authored Jun 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  01220ce8
- [Doc] Update V1 user guide for embedding models (#19842) · 6f68c492
  22quinn authored Jun 19, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  6f68c492
- Fixing Chunked Prefill Test. (#19762) · 47194606
  Alexei-V-Ivanov-AMD authored Jun 19, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  47194606
- [Frontend] Add optional token-level progress bar to `LLM.beam_search` (#19301) · 466166dc
  NekoMimiUnagi authored Jun 19, 2025
```
Signed-off-by: Ruosen Li <rxl190028@utdallas.edu>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Ubuntu <ubuntu@ip-172-31-71-179.ec2.internal>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  466166dc
- Add xLAM tool parser support (#17148) · 1d0ae26c
  Zuxin authored Jun 18, 2025
  
  1d0ae26c
- [Minor] Allow redirecting model path for HfRunner in test (#19795) · 60219995
  Isotr0py authored Jun 19, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  60219995
- raise exception for pin_lora (#19809) · c7b370c6
  Ning Xie authored Jun 19, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c7b370c6
- [Misc] [ROCm] Prevent surplus tensor reshape (#19803) · aa20d10a
  zsolt-borbely-htec authored Jun 19, 2025
```
Signed-off-by: Zsolt Borbely <zsolt.borbely@htecgroup.com>
```
  aa20d10a
- [ROCm] [AITER] [Bugfix] Patch for AITER commit `648764942e552a8bb5fe16026703716a81f05374` (#18990) · 2de12be4
  TJian authored Jun 18, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  2de12be4
- Mark invariant normalizer in Gemma as non-persistent (#19788) · 83ca9ae4
  Yu-Hang "Maxin" Tang authored Jun 18, 2025
```
Signed-off-by: Yu-Hang Tang <Tang.Maxin@gmail.com>
```
  83ca9ae4
- [Bugfix] Add check_health to v1 async client. (#19821) · e2148dc5
  kourosh hakhamaneshi authored Jun 18, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  e2148dc5
- [Bugfix] Fix the linter (#19826) · b1098b40
  Lu Fang authored Jun 19, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  b1098b40
- Support embedding models in V1 (#16188) · 799397ee
  Maximilien de Bayser authored Jun 19, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  799397ee
- [Quantization] Modify the logic of BNB double quantization (#19742) · 49599150
  Jee Jee Li authored Jun 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  49599150
- [Misc][ROCm] Enforce no unused variable in ROCm C++ files (#19796) · 8d1e89d9
  Lu Fang authored Jun 19, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8d1e89d9
- Fix FA2 fallback for Blackwell V1 (#19781) · 36239f79
  Michael Goin authored Jun 19, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  36239f79
- [Frontend] Expose custom args in OpenAI APIs (#16862) · dfada85e
  afeldman-nm authored Jun 18, 2025
```
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  dfada85e
- [BugFix] Fix use_cudagraph=False (#19612) · ed333497
  Richard Zou authored Jun 18, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ed333497
18 Jun, 2025 1 commit
- [Multimodal] Use fast processor for Qwen2/2.5-VL (#19789) · d49adea1
  Woosuk Kwon authored Jun 18, 2025
  
  d49adea1