Commits · 505805b645649be6a8e788a1f048b851fa123ef1 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "275c5daeb0048c3b3f359bb5d9478b1e75e02857"

18 Sep, 2025 40 commits
- [KV offload][1/N] Introduce an offloading component (#19848) · 505805b6
  Or Ozeri authored Sep 18, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  505805b6
- [ROCm][AITER][Bugfix] Switch AITER to use PIECEWISE_AND_FULL compilation (#25104) · bbdc0f23
  Rohan Potdar authored Sep 18, 2025
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  bbdc0f23
- [ROCm][CI/Build] Use ROCm7.0 as the base (#25178) · dc340593
  Gregory Shtrasberg authored Sep 18, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  dc340593
- [spec decode] Fix MTP inference path for MiMo-7B model (#25136) · c4cb0af9
  qizixi authored Sep 18, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  c4cb0af9
- [Misc] Add codeowner for Transformers backend (#25180) · 1c3b1634
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c3b1634
- Enable Allgather/ReduceScatter backend for NaiveAllToAll (#23964) · 2ea50e97
  Shu Wang authored Sep 18, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Shu Wang <shuw@nvidia.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  2ea50e97
- [Docs] Fix warnings in mkdocs build (continued) (#25163) · b419937c
  Hyogeun Oh (오효근) authored Sep 19, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  b419937c
- [New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872) · 5f696c33
  wang.yuqi authored Sep 18, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  5f696c33
- feat(api): Return 503 on /health when engine is dead (#24897) · 67244c86
  dongbo910220 authored Sep 18, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  67244c86
- [PERF] Add `conv1d` metadata to GDN attn (#25105) · 072d7e53
  Vadim Gimpelson authored Sep 18, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  072d7e53
- [Kernel] Decouple Tile Size from Block Size in Triton Unified Attention Kernel (#21197) · 01a583fe
  jvlunteren authored Sep 18, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  01a583fe
- [Misc] Add kv-connector label (#25156) · bc19d759
  Nicolò Lucchesi authored Sep 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  bc19d759
- Refactor dense FP8 tensor/channel/block utils and add CT FP8 block (#21404) · fbd6523a
  Michael Goin authored Sep 18, 2025
  
  fbd6523a
- [Structured Output][Refactor] Move `apply_grammar_bitmask()` method from... · 470484a4
  Shanshan Shen authored Sep 18, 2025
```
[Structured Output][Refactor] Move `apply_grammar_bitmask()` method from `ModelRunner` to structured output utils (#21999)
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  470484a4
- [Misc] Clean up flags in `vllm bench serve` (#25138) · 21da7334
  Roger Wang authored Sep 18, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  21da7334
- [Bugfix][Mamba] - Fix Conv State Kernel FP32 Support (#24883) · 66072b36
  Asaf Joseph Gardin authored Sep 18, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  66072b36
- Fix `validate-config` pre-commit check (#25157) · 3ed1ec4a
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3ed1ec4a
- Fix forward reference warning in documentation (#25150) · 5a33ae9a
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5a33ae9a
- [Docs] add the parallel sampling usage in LLMEngine and AsyncLLM (#24222) · c9ff9e6f
  William Song authored Sep 18, 2025
  
  c9ff9e6f
- [Docs] Fix pooling-params doc references in openai_compatible_server.md (#24939) · eaffe448
  Kay Yan authored Sep 18, 2025
  
  eaffe448
- Move `StructuredOutputsConfig` from `config/__init__.py` to `config/structured_outputs.py` (#25153) · 8ed039d5
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8ed039d5
- [Model] Improve Pooling Model (#25149) · 37970105
  Jee Jee Li authored Sep 18, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  37970105
- [Frontend] Support setting logprobs to -1 (#25031) · cc935fdd
  Chauncey authored Sep 18, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  cc935fdd
- silu-v1: Fix EPS not being used during max-reduction (#25069) · abdfcd4f
  Elvir Crnčević authored Sep 18, 2025
```
Signed-off-by: elvircrn <elvircrn@gmail.com>
```
  abdfcd4f
- Fix: Add explicit #include <omp.h> for OpenMP compatibility on certain toolchains (#24951) · 4f02b77d
  ihb2032 authored Sep 18, 2025
```
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
```
  4f02b77d
- [Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89
  Aaron Pham authored Sep 18, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  29283e89
- [Doc] Fix cross-reference warnings (#25058) · 05b044e6
  Punitvara authored Sep 18, 2025
```
Signed-off-by: Punit Vara <punitvara@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  05b044e6
- Add 'path' option to ImagePrompt data_format (#25081) · aa3f105c
  Gerard Finol authored Sep 18, 2025
```
Signed-off-by: Gerard Finol <gerard.finol@urv.cat>
```
  aa3f105c
- [Qwen] Add fp8 checkpoint support for qwen3-next. (#25079) · ef7eefe1
  Tao He authored Sep 18, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  ef7eefe1
- [Bugfix] when use s3 model cannot use default load_format (#24435) · 350c94de
  rongfu.leng authored Sep 18, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  350c94de
- Retrieve `sliding_window` from text config in Gemma3 MM (#25085) · f4cd80f9
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f4cd80f9
- [Docs] Fix API Reference (#25140) · 349e0e34
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  349e0e34
- [Kernel] Better inf handling for grouped topk cu (#24886) · 81b16a2b
  Lumina authored Sep 18, 2025
```
Signed-off-by: lumina37 <starry.qvq@gmail.com>
```
  81b16a2b
- [CLI] Use streaming in CLI chat and completion commands (#23769) · e111d5b0
  Simon Mo authored Sep 17, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  e111d5b0
- [benchmark] add peak throughput metrics and plot (#23867) · a904ea78
  Simon Mo authored Sep 17, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  a904ea78
- [Spec Decode] Efficient padded speculation (#24539) · b7433ca1
  Benjamin Chislett authored Sep 18, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  b7433ca1
- [V0 Deprecation] Remove more V0 tests (#25117) · 5c65a72b
  Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5c65a72b
- [EPLB] Add EPLB support for hunyuan_v1 (#23078) · 9d8a2d86
  YiwenC authored Sep 17, 2025
  
  9d8a2d86
- [XPU] Whisper model support on XPU Platform (#25123) · 3bc18127
  Chaojun Zhang authored Sep 18, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  3bc18127
- Mark prompt logprobs as incompatible with prompt embeds at API level (#25077) · bec060fd
  Andrew Sansom authored Sep 17, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  bec060fd