Commits · 67244c86f0f1ffc06fcab9cad5e78989695cc15f · OpenDAS / vllm_cscc

"container/Dockerfile.trtllm" did not exist on "538b463025d2f971baa0e5b0328c1bab70599510"

18 Sep, 2025 31 commits
- feat(api): Return 503 on /health when engine is dead (#24897) · 67244c86
  dongbo910220 authored Sep 18, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  67244c86
- [PERF] Add `conv1d` metadata to GDN attn (#25105) · 072d7e53
  Vadim Gimpelson authored Sep 18, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  072d7e53
- [Kernel] Decouple Tile Size from Block Size in Triton Unified Attention Kernel (#21197) · 01a583fe
  jvlunteren authored Sep 18, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  01a583fe
- Refactor dense FP8 tensor/channel/block utils and add CT FP8 block (#21404) · fbd6523a
  Michael Goin authored Sep 18, 2025
  
  fbd6523a
- [Structured Output][Refactor] Move `apply_grammar_bitmask()` method from... · 470484a4
  Shanshan Shen authored Sep 18, 2025
```
[Structured Output][Refactor] Move `apply_grammar_bitmask()` method from `ModelRunner` to structured output utils (#21999)
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  470484a4
- [Misc] Clean up flags in `vllm bench serve` (#25138) · 21da7334
  Roger Wang authored Sep 18, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  21da7334
- [Bugfix][Mamba] - Fix Conv State Kernel FP32 Support (#24883) · 66072b36
  Asaf Joseph Gardin authored Sep 18, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  66072b36
- Fix `validate-config` pre-commit check (#25157) · 3ed1ec4a
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3ed1ec4a
- Fix forward reference warning in documentation (#25150) · 5a33ae9a
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5a33ae9a
- [Docs] add the parallel sampling usage in LLMEngine and AsyncLLM (#24222) · c9ff9e6f
  William Song authored Sep 18, 2025
  
  c9ff9e6f
- [Docs] Fix pooling-params doc references in openai_compatible_server.md (#24939) · eaffe448
  Kay Yan authored Sep 18, 2025
  
  eaffe448
- Move `StructuredOutputsConfig` from `config/__init__.py` to `config/structured_outputs.py` (#25153) · 8ed039d5
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8ed039d5
- [Model] Improve Pooling Model (#25149) · 37970105
  Jee Jee Li authored Sep 18, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  37970105
- [Frontend] Support setting logprobs to -1 (#25031) · cc935fdd
  Chauncey authored Sep 18, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  cc935fdd
- [Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89
  Aaron Pham authored Sep 18, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  29283e89
- [Doc] Fix cross-reference warnings (#25058) · 05b044e6
  Punitvara authored Sep 18, 2025
```
Signed-off-by: Punit Vara <punitvara@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  05b044e6
- [Qwen] Add fp8 checkpoint support for qwen3-next. (#25079) · ef7eefe1
  Tao He authored Sep 18, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  ef7eefe1
- [Bugfix] when use s3 model cannot use default load_format (#24435) · 350c94de
  rongfu.leng authored Sep 18, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  350c94de
- Retrieve `sliding_window` from text config in Gemma3 MM (#25085) · f4cd80f9
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f4cd80f9
- [CLI] Use streaming in CLI chat and completion commands (#23769) · e111d5b0
  Simon Mo authored Sep 17, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  e111d5b0
- [benchmark] add peak throughput metrics and plot (#23867) · a904ea78
  Simon Mo authored Sep 17, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  a904ea78
- [Spec Decode] Efficient padded speculation (#24539) · b7433ca1
  Benjamin Chislett authored Sep 18, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  b7433ca1
- [EPLB] Add EPLB support for hunyuan_v1 (#23078) · 9d8a2d86
  YiwenC authored Sep 17, 2025
  
  9d8a2d86
- [XPU] Whisper model support on XPU Platform (#25123) · 3bc18127
  Chaojun Zhang authored Sep 18, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  3bc18127
- Mark prompt logprobs as incompatible with prompt embeds at API level (#25077) · bec060fd
  Andrew Sansom authored Sep 17, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  bec060fd
- [Model] enable data parallel for InternVL vision encoder (#23909) · 52bc9d5b
  YiwenC authored Sep 17, 2025
```
Signed-off-by: Yiwen Chen <yiwen66@berkeley.edu>
Signed-off-by: YiwenC <54658925+666even666@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  52bc9d5b
- [Kernels] Overlap shared experts with combine instead of dispatch (#24254) · dc2979c5
  bnellnm authored Sep 18, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  dc2979c5
- [Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in... · 027d37df
  toncao authored Sep 18, 2025
```
[Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in qwen2moe to successfully load ignored params in quantized models (#24960)
Signed-off-by: toncao <cpatonn@gmail.com>
Co-authored-by: toncao <cpatonn@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  027d37df
- [Core][MM] Cleanup `MultiModalCache` (#25006) · b9821967
  Lukas Geiger authored Sep 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  b9821967
- [MM Encoder] Apply DP ViT for Qwen3-VL model series (#24955) · 3127274d
  Roger Wang authored Sep 17, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3127274d
- [Kernels] Enable DeepGEMM by default (#24462) · 4ac510f4
  bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  4ac510f4
17 Sep, 2025 9 commits
- [Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537) · 5963b98b
  bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  5963b98b
- [Bugfix] Refactor Flashinfer TRTLLM attention kernel selection logic (#24600) · e67a79db
  elvischenv authored Sep 18, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  e67a79db
- Aiter mha fp8 fix (#24991) · 1a456c7c
  Douglas Lehr authored Sep 17, 2025
```
Signed-off-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
```
  1a456c7c
- [gpt-oss][2] fix types for streaming (#24556) · bff2e5f1
  Andrew Xia authored Sep 17, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  bff2e5f1
- [BUG] Exclude .pth files when pulling remote files (#25092) · f20c3b09
  ahao-anyscale authored Sep 17, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  f20c3b09
- [Bugfix] Update import path for bc_linter_include (#24766) · 88313154
  Mohammad Miadh Angkad authored Sep 18, 2025
```
Signed-off-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>
```
  88313154
- [V1] Logits processor docs (#22919) · 7ae98875
  afeldman-nm authored Sep 17, 2025
```
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Joseph Marinier <Joseph.Marinier@gmail.com>
```
  7ae98875
- Change log level from info to debug for IOProcessor (#24999) · 8b32464a
  Michael Goin authored Sep 17, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  8b32464a
- [V0 Deprecation] Remove unused output processor util (#25023) · 99cc41ad
  Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  99cc41ad