Commits · 3efb9f4d95bfe8810b106637cd9eb45693c93e4d · OpenDAS / vllm_cscc

"fern/pages/backends/vllm/prometheus.md" did not exist on "cf433e6825d83f41905da47d69ca5ee30d4eb1ba"

03 Sep, 2025 8 commits
- [Bugfix][DP] DP distribution does not require ray[default] (#23822) · a43a3f17
  Kebe authored Sep 04, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  a43a3f17
- [Attention] Blackwell FP8 MLA support with CUTLASS_MLA backend (#23289) · a7423220
  Matthew Bonanni authored Sep 03, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a7423220
- [Kernels] Overlap shared experts with send/recv (#23273) · e9b92dcd
  bnellnm authored Sep 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e9b92dcd
- [Doc]: fix typos in Python comments (#24115) · 02d411fd
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  02d411fd
- [Doc]: fix typos in Python comments (#24093) · d7e1e599
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d7e1e599
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
- [V1] Wrapper which plumbs request-level logits processors into vLLM... · 136d853e
  afeldman-nm authored Sep 02, 2025
```
[V1] Wrapper which plumbs request-level logits processors into vLLM batch-level logits processing (#23656)
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  136d853e
- Upgrade xgrammar to 0.1.23 (#22988) · e32a0e86
  Russell Bryant authored Sep 02, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  e32a0e86
02 Sep, 2025 4 commits
- [Log] Only Print Profiler Results on Rank 0 (#23370) · 98aee612
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  98aee612
- [Metrics] Deprecate TPOT in favor of ITL (#24110) · 24177984
  Mark McLoughlin authored Sep 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  24177984
- Remove runtime checks based on pooling params (#24051) · d59c9864
  Maximilien de Bayser authored Sep 02, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  d59c9864
- [Doc]: fix typos in Python comments (#24042) · 0235103c
  Didier Durand authored Sep 02, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0235103c
01 Sep, 2025 9 commits
- [bugfix]fix MTP hidden states (#24056) · a344a5aa
  Lucia Fang authored Sep 01, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  a344a5aa
- [Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56853702
- [Misc] Minor code simplification for spec decode (#24053) · 39a22dca
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  39a22dca
- [Doc]: fix typos in Python comments (#24026) · 10728495
  Didier Durand authored Sep 01, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  10728495
- [Misc] add hash_function doc string (#24014) · 5438967f
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5438967f
- [Misc] refactor code by import as for torch._inductor.config (#23677) · 499b074b
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  499b074b
- [Misc] Move fast prefill logic to separate method (#24013) · b5571368
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b5571368
- [Misc] Avoid redundant copy for encoder-only models (#24012) · 8c742a66
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8c742a66
- v1: Support KV events from connectors (#19737) · 14b4326b
  Or Ozeri authored Sep 01, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  14b4326b
31 Aug, 2025 4 commits
- [Minor] Fix some random typos in comments (#24009) · 752d2e1c
  Nick Hill authored Aug 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  752d2e1c
- vllm fix check on max vocab size (#22471) · 81eea3d3
  Xiaodong Wang authored Aug 31, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  81eea3d3
- [Doc]: fix typos in Python comments (#24001) · 9701352e
  Didier Durand authored Aug 31, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  9701352e
- [Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394) · 749be00a
  Roger Wang authored Aug 30, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  749be00a
30 Aug, 2025 4 commits
- [LoRA] Much faster startup when LoRA is enabled (#23777) · 038e9be4
  Andy Lo authored Aug 30, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  038e9be4
- [Refactor] refactor freezing_value/cuda_event initialize outside try finally (#23758) · e80bca30
  Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  e80bca30
- [Misc] add reorder_batch AttentionMetadataBuilder (#23798) · fb4983e1
  Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  fb4983e1
- [Core] Cleanup TPU model runner for MM (#23894) · f1bddbd8
  Cyrus Leung authored Aug 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f1bddbd8
29 Aug, 2025 6 commits
- [BugFix] Async scheduling and PP compatibility with DP (#23770) · d90d8eb6
  Nick Hill authored Aug 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d90d8eb6
- Update PyTorch to 2.8.0 (#20358) · 67c14906
  Huy Do authored Aug 29, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  67c14906
- [Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779) · 69f46359
  Flora Feng authored Aug 29, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  69f46359
- [Performance] V1 Classify Models E2E Performance Optimization (#23541) · d9e00dbd
  wang.yuqi authored Aug 29, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d9e00dbd
- [CPU] Enable data parallel for CPU backend (#23903) · ad39106b
  Li, Jiang authored Aug 29, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  ad39106b
- Fix(async): Add support for truncate_prompt_tokens in AsyncLLM (#23800) · 05d839c1
  Raghavan authored Aug 29, 2025
  
  05d839c1
28 Aug, 2025 5 commits
- [V1] Enable prefill optimization for Gemma3n (#22628) · cb293f6a
  Yong Hoon Shin authored Aug 28, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  cb293f6a
- [BugFix][FlashInfer] Fix potential race condition for paged_kv_indptr_cpu (#23737) · 7ffbf272
  Woosuk Kwon authored Aug 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7ffbf272
- [bugfix] [spec-decoding] fix data race in sample_recovered_tokens_kernel (vLLM v1) (#23829) · 57d4ede5
  Jingkai He authored Aug 29, 2025
```
Signed-off-by: He-Jingkai <he-jingkai@outlook.com>
```
  57d4ede5
- [ROCm][Aiter] Add triton fp8 bmm kernel for mla (#23264) · 04d1dd7f
  Divakar Verma authored Aug 28, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: ShaoChunLee <Shao-Chun.Lee@amd.com>
```
  04d1dd7f
- [CI] Fix linting error on main (#23835) · 1f096f9b
  Thomas Parnell authored Aug 28, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  1f096f9b