Commits · d6b3d39b6d87c847cfc9b9a865204ef0a6fcec12 · OpenDAS / vllm_cscc

"tests/models/quantization/test_fp8.py" did not exist on "d3311562fbe740a883e7f03f0b59620587cabb29"

18 Dec, 2025 40 commits
- [Cleanup] Refactor FlashInferMetadataBuilder (#29128) · d6b3d39b
  Benjamin Chislett authored Dec 18, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  d6b3d39b
- [NIXL][BUG FIX] Fix both failing issue and accuracy issue with nixl + host_buffer on CUDA (#30419) · 6ca74bc1
  Chendi.Xue authored Dec 18, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  6ca74bc1
- Check for truthy `rope_parameters` not the existence of it (#30983) · 19c58339
  Harry Mellor authored Dec 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  19c58339
- [BugFix] Fix spec decode + structured outputs + preemption edge case (#30916) · b0b77c46
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b0b77c46
- Strengthen input validation and tests for 'parse_raw_prompts’. (#30652) · 634a14bd
  Kayvan Mivehnejad authored Dec 18, 2025
```
Signed-off-by: Kayvan Mivehnejad <K.Mivehnejad@gmail.com>
```
  634a14bd
- [BugFix] Spec decode with VLLM_ENABLE_V1_MULTIPROCESSING=0 (#30319) · 24b65eff
  Chen Zhang authored Dec 18, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  24b65eff
- Remove all2all backend envvar (#30363) · 41b6f920
  Elizabeth Thomas authored Dec 18, 2025
```
Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  41b6f920
- [Bug] Fix compressed tensor not using deepgemm (#30820) · 97000a2b
  Wentao Ye authored Dec 18, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  97000a2b
- [Bugfix] Remove `tile_size=64` for mm_prefix triton attention (#30973) · d2dc5dfc
  Isotr0py authored Dec 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d2dc5dfc
- tuned fused configs for B300 (#30629) · b8c477c1
  navmarri14 authored Dec 18, 2025
  
  b8c477c1
- [Perf] enable flashinfer rotary_embedding custom ops in DeepSeek rotary (#30729) · 53ad423f
  jiahanc authored Dec 18, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  53ad423f
- [BugFix]Reclaim resources to prevent memory leaks when use LMCacheMPConnector (#30745) · 889f8bb2
  wz1qqx authored Dec 19, 2025
```
Signed-off-by: wz1qqx <ziqi.wang@novita.ai>
Co-authored-by: wz1qqx <ziqi.wang@novita.ai>
```
  889f8bb2
- [XPU] allow custom workers (e.g. vllm-omni workers) to be used on XPU (#30935) · 058926d4
  Fanli Lin authored Dec 19, 2025
```
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
```
  058926d4
- [MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new... · 700a5ad6
  Isotr0py authored Dec 19, 2025
```
[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new `MMEncoderAttention` interface (#30684)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  700a5ad6
- [BugFix] Add sleep to fix tight loop and release GIL (#29476) · 62be3670
  Alec authored Dec 18, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  62be3670
- [Bugfix] fix DP-aware routing in OpenAI API requests (#29002) · 500f26e6
  inkcherry authored Dec 19, 2025
```
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
```
  500f26e6
- [Cleanup] Remove unused ModelRunner V1 `InputBatch.num_tokens` field (#30218) · 686cbaac
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  686cbaac
- fix fp8 online quantization streaming with tp > 1 (#30900) · f4ee2c3d
  Vasiliy Kuznetsov authored Dec 18, 2025
```
Signed-off-by: vasiliy <vasiliy@fb.com>
```
  f4ee2c3d
- [LoRA] Set default MXFP4 LoRA backend to Marlin (#30598) · 9a5e9652
  Xin Yang authored Dec 18, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9a5e9652
- [Doc] Add Sophgo TPU Support (#30949) · 326e7c31
  wzyrrr authored Dec 19, 2025
```
Co-authored-by: zhaoyang.wang <zhaoyang.wang@sophgo.com>
```
  326e7c31
- [Bugfix][torch2.10] Fix test_qwen2_5_vl_compilation with 2.10 RC (#30822) · 0db5439d
  Lucas Kabela authored Dec 18, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0db5439d
- adds jais 2 support (#30188) · 28d15ab5
  sarathc-cerebras authored Dec 18, 2025
```
Signed-off-by: sarathc-cerebras <sarath.chandran@cerebras.net>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  28d15ab5
- [Bug] Fix batch invariant in torch 2.10 (#30907) · 66287582
  Wentao Ye authored Dec 18, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  66287582
- [Misc] support nsys profile for bench latency (#29776) · eee600c3
  zhrrr authored Dec 18, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  eee600c3
- Filter safetensors files to download if .safetensors.index.json exists (#30537) · 100f93d2
  Michael Goin authored Dec 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  100f93d2
- [ROCm] Serving Fails on Radeon Due to AITER Dtype Import (#30952) · 96bf50a2
  vllmellm authored Dec 18, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  96bf50a2
- [Bugfix][CPU] Fix Mac CPU build (#30955) · f90d3636
  Li, Jiang authored Dec 18, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  f90d3636
- [moe] Use enable_chunking func (to support disabling chunking) (#29935) · 8372be28
  Ming Yang authored Dec 18, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  8372be28
- [ROCm][Bugfix] Fix `fa_version` argument error in... · 8da6ae49
  Andreas Karatzas authored Dec 18, 2025
```
[ROCm][Bugfix] Fix `fa_version` argument error in `flash_attn_maxseqlen_wrapper` for ROCm without aiter (#30909)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  8da6ae49
- [BugFix] Partial revert of #29558 (DeepEP HT + PIECEWISE CG support) (#30910) · 30bb19a7
  Lucas Wilkinson authored Dec 18, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  30bb19a7
- [Bugfix] Fix Unicode issues in GLM-4 tool calling (#30920) · aa7e8360
  Chauncey authored Dec 18, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  aa7e8360
- [ROCm][Bugfix] fix(structured_output): Skip guidance backend for schemas with... · be2ad5f9
  Andreas Karatzas authored Dec 18, 2025
```
[ROCm][Bugfix] fix(structured_output): Skip guidance backend for schemas with patternProperties (#30730)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  be2ad5f9
- [Platform] Let EPD work with non-cuda platform (#30225) · a85724bd
  wangxiyuan authored Dec 18, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  a85724bd
- [Fix][FlexAttention] return max logical block index to handle reused blocks (#30915) · 11a89cf9
  Yifan Qiao authored Dec 17, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
```
  11a89cf9
- [CPU] Refactor CPU fused MOE (#30531) · e3ab93c8
  Li, Jiang authored Dec 18, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3ab93c8
- fix: add warmup for audio preprocessing (#30706) · fc2ae6d6
  Nathan Price authored Dec 18, 2025
```
Signed-off-by: Nathan Price <nathan@abridge.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  fc2ae6d6
- [KV connector][LMCache] Only record the cuda event when there are request to store/load (#30814) · ec965569
  Yihua Cheng authored Dec 17, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  ec965569
- [AMD][CI] fix lm eval ci arg (#30911) · 82dc338a
  Divakar Verma authored Dec 17, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  82dc338a
- [PERF] Qwen3-next. Add fp8 cutlass MoE tuned configs. `chmod -x *MI308X.json` (#29553) · 717ac33d
  Vadim Gimpelson authored Dec 18, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  717ac33d
- [Doc][CPU] Update CPU doc (#30765) · cfb7e555
  Li, Jiang authored Dec 18, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  cfb7e555