Commits · 1d5922fadeebc5ec133dc1c88eb1e85605a5510c · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "4646fe248221bafcc906ecf26c1d5334f9c8387f"

09 Feb, 2026 6 commits
- [ASR] Fix audio benchmark and add RTFx metric (#32300) · 1d5922fa
  Ekagra Ranjan authored Feb 09, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  1d5922fa
- [Model] GLM adaptation (#34124) · 978a37c8
  Jee Jee Li authored Feb 09, 2026
  
  978a37c8
- [BugFix] Fix `fastsafetensors` TP all procs using all GPUs (#34070) · d9bede03
  Nick Hill authored Feb 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  d9bede03
- [Frontend][last/5] Make pooling entrypoints request schema consensus. (#31127) · 22b64948
  wang.yuqi authored Feb 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  22b64948
- [Tiny] Rename encoder budget file to more specific name (#34103) · 7c233dbb
  Reagan Lee authored Feb 08, 2026
```
Signed-off-by: Reagan Lee <“reaganjlee@gmail.com”>
Co-authored-by: Reagan Lee <“reaganjlee@gmail.com”>
```
  7c233dbb
- [bug-fix] supported_tasks is breaking backward compatibility at init_app_state (#34027) · a75a5b54
  kourosh hakhamaneshi authored Feb 08, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
Signed-off-by: kourosh hakhamaneshi <31483498+kouroshHakha@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  a75a5b54
08 Feb, 2026 9 commits
- [Release 2.10] Update to Torch 2.10 - final release (#30525) · f97ca671
  Andrey Talman authored Feb 08, 2026
  
  f97ca671
- Add support for ModelOpt MXFP8 dense models (#33786) · 084aa19f
  danisereb authored Feb 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  084aa19f
- glm 4.6 fused tuned inference config for B200 (#32958) · 1ecfabe5
  navmarri14 authored Feb 08, 2026
  
  1ecfabe5
- [torch.compile] Add an option to force-enable the MOE cold start optimization (#33735) · 4df841fe
  Richard Zou authored Feb 08, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  4df841fe
- [BugFix] Change support no act and mul for marlin (#34088) · a263aa61
  TomerBN-Nvidia authored Feb 08, 2026
```
Signed-off-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
Co-authored-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
```
  a263aa61
- [Revert] Fix performance regression for GLM-4.7-GPTQ decode and MTP acceptance rate (#33771) · 179ae7da
  aabbccddwasd authored Feb 09, 2026
```
Signed-off-by: aabbccddwasd <aabbccddwasd@qq.com>
```
  179ae7da
- Add embedding input functionality for disabled modalities [remake] (#32493) · c4df59ad
  Reagan Lee authored Feb 08, 2026
```
Signed-off-by: Reagan Lee <“reaganjlee@gmail.com”>
Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan Lee <96998476+reaganjlee@users.noreply.github.com>
Co-authored-by: Reagan Lee <“reaganjlee@gmail.com”>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c4df59ad
- [Perf] Simplify DeepseekV32 tokenizer, ensure fast detokenization used (#33855) · a96197f5
  Nick Hill authored Feb 07, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a96197f5
- [ROCm][Bugfix] fix act_quant_fusion module import error (#34069) · ab10d798
  Andreas Karatzas authored Feb 07, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  ab10d798
07 Feb, 2026 22 commits
- [Doc] Fix run_batch docs (#34056) · b956cdf8
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b956cdf8
- Perf tuning and expansion of cases covered for wvSplitKrc (#33493) · ed17f54c
  Hashem Hashemi authored Feb 07, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  ed17f54c
- Make directory exist ok for ray spinning up multiple replicas on a single instance (#33604) · 860981d8
  Jiang Wu authored Feb 07, 2026
```
Signed-off-by: Jiang Wu <jwu@cclgroup.com>
```
  860981d8
- move checks out of `unified_kv_cache_update` custom op (#33943) · de3869bb
  Rohan Potdar authored Feb 07, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  de3869bb
- [PluggableLayer][3/N] Apply PluggableLayer to mamba layers. (#33660) · ce9b3cd3
  whx authored Feb 07, 2026
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  ce9b3cd3
- [Model] Enable Step3p5ForCausalLM testing (#33755) · db4ede97
  Jee Jee Li authored Feb 07, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db4ede97
- [Frontend]Add support for transcriptions and translations to run_batch (#33934) · 2cb2340f
  Pooya Davoodi authored Feb 07, 2026
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  2cb2340f
- Enable Eagle3 speculative decoding for Mistral3ForConditionalGeneration to support eagle3 (#33939) · 4df44c16
  TundeAtSN authored Feb 07, 2026
```
Signed-off-by: Akintunde Oladipo <akintunde.oladipo@servicenow.com>
Signed-off-by: TundeAtSN <akintunde.oladipo@servicenow.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  4df44c16
- [torch.compile] Stop compiling identical artifacts (#34003) · 81fe69ca
  Richard Zou authored Feb 07, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  81fe69ca
- [Kernel] Add KernelConfig flag to enable/disable FlashInfer autotune (#34006) · dd6a6e11
  Mohammad Miadh Angkad authored Feb 07, 2026
```
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  dd6a6e11
- [Renderer] Define `render_cmpl` and `render_chat` (#34039) · edb359cc
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  edb359cc
- [Misc] Simplify `get_max_tokens` (#34036) · 11a4c9d3
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  11a4c9d3
- Fix spelling errors (#33978) · 15a0b9e5
  lukec authored Feb 07, 2026
  
  15a0b9e5
- [Misc] Make `PlaceholderRange.get_num_embeds` a method (#34035) · 48312e57
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  48312e57
- [Revert] Add util `handle_deprecated` back (#33998) · 18e85452
  Wentao Ye authored Feb 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  18e85452
- [ModelRunner V2] Revert token rank comparison difference for now (#34017) · 40218a82
  Nick Hill authored Feb 06, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  40218a82
- [Misc] Add backward-compatible import aliases for renamed translations module (#34015) · 1c3b2205
  kourosh hakhamaneshi authored Feb 06, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  1c3b2205
- [Bugfix] Fix _fused_moe_lora_expand signature mismatch (#33821) · 3920cafd
  Xin Yang authored Feb 06, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  3920cafd
- [CI][AMD]Bugfix] Check that model_config is not None in enable_norm_pad_fusion (#34007) · ec28784f
  rasmith authored Feb 06, 2026
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  ec28784f
- [Bugfix] Fix Whisper tokenization (#34011) · 55aeec04
  Nicolò Lucchesi authored Feb 07, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  55aeec04
- [Bugfix] Fix QK Norm+RoPE fusion pattern matching on B200+FP8 (#33967) · 90607718
  Ikenna authored Feb 06, 2026
```
Signed-off-by: Ikenna <ikennachifo@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  90607718
- [Feat][RL] Pause and Resume with keep requests for single engine (#32351) · 89a385d7
  Aaron Hao authored Feb 06, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  89a385d7
06 Feb, 2026 3 commits
- [bugfix] [ROCm] Fix premature CUDA initialization in platform detection (#33941) · 4a2d00ea
  kourosh hakhamaneshi authored Feb 06, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  4a2d00ea
- Fix RoutingMethodType logic (#33919) · 207c3a0c
  Dimitrios Bariamis authored Feb 06, 2026
```
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  207c3a0c
- [Fix] Fix `logprobs=0` handling for `/inference/v1/generate` endpoint (#34010) · ae2e93f8
  Sumanth R Hegde authored Feb 06, 2026
```
Signed-off-by: SumanthRH <sumanthrh99@gmail.com>
```
  ae2e93f8