Commits · 1e4ecca1d01b9941e621614a062dd4e6a4557c46 · OpenDAS / vllm_cscc

07 Oct, 2025 6 commits

[Model] Add support for ModernBertForTokenClassification (#26340) · 6f59beaf

antrec authored Oct 07, 2025

Signed-off-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Signed-off-by: antrec <antoine.recanati@gmail.com>
Co-authored-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

6f59beaf

[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) · 41f1cf38
fxmarty-amd authored Oct 07, 2025

41f1cf38

[Docs] add docs for cuda graph v1 (#24374) · 63773a62

fhl2000 authored Oct 07, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

63773a62

Add TRL example notebook to RLHF docs (#26346) · 883b4289
Sergio Paniego Blanco authored Oct 07, 2025
```
Signed-off-by: sergiopaniego <sergiopaniegoblanco@gmail.com>
```
883b4289
[V0 Deprecation] Remove `VLLM_USE_V1` from docs and scripts (#26336) · 7e4cd070
Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
7e4cd070
[Docs][DBO] Add initial doc that describes the DBO implementation (#26024) · c50901f3
Sage Moore authored Oct 06, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
c50901f3

06 Oct, 2025 5 commits
- [Docs] Fix broken table in moe_kernel_features doc (#26314) · 93540958
  Varun Sundar Rabindranath authored Oct 06, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  93540958
- [Benchmark] Enable MM Embedding benchmarks (#26310) · 44b9af5b
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44b9af5b
- [Doc] add KAITO to integrations (#25521) · 77c95f72
  abhisheksheth28 authored Oct 06, 2025
```
Signed-off-by: "Abhishek Sheth" <absheth@microsoft.com>
```
  77c95f72
- [Docs] Edit HF Inference Endpoints documentation (#26275) · 59f30d04
  Aritra Roy Gosthipaty authored Oct 06, 2025
```
Signed-off-by: Aritra Roy Gosthipaty <aritra.born2fly@gmail.com>
Signed-off-by: ariG23498 <aritra.born2fly@gmail.com>
```
  59f30d04
- [Doc] Edited minor typo (#26266) · 59b47764
  orangeng authored Oct 05, 2025
```
Signed-off-by: Orange Ng <ngquanhao@outlook.com>
```
  59b47764
05 Oct, 2025 3 commits
- [DOC] Update production-stack.md (#26177) · f509a208
  Elieser Pereira authored Oct 05, 2025
```
Signed-off-by: Elieser Pereira <elieser.pereiraa@gmail.com>
```
  f509a208
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- Add documentation for granite 4 tool calling (#26175) · e0986ea0
  Maximilien de Bayser authored Oct 05, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e0986ea0
04 Oct, 2025 3 commits

[Model] CLIP Embedding Support (#26010) · 4570535e
Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
4570535e

Support expert parallel in Transformers backend (#26162) · d3d649ef

Harry Mellor authored Oct 04, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

d3d649ef

[GPTOSS][DP/EP][Marlin] Enable GPTOSS DP/EP using Marlin kernels (#25488) · 7ef40bb9

Varun Sundar Rabindranath authored Oct 03, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

7ef40bb9

03 Oct, 2025 4 commits
- [Multi Modal] Configurable MM Profiling (#25631) · 79aa2446
  Wenlong Wang authored Oct 03, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  79aa2446
- [Model] Use `merge_by_field_config` for MM models (InternVL family) (#26153) · f9a8084e
  Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f9a8084e
- `FusedMoE` support for the Transformers backend (#22650) · 10d76548
  Harry Mellor authored Oct 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  10d76548
- [Build/CI] Revert back to Ubuntu 20.04, install python 3.12 with uv (#26103) · 27edd2ae
  Tyler Michael Smith authored Oct 03, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  27edd2ae
02 Oct, 2025 4 commits
- [Small] Prevent bypassing media domain restriction via HTTP redirects (#26035) · ad87ba92
  Chenheli Hua authored Oct 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  ad87ba92
- [CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529
  Cyrus Leung authored Oct 03, 2025
```
[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d00d6529
- Update base image to 22.04 (jammy) (#26065) · d4e7a115
  Huy Do authored Oct 02, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  d4e7a115
- Run:ai model streamer add GCS package support (#24909) · be22bb6f
  pwschuurman authored Oct 01, 2025
```
Signed-off-by: Peter Schuurman <psch@google.com>
```
  be22bb6f
01 Oct, 2025 2 commits

[Doc] updating torch.compile doc link (#25989) · 57b46d76

nadathurv authored Oct 01, 2025

Signed-off-by: nadathurv <work.vnadathur@gmail.com>
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Co-authored-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>

57b46d76

Fix INT8 quantization error on Blackwell GPUs (SM100+) (#25935) · 99028fda
Param authored Sep 30, 2025
```
Signed-off-by: padg9912 <phone.and.desktop@gmail.com>
```
99028fda

30 Sep, 2025 7 commits

[Docs] Remove API Reference from search index (#25949) · 2ce26b9b
Harry Mellor authored Sep 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2ce26b9b

[Docs] Add moe kernel features doc (#25297) · fb610ae6

bnellnm authored Sep 30, 2025


Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: bnellnm <49004751+bnellnm@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

fb610ae6

[Doc] Improve MM Pooling model documentation (#25966) · 2f652e6c
Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
2f652e6c

Add Hugging Face Inference Endpoints guide to Deployment docs (#25886) · 099aaee5

Sergio Paniego Blanco authored Sep 30, 2025

Signed-off-by: sergiopaniego <sergiopaniegoblanco@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

099aaee5

Updated TRL integration docs (#25684) · 1ad3aca6

Sergio Paniego Blanco authored Sep 30, 2025

Signed-off-by: sergiopaniego <sergiopaniegoblanco@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Sergio Paniego Blanco <sergiopaniegoblanco@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

1ad3aca6

[Doc] Add Cambricon MLU support (#25942) · 8d0afa9b
a120092009 authored Sep 30, 2025
```
Signed-off-by: a120092009 <zhaoty0121@gmail.com>
```
8d0afa9b
Test Prompt Embeds/LoRA compatibility and Enable LoRA Support for OPT Models (#25717) · 78a47f87
Andrew Sansom authored Sep 29, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
78a47f87

29 Sep, 2025 4 commits
- [NIXL] Increase default KV block eviction timeout on P (#25897) · 2e4fe48c
  Nicolò Lucchesi authored Sep 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2e4fe48c
- [Doc] Add documentation for vLLM continuous benchmarking and profiling (#25819) · 9bedac96
  Naman Lalit authored Sep 29, 2025
```
Signed-off-by: Naman Lalit <nl2688@nyu.edu>
```
  9bedac96
- [Model] Remove MotifForCausalLM (#25866) · e61eb5e0
  Jee Jee Li authored Sep 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e61eb5e0
- [Bugfix] Fix requirements paths in install instructions (#25827) · edbaadd9
  Yingjun Mou authored Sep 29, 2025
```
Signed-off-by: yingjun-mou <renzomou@gmail.com>
```
  edbaadd9
28 Sep, 2025 1 commit
- Update GLM-4.5 Doc transformers version (#25830) · b1ded114
  Yuxuan Zhang authored Sep 28, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  b1ded114
27 Sep, 2025 1 commit

[Core] GC Debug callback (#24829) · c216119d

Jialin Ouyang authored Sep 27, 2025


Signed-off-by: Jialin Ouyang <jialino@meta.com>
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Jialin Ouyang <jialino@meta.com>

c216119d