Commits · f38ee34a0a48b9acd67ea635be80e1d5ba992694 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "e94384bbadbaf99dea24c4af4de6a8c897f830e7"

22 Jul, 2025 3 commits
- [feat] Enable mm caching for transformers backend (#21358) · f38ee34a
  Raushan Turganbay authored Jul 22, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  f38ee34a
- Add arcee model (#21296) · 82b8027b
  Raghav Ravishankar authored Jul 22, 2025
```
Signed-off-by: alyosha-swamy <raghav@arcee.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  82b8027b
- [Doc] Fix CPU doc format (#21316) · 5e70dcd6
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  5e70dcd6
21 Jul, 2025 5 commits
- [CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289) · a15a50fc
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a15a50fc
- [Misc] unify variable for LLM instance (#20996) · d9784107
  Ning Xie authored Jul 21, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d9784107
- [Docs] Make tables more space efficient in `supported_models.md` (#21291) · e6b90a28
  Harry Mellor authored Jul 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6b90a28
- [Docs] Fix hardcoded links in docs (#21287) · be54a951
  Harry Mellor authored Jul 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  be54a951
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
20 Jul, 2025 1 commit

[Model] Support VLMs with transformers backend (#20543) · 9499e26e

Raushan Turganbay authored Jul 20, 2025


Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9499e26e

19 Jul, 2025 7 commits
- [Docs] [V1] Update docs to remove enforce_eager limitation for hybrid models. (#21233) · 2b504eb7
  Thomas Parnell authored Jul 20, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  2b504eb7
- GLM-4 Update (#20736) · 10eb24cc
  Yuxuan Zhang authored Jul 20, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>
```
  10eb24cc
- [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) · 752c6ade
  Woosuk Kwon authored Jul 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  752c6ade
- [Docs] Update the link to the 'Prometheus/Grafana' example (#21225) · 6a971ed6
  Jiayi Yan authored Jul 19, 2025
  
  6a971ed6
- [bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) · e3a0e43d
  Li, Jiang authored Jul 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3a0e43d
- [Model] EXAONE 4.0 model support (#21060) · 3e04107d
  김종곤 authored Jul 19, 2025
```
Signed-off-by: Deepfocused <rlawhdrhs27@gmail.com>
Signed-off-by: woongsik <rlawhdrhs27@gmail.com>
```
  3e04107d
- [Quantization] Enable BNB support for more MoE models (#21100) · 466e878f
  Jee Jee Li authored Jul 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  466e878f
18 Jul, 2025 3 commits
- [Doc] Fix typo in model name (#21178) · 55ad6487
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  55ad6487
- [Docs] Update supported models documentation with missing models (#20844) · b9a21e91
  Lucia Fang authored Jul 18, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  b9a21e91
- [Docs] Add minimal demo of Ray Data API usage (#21080) · c4e3b125
  Ricardo Decal authored Jul 17, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  c4e3b125
17 Jul, 2025 6 commits
- [Misc] Qwen MoE model supports LoRA (#20932) · a3a6c695
  Jee Jee Li authored Jul 18, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a3a6c695
- [Docs] Move code block out of admonition now that it's short (#21118) · 2d6a3820
  Harry Mellor authored Jul 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2d6a3820
- [VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) · 4ef00b5c
  kYLe authored Jul 17, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4ef00b5c
- [Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820) · 5a7fb3ab
  Asher authored Jul 17, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  5a7fb3ab
- [V1][P/D]Enhance Performance and code readability for P2pNcclConnector (#20906) · 8a4e5c5f
  Zhonghua Deng authored Jul 17, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  8a4e5c5f
- [TPU] Start using python 3.12 (#21000) · 58760e12
  XiongfeiWei authored Jul 16, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  58760e12
16 Jul, 2025 4 commits
- Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC... · 01513a33
  Nir David authored Jul 16, 2025
```
Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)
Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>
```
  01513a33
- [Docs] Add intro and fix 1-2-3 list in frameworks/open-webui.md (#19199) · 260127ea
  Michael Yao authored Jul 16, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  260127ea
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
- [Docs] Enhance Anyscale documentation, add quickstart links for vLLM (#21018) · 3ed94f9d
  Ricardo Decal authored Jul 15, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  3ed94f9d
15 Jul, 2025 8 commits
- Add full serve CLI reference back to docs (#20978) · b637e9dc
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b637e9dc
- [Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979) · 313ae8c1
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  313ae8c1
- [Deprecation] Remove `TokenizerPoolConfig` (#20968) · 56fe4bed
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  56fe4bed
- [doc] Add more details for Ray-based DP (#20948) · d9127818
  Rui Qiao authored Jul 15, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  d9127818
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
- [frontend] Add --help=page option for paginated help output (#20961) · 68d28e37
  Reid authored Jul 15, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  68d28e37
- [Doc] Clearer mistral3 and pixtral model support description (#20926) · fc017915
  Isotr0py authored Jul 15, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  fc017915
- [Docs] Add Kuberay to deployment integrations (#20592) · 054c8657
  Ricardo Decal authored Jul 14, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  054c8657
14 Jul, 2025 1 commit
- [Model] Add Ling implementation (#20680) · 38efa282
  ant-yy authored Jul 14, 2025
```
Signed-off-by: vito.yy <vito.yy@antgroup.com>
```
  38efa282
12 Jul, 2025 2 commits
- [docs] convert supported configs to table (#20858) · a86754a1
  Reid authored Jul 12, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  a86754a1
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738