Commits · 37e380613220f607cb465fc15f72a4a033a98b23 · OpenDAS / vllm_cscc

17 Mar, 2025 1 commit
- [Bugfix] Make Gemma3 MM V0 only for now (#14971) · 37e38061
  Roger Wang authored Mar 17, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  37e38061
16 Mar, 2025 1 commit
- [Doc] Add guidance for using `ccache` with `pip install -e .` in doc (#14901) · 90df7f23
  Vadim Gimpelson authored Mar 17, 2025
  
  90df7f23
15 Mar, 2025 4 commits

[Bugfix] EAGLE output norm bug (#14464) · 9ed6ee92
Bryan Lu authored Mar 14, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
9ed6ee92

Jennifer Zhao authored Mar 14, 2025


Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Co-authored-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Jennifer Zhao <JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

aaacf173

[CPU] Support FP8 KV cache (#14741) · a2ae4965
Li, Jiang authored Mar 15, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
a2ae4965
[Docs] Add new East Coast vLLM Meetup slides to README and meetups.md (#14852) · 877e3522
Simon Mo authored Mar 14, 2025

877e3522

14 Mar, 2025 6 commits
- [Doc] More neutral K8s deployment guide (#14084) · 54a88044
  Yuan Tang authored Mar 14, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  54a88044
- [V1][Metrics] Updated list of deprecated metrics in v0.8 (#14695) · 9d2b4a70
  Mark McLoughlin authored Mar 14, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  9d2b4a70
- [Misc] Clean up type annotation for `SupportsMultiModal` (#14794) · 601bd326
  Cyrus Leung authored Mar 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  601bd326
- [Bugfix][IPEX] Add `VLLM_CPU_MOE_PREPACK` to allow disabling MoE prepack when... · 95d680b8
  Thien Tran authored Mar 14, 2025
```
[Bugfix][IPEX] Add `VLLM_CPU_MOE_PREPACK` to allow disabling MoE prepack when CPU does not support it (#14681)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  95d680b8
- [Doc] Fix small typo in Transformers fallback (#14791) · 60c872d4
  Chen Zhang authored Mar 14, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  60c872d4
- [Doc] Fix typo in documentation (#14783) · 3fb17d26
  yasu52 authored Mar 13, 2025
```
Signed-off-by: yasu52 <tsuguro4649@gmail.com>
```
  3fb17d26
13 Mar, 2025 2 commits

[VLM] Support loading InternVideo2.5 models as original InternVLChatModel (#14738) · b1cc4dfe
Isotr0py authored Mar 13, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
b1cc4dfe

[VLM] Support pan-and-scan for Gemma3 multi-modal processor (#14672) · 38240392

Cyrus Leung authored Mar 13, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Roger Wang <ywang@roblox.com>

38240392

12 Mar, 2025 1 commit

[Model] Add support for Gemma 3 (#14660) · c0c25e25

Woosuk Kwon authored Mar 12, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

c0c25e25

11 Mar, 2025 3 commits
- [Hardware][Intel GPU] upgrade IPEX dependency to 2.6.10. (#14564) · c6e14a61
  Kunshang Ji authored Mar 11, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  c6e14a61
- docs: Add documentation for s390x cpu implementation (#14198) · 07964e2f
  Dilip Gowda Bhagavan authored Mar 11, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  07964e2f
- [Bugfix] Update `--hf-overrides` for `Alibaba-NLP/gte-Qwen2` (#14609) · af295e9b
  Cyrus Leung authored Mar 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  af295e9b
10 Mar, 2025 5 commits
- [Docs] Make installation URLs nicer (#14556) · bc2d4473
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bc2d4473
- Correct capitalisation: `VLLM` -> `vLLM` (#14562) · 3b352a2f
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3b352a2f
- [Doc] Update PaliGemma note to a warning (#14565) · 001a9c7b
  Cyrus Leung authored Mar 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  001a9c7b
- [Frontend] support image embeds (#13955) · b0746fae
  Chauncey authored Mar 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  b0746fae
- [Docs] Mention `model_impl` arg when explaining Transformers fallback (#14552) · 60a98b2d
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  60a98b2d
08 Mar, 2025 5 commits
- Move requirements into their own directory (#12547) · 206e2577
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  206e2577
- Add RLHF document (#14482) · cfd0ae82
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cfd0ae82
- Add training doc signposting to TRL (#14439) · be0b399d
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  be0b399d
- [Doc] Added QwQ-32B to the supported models list in the reasoning out… (#14479) · c908a07f
  Robin authored Mar 08, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  c908a07f
- [Doc]add doc for Qwen models tool calling (#14478) · 7b6fd6e4
  Robin authored Mar 08, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  7b6fd6e4
07 Mar, 2025 3 commits
- [v1] torch.compile integration explanation (#14437) · c6359e8c
  youkaichao authored Mar 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c6359e8c
- [Doc] Update prefix_caching.md to match the example image (#14420) · f7ebad23
  York-RDWang authored Mar 07, 2025
  
  f7ebad23
- correct wrong markdown syntax (#14414) · 70da0c07
  Peng Li authored Mar 07, 2025
```
Signed-off-by: vincent-pli <justdoit.pli@gmail.com>
```
  70da0c07
06 Mar, 2025 8 commits
- [Docs] Add nsight guide to profiling docs (#14298) · 04222984
  Michael Goin authored Mar 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  04222984
- [Doc] Correct beam_search using in generative_models.md (#14363) · 4f27044a
  Irina Yuryeva authored Mar 06, 2025
  
  4f27044a
- [Doc] Update reasoning with stream example to use OpenAI library (#14077) · 0ddc991f
  Yanyi Liu authored Mar 06, 2025
```
Signed-off-by: liuyanyi <wolfsonliu@163.com>
```
  0ddc991f
- [Frontend][Docs] Transcription API streaming (#13301) · fa82b938
  Nicolò Lucchesi authored Mar 06, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  fa82b938
- [V1][VLM][Pixtral-HF] Support Pixtral-HF on V1 (#14275) · 5d802522
  lkchen authored Mar 06, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  5d802522
- [Model] Update Paligemma multimodal processing with PromptUpdate (#14015) · 17699280
  kYLe authored Mar 06, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  17699280
- [Bugfix][Structured Output] Support outlines engine with reasoning outputs for DeepSeek R1 (#14114) · f5f7f00c
  Ce Gao authored Mar 06, 2025
  
  f5f7f00c
- [misc] Mention `ray list nodes` command to troubleshoot ray issues (#14318) · abcc61e0
  Rui Qiao authored Mar 05, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  abcc61e0
05 Mar, 2025 1 commit
- [Docs] Add Meta Slides (#14297) · ca2ca8de
  Simon Mo authored Mar 05, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  ca2ca8de