Commits · 3b352a2f92bca6fd5261d74fe70121cd393e3a38 · OpenDAS / vllm_cscc

10 Mar, 2025 4 commits
- Correct capitalisation: `VLLM` -> `vLLM` (#14562) · 3b352a2f
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3b352a2f
- [Doc] Update PaliGemma note to a warning (#14565) · 001a9c7b
  Cyrus Leung authored Mar 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  001a9c7b
- [Frontend] support image embeds (#13955) · b0746fae
  Chauncey authored Mar 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  b0746fae
- [Docs] Mention `model_impl` arg when explaining Transformers fallback (#14552) · 60a98b2d
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  60a98b2d
08 Mar, 2025 5 commits
- Move requirements into their own directory (#12547) · 206e2577
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  206e2577
- Add RLHF document (#14482) · cfd0ae82
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cfd0ae82
- Add training doc signposting to TRL (#14439) · be0b399d
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  be0b399d
- [Doc] Added QwQ-32B to the supported models list in the reasoning out… (#14479) · c908a07f
  Robin authored Mar 08, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  c908a07f
- [Doc]add doc for Qwen models tool calling (#14478) · 7b6fd6e4
  Robin authored Mar 08, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  7b6fd6e4
07 Mar, 2025 3 commits
- [v1] torch.compile integration explanation (#14437) · c6359e8c
  youkaichao authored Mar 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c6359e8c
- [Doc] Update prefix_caching.md to match the example image (#14420) · f7ebad23
  York-RDWang authored Mar 07, 2025
  
  f7ebad23
- correct wrong markdown syntax (#14414) · 70da0c07
  Peng Li authored Mar 07, 2025
```
Signed-off-by: vincent-pli <justdoit.pli@gmail.com>
```
  70da0c07
06 Mar, 2025 8 commits
- [Docs] Add nsight guide to profiling docs (#14298) · 04222984
  Michael Goin authored Mar 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  04222984
- [Doc] Correct beam_search using in generative_models.md (#14363) · 4f27044a
  Irina Yuryeva authored Mar 06, 2025
  
  4f27044a
- [Doc] Update reasoning with stream example to use OpenAI library (#14077) · 0ddc991f
  Yanyi Liu authored Mar 06, 2025
```
Signed-off-by: liuyanyi <wolfsonliu@163.com>
```
  0ddc991f
- [Frontend][Docs] Transcription API streaming (#13301) · fa82b938
  Nicolò Lucchesi authored Mar 06, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  fa82b938
- [V1][VLM][Pixtral-HF] Support Pixtral-HF on V1 (#14275) · 5d802522
  lkchen authored Mar 06, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  5d802522
- [Model] Update Paligemma multimodal processing with PromptUpdate (#14015) · 17699280
  kYLe authored Mar 06, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  17699280
- [Bugfix][Structured Output] Support outlines engine with reasoning outputs for DeepSeek R1 (#14114) · f5f7f00c
  Ce Gao authored Mar 06, 2025
  
  f5f7f00c
- [misc] Mention `ray list nodes` command to troubleshoot ray issues (#14318) · abcc61e0
  Rui Qiao authored Mar 05, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  abcc61e0
05 Mar, 2025 5 commits
- [Docs] Add Meta Slides (#14297) · ca2ca8de
  Simon Mo authored Mar 05, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  ca2ca8de
- prefix_caching.md: Fixed typo (#14293) · 8f808cf8
  DaividFrank authored Mar 05, 2025
```
Signed-off-by: Daivid Savernin-Frenk <daivid.frank@TurboNext.ai>
```
  8f808cf8
- [Doc] [3/N] Refer code examples for common cases in dev multimodal processor (#14278) · 7f89a594
  Cyrus Leung authored Mar 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7f89a594
- [Doc] Update nginx guide: remove privileged from vllm container run and add target GPU ID (#14217) · 961644e6
  Iacopo Poli authored Mar 05, 2025
```
Signed-off-by: Iacopo Poli <iacopo@lighton.ai>
```
  961644e6
- [Model] New model support for Phi-4-multimodal-instruct (#14119) · 0a995d54
  Congcong Chen authored Mar 04, 2025
  
  0a995d54
04 Mar, 2025 4 commits

[v1][Metrics] Add design doc (#12745) · c2bd2196

Mark McLoughlin authored Mar 04, 2025


Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

c2bd2196

[Docs] Update Dockerfile dependency image (#14215) · 550c7ba3
Michael Goin authored Mar 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
550c7ba3
[doc] add "Failed to infer device type" to faq (#14200) · 3610fb49
youkaichao authored Mar 04, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
3610fb49

[Model] Add support for GraniteMoeShared models (#13313) · c060b714

Travis Johnson authored Mar 03, 2025


Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

c060b714

03 Mar, 2025 3 commits
- [Docs] Add GPTQModel (#14056) · cd1d3c3d
  Qubitium-ModelCloud authored Mar 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  cd1d3c3d
- Improve the docs for `TransformersModel` (#14147) · 98175b28
  Harry Mellor authored Mar 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  98175b28
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
02 Mar, 2025 3 commits
- [v0][structured output] Support reasoning output (#12955) · bf33700e
  Ce Gao authored Mar 03, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  bf33700e
- [Doc] Source building add clone step (#14086) · bc6ccb98
  qux-bbb authored Mar 02, 2025
```
Signed-off-by: qux-bbb <1147635419@qq.com>
```
  bc6ccb98
- [Model] Add LoRA support for TransformersModel (#13770) · cc5e8f6d
  Jee Jee Li authored Mar 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  cc5e8f6d
01 Mar, 2025 2 commits
- [Documentation] Add more deployment guide for Kubernetes deployment (#13841) · 8994dabc
  Kuntai Du authored Feb 28, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  8994dabc
- [Docs] Add `pipeline_parallel_size` to optimization docs (#14059) · f64ffa8c
  Brayden Zhong authored Mar 01, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  f64ffa8c
28 Feb, 2025 3 commits
- [Doc] Fix ROCm documentation (#14041) · 2aed2c9f
  Brayden Zhong authored Feb 28, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2aed2c9f
- Update AutoAWQ docs (#14042) · f58f8b5c
  Harry Mellor authored Feb 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f58f8b5c
- [Doc] Move multimodal Embedding API example to Online Serving page (#14017) · 1088f062
  Cyrus Leung authored Feb 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1088f062