Commits · 4098b72210dc10761bb348b373bbd0fc9b23b0e4 · OpenDAS / vllm_cscc

27 Mar, 2025 5 commits
- Use absolute placement for Ask AI button (#15628) · 46450b8d
  Harry Mellor authored Mar 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  46450b8d
- [Doc] Link to onboarding tasks (#15629) · 07bf813f
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  07bf813f
- [Model] MiniCPM-V/O supports V1 (#15487) · ac5bc615
  Cyrus Leung authored Mar 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ac5bc615
- [Doc] update --system for transformers installation in docker doc (#15616) · 8063dfc6
  Reid authored Mar 27, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  8063dfc6
- [Doc] Update V1 user guide for fp8 kv cache support (#15585) · 7f301dd8
  Wei Zeng authored Mar 26, 2025
```
Signed-off-by: weizeng <weizeng@roblox.com>
```
  7f301dd8
26 Mar, 2025 4 commits

Support SHA256 as hash function in prefix caching (#15297) · 27df5199
marko authored Mar 26, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
27df5199
[Model] Add Reasoning Parser for Granite Models (#14202) · 1711b929
Alex Brooks authored Mar 26, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
```
1711b929

Separate base model from `TransformersModel` (#15467) · cf5c8f16

Harry Mellor authored Mar 26, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

cf5c8f16

[Model] Support multi-image for Molmo (#15438) · 997c8811
Cyrus Leung authored Mar 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
997c8811

25 Mar, 2025 2 commits

[Doc] Update V1 user guide for multi-modality (#15460) · 3f04a7fb
Cyrus Leung authored Mar 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
3f04a7fb

Add pipeline parallel support to `TransformersModel` (#12832) · 97cfa65d

Harry Mellor authored Mar 25, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

97cfa65d

24 Mar, 2025 4 commits
- [Doc] Update docs on handling OOM (#15357) · 6dd55af6
  Cyrus Leung authored Mar 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  6dd55af6
- [DOC] Add Kubernetes deployment guide with CPUs (#14865) · 3eb08ed9
  Yuan Tang authored Mar 24, 2025
  
  3eb08ed9
- [Core] Integrate `fastsafetensors` loader for loading model weights (#10647) · 761702fd
  Manish Sethi authored Mar 24, 2025
```
Signed-off-by: Manish Sethi <Manish.sethi1@ibm.com>
```
  761702fd
- [Misc] Upgrade BNB version (#15183) · 3892e58a
  Jee Jee Li authored Mar 24, 2025
  
  3892e58a
23 Mar, 2025 3 commits
- [Misc][Doc] Add note regarding loading `generation_config` by default (#15281) · 9c5c81b0
  Roger Wang authored Mar 23, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9c5c81b0
- [Frontend] Support tool calling and reasoning parser (#14511) · d6cd59f1
  Robin authored Mar 24, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  d6cd59f1
- [V1][Usage] Refactor speculative decoding configuration and tests (#14434) · 50c9636d
  shangmingc authored Mar 23, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  50c9636d
22 Mar, 2025 2 commits

Remove openvino support in favor of external plugin (#15339) · b877031d
Russell Bryant authored Mar 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
b877031d

[Model] Support Tele-FLM Model (#15023) · 2f4bd358

Naitong Yu authored Mar 22, 2025


Signed-off-by: Naitong Yu <ntyu@baai.ac.cn>
Signed-off-by: jiangxin <horizon94@outlook.com>
Co-authored-by: Jason Fang <jasonfang3900@gmail.com>
Co-authored-by: jiangxin <horizon94@outlook.com>

2f4bd358

21 Mar, 2025 6 commits
- Revert "[Feature] specify model in config.yaml (#14855)" (#15293) · baec0d4d
  Cyrus Leung authored Mar 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  baec0d4d
- [Misc] Add cProfile helpers (#15074) · 61e8c183
  Russell Bryant authored Mar 21, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  61e8c183
- [Feature] specify model in config.yaml (#14855) · 0fa3970d
  Wei Zeng authored Mar 21, 2025
```
Signed-off-by: weizeng <weizeng@roblox.com>
```
  0fa3970d
- [Doc] Update LWS docs (#15163) · 7297941b
  Edwin Hernandez authored Mar 20, 2025
```
Signed-off-by: Edwinhr716 <Edandres249@gmail.com>
```
  7297941b
- Mention `extra_body` as a way top pass vLLM only parameters using the OpenAI client (#15240) · 6edbfa92
  Harry Mellor authored Mar 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6edbfa92
- [Misc] Clean up the BitsAndBytes arguments (#15140) · 10f55fe6
  Jee Jee Li authored Mar 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  10f55fe6
20 Mar, 2025 1 commit
- [Doc] Clarify run vllm only on one node in distributed inference (#15148) · 4cb1c05c
  Rui Qiao authored Mar 19, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  4cb1c05c
19 Mar, 2025 2 commits
- [Doc] Update tip info on using latest transformers when creating a custom Dockerfile (#15070) · 073d1ed3
  Marc-Alexandre Côté authored Mar 19, 2025
  
  073d1ed3
- [Bugfix] Re-enable Gemma3 for V1 (#14980) · 61f41218
  Cyrus Leung authored Mar 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61f41218
18 Mar, 2025 4 commits

[Doc] Minor v1_user_guide update (#15064) · 228b768d
Jennifer Zhao authored Mar 18, 2025
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
228b768d

[MODEL] Add support for Zamba2 models (#13185) · 452e8fd9

yury-tokpanov authored Mar 18, 2025


Signed-off-by: Yury Tokpanov <yury@zyphra.com>
Signed-off-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

452e8fd9

[Mistral-Small 3.1] Update docs and tests (#14977) · f863ffc9
Patrick von Platen authored Mar 18, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
f863ffc9
[Doc][V1] Fix V1 APC doc (#14920) · d1695758
Shanshan Shen authored Mar 18, 2025

d1695758

17 Mar, 2025 1 commit
- [Bugfix] Make Gemma3 MM V0 only for now (#14971) · 37e38061
  Roger Wang authored Mar 17, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  37e38061
16 Mar, 2025 1 commit
- [Doc] Add guidance for using `ccache` with `pip install -e .` in doc (#14901) · 90df7f23
  Vadim Gimpelson authored Mar 17, 2025
  
  90df7f23
15 Mar, 2025 4 commits

[Bugfix] EAGLE output norm bug (#14464) · 9ed6ee92
Bryan Lu authored Mar 14, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
9ed6ee92

[Doc] V1 user guide (#13991) · aaacf173

Jennifer Zhao authored Mar 14, 2025


Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Co-authored-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Jennifer Zhao <JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

aaacf173

[CPU] Support FP8 KV cache (#14741) · a2ae4965
Li, Jiang authored Mar 15, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
a2ae4965
[Docs] Add new East Coast vLLM Meetup slides to README and meetups.md (#14852) · 877e3522
Simon Mo authored Mar 14, 2025

877e3522

14 Mar, 2025 1 commit
- [Doc] More neutral K8s deployment guide (#14084) · 54a88044
  Yuan Tang authored Mar 14, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  54a88044