Commits · b7b7676d67ee517c0f97cfd245531db477606010 · OpenDAS / vllm_cscc

31 Mar, 2025 5 commits
- Move dockerfiles into their own directory (#14549) · e6e3c55e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6e3c55e
- [V1][Spec Decode] Remove deprecated spec decode config params (#15466) · 239b7bef
  shangmingc authored Apr 01, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  239b7bef
- Upgrade `transformers` to `v4.50.3` (#13905) · e5ef4fa9
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e5ef4fa9
- [Model] Update support for NemotronNAS models (#15008) · 3aa2b6a6
  Naveassaf authored Mar 31, 2025
```
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
```
  3aa2b6a6
- Recommend developing with Python 3.12 in developer guide (#15811) · b932c048
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b932c048
30 Mar, 2025 1 commit

[doc] update conda to usage link in installation (#15761) · 44c3a5ab

Reid authored Mar 30, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

44c3a5ab

29 Mar, 2025 4 commits
- [Docs] Document v0 engine support in reasoning outputs (#15739) · 762b424a
  Ce Gao authored Mar 29, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  762b424a
- [Model] Support Skywork-R1V (#15397) · de1cb387
  pengyuange authored Mar 29, 2025
```
Signed-off-by: jiacai.liu <932997367@qq.com>
Co-authored-by: jiacai.liu <932997367@qq.com>
```
  de1cb387
- [ROCm][AMD][Build] Update AMD supported arch list (#15632) · c802f543
  Gregory Shtrasberg authored Mar 28, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  c802f543
- [Docs][V1] Optimize diagrams in prefix caching design (#15716) · cff8991a
  simpx authored Mar 29, 2025
  
  cff8991a
28 Mar, 2025 5 commits
- [doc] add missing imports (#15699) · 2914006f
  Reid authored Mar 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2914006f
- [Docs] Add "Generation quality changed" section to troubleshooting (#15701) · 0b416752
  Harry Mellor authored Mar 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0b416752
- [CPU][CI] Improve CPU Dockerfile (#15690) · 280d0741
  Li, Jiang authored Mar 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  280d0741
- [Doc] Fix dead links in Job Board (#15637) · b4245a48
  wwl2755 authored Mar 27, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  b4245a48
- [Bugfix] Fix failure to launch in Tensor Parallel TP mode on macOS. (#14948) · 4e0f6076
  Kebe authored Mar 28, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  4e0f6076
27 Mar, 2025 6 commits
- Correct PowerPC to modern IBM Power (#15635) · 32d66927
  cnorman authored Mar 27, 2025
```
Signed-off-by: Christy Norman <christy@linux.vnet.ibm.com>
```
  32d66927
- Use absolute placement for Ask AI button (#15628) · 46450b8d
  Harry Mellor authored Mar 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  46450b8d
- [Doc] Link to onboarding tasks (#15629) · 07bf813f
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  07bf813f
- [Model] MiniCPM-V/O supports V1 (#15487) · ac5bc615
  Cyrus Leung authored Mar 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ac5bc615
- [Doc] update --system for transformers installation in docker doc (#15616) · 8063dfc6
  Reid authored Mar 27, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  8063dfc6
- [Doc] Update V1 user guide for fp8 kv cache support (#15585) · 7f301dd8
  Wei Zeng authored Mar 26, 2025
```
Signed-off-by: weizeng <weizeng@roblox.com>
```
  7f301dd8
26 Mar, 2025 4 commits

Support SHA256 as hash function in prefix caching (#15297) · 27df5199
marko authored Mar 26, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
27df5199
[Model] Add Reasoning Parser for Granite Models (#14202) · 1711b929
Alex Brooks authored Mar 26, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
```
1711b929

Separate base model from `TransformersModel` (#15467) · cf5c8f16

Harry Mellor authored Mar 26, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

cf5c8f16

[Model] Support multi-image for Molmo (#15438) · 997c8811
Cyrus Leung authored Mar 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
997c8811

25 Mar, 2025 2 commits

[Doc] Update V1 user guide for multi-modality (#15460) · 3f04a7fb
Cyrus Leung authored Mar 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
3f04a7fb

Add pipeline parallel support to `TransformersModel` (#12832) · 97cfa65d

Harry Mellor authored Mar 25, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

97cfa65d

24 Mar, 2025 4 commits
- [Doc] Update docs on handling OOM (#15357) · 6dd55af6
  Cyrus Leung authored Mar 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  6dd55af6
- [DOC] Add Kubernetes deployment guide with CPUs (#14865) · 3eb08ed9
  Yuan Tang authored Mar 24, 2025
  
  3eb08ed9
- [Core] Integrate `fastsafetensors` loader for loading model weights (#10647) · 761702fd
  Manish Sethi authored Mar 24, 2025
```
Signed-off-by: Manish Sethi <Manish.sethi1@ibm.com>
```
  761702fd
- [Misc] Upgrade BNB version (#15183) · 3892e58a
  Jee Jee Li authored Mar 24, 2025
  
  3892e58a
23 Mar, 2025 3 commits
- [Misc][Doc] Add note regarding loading `generation_config` by default (#15281) · 9c5c81b0
  Roger Wang authored Mar 23, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9c5c81b0
- [Frontend] Support tool calling and reasoning parser (#14511) · d6cd59f1
  Robin authored Mar 24, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  d6cd59f1
- [V1][Usage] Refactor speculative decoding configuration and tests (#14434) · 50c9636d
  shangmingc authored Mar 23, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  50c9636d
22 Mar, 2025 2 commits

Remove openvino support in favor of external plugin (#15339) · b877031d
Russell Bryant authored Mar 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
b877031d

[Model] Support Tele-FLM Model (#15023) · 2f4bd358

Naitong Yu authored Mar 22, 2025


Signed-off-by: Naitong Yu <ntyu@baai.ac.cn>
Signed-off-by: jiangxin <horizon94@outlook.com>
Co-authored-by: Jason Fang <jasonfang3900@gmail.com>
Co-authored-by: jiangxin <horizon94@outlook.com>

2f4bd358

21 Mar, 2025 4 commits
- Revert "[Feature] specify model in config.yaml (#14855)" (#15293) · baec0d4d
  Cyrus Leung authored Mar 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  baec0d4d
- [Misc] Add cProfile helpers (#15074) · 61e8c183
  Russell Bryant authored Mar 21, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  61e8c183
- [Feature] specify model in config.yaml (#14855) · 0fa3970d
  Wei Zeng authored Mar 21, 2025
```
Signed-off-by: weizeng <weizeng@roblox.com>
```
  0fa3970d
- [Doc] Update LWS docs (#15163) · 7297941b
  Edwin Hernandez authored Mar 20, 2025
```
Signed-off-by: Edwinhr716 <Edandres249@gmail.com>
```
  7297941b