Commits · 325f679f324c1044cfaa0c594bf0d817eeda4451 · OpenDAS / vllm_cscc

31 Jan, 2025 1 commit
- Add favicon to docs (#12611) · e3f7ff65
  Harry Mellor authored Jan 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e3f7ff65
30 Jan, 2025 1 commit
- Set `?device={device}` when changing tab in installation guides (#12560) · a2769032
  Harry Mellor authored Jan 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a2769032
29 Jan, 2025 3 commits

[Model] Refactoring of MiniCPM-V and add MiniCPM-o-2.6 support for vLLM (#12069) · d93bf4da

Alphi authored Jan 29, 2025


Signed-off-by: hzh <hezhihui_thu@163.com>
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: shaochangxu.scx <shaochangxu.scx@antgroup.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Oleg Mosalov <oleg@krai.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Chenguang Li <757486878@qq.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Shanshan Shen <467638484@qq.com>
Signed-off-by: elijah <f1renze.142857@gmail.com>
Signed-off-by: Yikun <yikunkero@gmail.com>
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Co-authored-by: shaochangxu <85155497+shaochangxu@users.noreply.github.com>
Co-authored-by: shaochangxu.scx <shaochangxu.scx@antgroup.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: sixgod <evethwillbeok@outlook.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Akshat Tripathi <Akshat.tripathi6568@gmail.com>
Co-authored-by: Oleg Mosalov <oleg@krai.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Avshalom Manevich <12231371+avshalomman@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Yangcheng Li <liyangcheng.lyc@alibaba-inc.com>
Co-authored-by: Siyuan Li <94890248+liaoyanqing666@users.noreply.github.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: Chenguang Li <757486878@qq.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Alex Brooks <alex.brooks@ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
Co-authored-by: elijah <30852919+e1ijah1@users.noreply.github.com>
Co-authored-by: Yikun Jiang <yikunkero@gmail.com>
Co-authored-by: Steve Luo <36296769+SunflowerAries@users.noreply.github.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Konrad Zawora <kzawora@habana.ai>
Co-authored-by: TJian <tunjian1996@gmail.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: maang-h <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Elfie Guo <164945471+elfiegg@users.noreply.github.com>
Co-authored-by: Rui Qiao <161574667+ruisearch42@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

d93bf4da

[Doc] Convert docs to use colon fences (#12471) · dd6a3a02
Harry Mellor authored Jan 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
dd6a3a02

[Frontend] Support reasoning content for deepseek r1 (#12473) · a7e3eba6

Ce Gao authored Jan 29, 2025


Signed-off-by: Ce Gao <cegao@tensorchord.ai>
Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

a7e3eba6

28 Jan, 2025 2 commits
- [Doc] Fix typo for x86 CPU installation (#12514) · 925d2f19
  Jun Duan authored Jan 28, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  925d2f19
- [VLM] Merged multi-modal processor and V1 support for Qwen-VL (#12504) · 8f58a513
  Cyrus Leung authored Jan 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8f58a513
27 Jan, 2025 2 commits
- [DOC] Add link to vLLM blog (#12460) · 582cf787
  Yuan Tang authored Jan 26, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  582cf787
- [Frontend] Rerank API (Jina- and Cohere-compatible API) (#12376) · 0034b09c
  Kyle Mistele authored Jan 26, 2025
```
Signed-off-by: Kyle Mistele <kyle@mistele.com>
```
  0034b09c
24 Jan, 2025 2 commits
- [Hardware][Gaudi][Doc] Add missing step in setup instructions (#12382) · 9a0f3bdb
  Mohit Deopujari authored Jan 24, 2025
  
  9a0f3bdb
- [Docs] Update spec decode + structured output in compat matrix (#12373) · c5cffcd0
  Russell Bryant authored Jan 23, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  c5cffcd0
23 Jan, 2025 7 commits
- [Docs] Add meetup slides (#12345) · 682b55bc
  Woosuk Kwon authored Jan 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  682b55bc
- [Docs] Document Phi-4 support (#12362) · 2cbeedad
  Isotr0py authored Jan 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2cbeedad
- [FP8][Kernel] Dynamic kv cache scaling factors computation (#11906) · e97f802b
  Gregory Shtrasberg authored Jan 23, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
```
  e97f802b
- [Doc] Troubleshooting errors during model inspection (#12351) · d07efb31
  Cyrus Leung authored Jan 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d07efb31
- [doc] explain common errors around torch.compile (#12340) · 51162744
  youkaichao authored Jan 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  51162744
- [Docs] Document vulnerability disclosure process (#12326) · 7551a340
  Russell Bryant authored Jan 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7551a340
- [Docs] Update FP8 KV Cache documentation (#12238) · 01a55941
  Michael Goin authored Jan 22, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  01a55941
21 Jan, 2025 3 commits
- [Documentation][AMD] Add information about prebuilt ROCm vLLM docker for perf... · 09ccc9c8
  Hongxia Yang authored Jan 21, 2025
```
[Documentation][AMD] Add information about prebuilt ROCm vLLM docker for perf validation purpose (#12281)
Signed-off-by: Hongxia Yang <hongxyan@amd.com>
```
  09ccc9c8
- [Misc] Rename `MultiModalInputsV2 -> MultiModalInputs` (#12244) · 96912550
  Cyrus Leung authored Jan 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  96912550
- [AMD][Build] Porting dockerfiles from the ROCm/vllm fork (#11777) · d4b62d46
  Gregory Shtrasberg authored Jan 20, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  d4b62d46
20 Jan, 2025 2 commits
- [Model] Add Qwen2 PRM model support (#12202) · 83609791
  Isotr0py authored Jan 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  83609791
- Move linting to `pre-commit` (#11975) · 3ea7b945
  Harry Mellor authored Jan 20, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3ea7b945
19 Jan, 2025 1 commit

[V1] Add V1 support of Qwen2-VL (#12128) · 81763c58

Roger Wang authored Jan 19, 2025


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: imkero <kerorek@outlook.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

81763c58

18 Jan, 2025 2 commits
- [Model] Port deepseek-vl2 processor, remove dependency (#12169) · 02798eca
  Isotr0py authored Jan 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  02798eca
- [AMD][CI/Build][Bugfix] use pytorch stale wheel (#12172) · c09503dd
  Hongxia Yang authored Jan 17, 2025
```
Signed-off-by: hongxyan <hongxyan@amd.com>
```
  c09503dd
17 Jan, 2025 1 commit
- [Doc] Add instructions on using Podman when SELinux is active (#12136) · 1475847a
  Yuan Tang authored Jan 16, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  1475847a
16 Jan, 2025 2 commits
- [Model] Add support for deepseek-vl2-tiny model (#12068) · 62b06ba2
  Isotr0py authored Jan 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  62b06ba2
- [Doc] Add documentation for specifying model architecture (#12105) · f8ef146f
  Cyrus Leung authored Jan 16, 2025
  
  f8ef146f
15 Jan, 2025 2 commits
- [Model]: Support internlm3 (#12037) · 97eb97b5
  RunningLeon authored Jan 15, 2025
  
  97eb97b5
- [Doc] Update examples to remove SparseAutoModelForCausalLM (#12062) · 3f9b7ab9
  Kyle Sayers authored Jan 15, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  3f9b7ab9
14 Jan, 2025 3 commits
- Explain where the engine args go when using Docker (#12041) · c9d6ff53
  Harry Mellor authored Jan 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c9d6ff53
- [Doc] Update Quantization Hardware Support Documentation (#12025) · 8a1f938e
  TJian authored Jan 14, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  8a1f938e
- [Docs] Add Sky Computing Lab to project intro (#12019) · 1a401252
  Woosuk Kwon authored Jan 13, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1a401252
13 Jan, 2025 2 commits
- [Doc] Organise installation documentation into categories and tabs (#11935) · e8c23ff9
  Harry Mellor authored Jan 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e8c23ff9
- [Doc][V1] Update model implementation guide for V1 support (#11998) · cd824990
  Roger Wang authored Jan 13, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  cd824990
12 Jan, 2025 3 commits

[Hardware][CPU] Multi-LoRA implementation for the CPU backend (#11100) · 8bddb735

Akshat Tripathi authored Jan 12, 2025


Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Oleg Mosalov <oleg@krai.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Oleg Mosalov <oleg@krai.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

8bddb735

[Model] Initialize support for Deepseek-VL2 models (#11578) · f967e51f
Isotr0py authored Jan 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
f967e51f
[CI/Build] Add markdown linter (#11857) · 43f3d9e6
Rafael Vasquez authored Jan 12, 2025
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
43f3d9e6

11 Jan, 2025 1 commit
- [Doc] Basic guide for writing unit tests for new models (#11951) · a991f7d5
  Cyrus Leung authored Jan 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a991f7d5