Commits · a7e3eba66fff82f7e12bb2354c4b26635f0f7761 · OpenDAS / vllm_cscc

29 Jan, 2025 1 commit

[Frontend] Support reasoning content for deepseek r1 (#12473) · a7e3eba6

Ce Gao authored Jan 29, 2025


Signed-off-by: Ce Gao <cegao@tensorchord.ai>
Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

a7e3eba6

28 Jan, 2025 2 commits
- [Doc] Fix typo for x86 CPU installation (#12514) · 925d2f19
  Jun Duan authored Jan 28, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  925d2f19
- [VLM] Merged multi-modal processor and V1 support for Qwen-VL (#12504) · 8f58a513
  Cyrus Leung authored Jan 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8f58a513
27 Jan, 2025 2 commits
- [DOC] Add link to vLLM blog (#12460) · 582cf787
  Yuan Tang authored Jan 26, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  582cf787
- [Frontend] Rerank API (Jina- and Cohere-compatible API) (#12376) · 0034b09c
  Kyle Mistele authored Jan 26, 2025
```
Signed-off-by: Kyle Mistele <kyle@mistele.com>
```
  0034b09c
24 Jan, 2025 2 commits
- [Hardware][Gaudi][Doc] Add missing step in setup instructions (#12382) · 9a0f3bdb
  Mohit Deopujari authored Jan 24, 2025
  
  9a0f3bdb
- [Docs] Update spec decode + structured output in compat matrix (#12373) · c5cffcd0
  Russell Bryant authored Jan 23, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  c5cffcd0
23 Jan, 2025 7 commits
- [Docs] Add meetup slides (#12345) · 682b55bc
  Woosuk Kwon authored Jan 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  682b55bc
- [Docs] Document Phi-4 support (#12362) · 2cbeedad
  Isotr0py authored Jan 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2cbeedad
- [FP8][Kernel] Dynamic kv cache scaling factors computation (#11906) · e97f802b
  Gregory Shtrasberg authored Jan 23, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
```
  e97f802b
- [Doc] Troubleshooting errors during model inspection (#12351) · d07efb31
  Cyrus Leung authored Jan 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d07efb31
- [doc] explain common errors around torch.compile (#12340) · 51162744
  youkaichao authored Jan 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  51162744
- [Docs] Document vulnerability disclosure process (#12326) · 7551a340
  Russell Bryant authored Jan 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7551a340
- [Docs] Update FP8 KV Cache documentation (#12238) · 01a55941
  Michael Goin authored Jan 22, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  01a55941
21 Jan, 2025 3 commits
- [Documentation][AMD] Add information about prebuilt ROCm vLLM docker for perf... · 09ccc9c8
  Hongxia Yang authored Jan 21, 2025
```
[Documentation][AMD] Add information about prebuilt ROCm vLLM docker for perf validation purpose (#12281)
Signed-off-by: Hongxia Yang <hongxyan@amd.com>
```
  09ccc9c8
- [Misc] Rename `MultiModalInputsV2 -> MultiModalInputs` (#12244) · 96912550
  Cyrus Leung authored Jan 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  96912550
- [AMD][Build] Porting dockerfiles from the ROCm/vllm fork (#11777) · d4b62d46
  Gregory Shtrasberg authored Jan 20, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  d4b62d46
20 Jan, 2025 2 commits
- [Model] Add Qwen2 PRM model support (#12202) · 83609791
  Isotr0py authored Jan 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  83609791
- Move linting to `pre-commit` (#11975) · 3ea7b945
  Harry Mellor authored Jan 20, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3ea7b945
19 Jan, 2025 1 commit

[V1] Add V1 support of Qwen2-VL (#12128) · 81763c58

Roger Wang authored Jan 19, 2025


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: imkero <kerorek@outlook.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

81763c58

18 Jan, 2025 2 commits
- [Model] Port deepseek-vl2 processor, remove dependency (#12169) · 02798eca
  Isotr0py authored Jan 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  02798eca
- [AMD][CI/Build][Bugfix] use pytorch stale wheel (#12172) · c09503dd
  Hongxia Yang authored Jan 17, 2025
```
Signed-off-by: hongxyan <hongxyan@amd.com>
```
  c09503dd
17 Jan, 2025 1 commit
- [Doc] Add instructions on using Podman when SELinux is active (#12136) · 1475847a
  Yuan Tang authored Jan 16, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  1475847a
16 Jan, 2025 2 commits
- [Model] Add support for deepseek-vl2-tiny model (#12068) · 62b06ba2
  Isotr0py authored Jan 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  62b06ba2
- [Doc] Add documentation for specifying model architecture (#12105) · f8ef146f
  Cyrus Leung authored Jan 16, 2025
  
  f8ef146f
15 Jan, 2025 2 commits
- [Model]: Support internlm3 (#12037) · 97eb97b5
  RunningLeon authored Jan 15, 2025
  
  97eb97b5
- [Doc] Update examples to remove SparseAutoModelForCausalLM (#12062) · 3f9b7ab9
  Kyle Sayers authored Jan 15, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  3f9b7ab9
14 Jan, 2025 3 commits
- Explain where the engine args go when using Docker (#12041) · c9d6ff53
  Harry Mellor authored Jan 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c9d6ff53
- [Doc] Update Quantization Hardware Support Documentation (#12025) · 8a1f938e
  TJian authored Jan 14, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  8a1f938e
- [Docs] Add Sky Computing Lab to project intro (#12019) · 1a401252
  Woosuk Kwon authored Jan 13, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1a401252
13 Jan, 2025 2 commits
- [Doc] Organise installation documentation into categories and tabs (#11935) · e8c23ff9
  Harry Mellor authored Jan 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e8c23ff9
- [Doc][V1] Update model implementation guide for V1 support (#11998) · cd824990
  Roger Wang authored Jan 13, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  cd824990
12 Jan, 2025 3 commits

[Hardware][CPU] Multi-LoRA implementation for the CPU backend (#11100) · 8bddb735

Akshat Tripathi authored Jan 12, 2025


Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Oleg Mosalov <oleg@krai.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Oleg Mosalov <oleg@krai.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

8bddb735

[Model] Initialize support for Deepseek-VL2 models (#11578) · f967e51f
Isotr0py authored Jan 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
f967e51f
[CI/Build] Add markdown linter (#11857) · 43f3d9e6
Rafael Vasquez authored Jan 12, 2025
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
43f3d9e6

11 Jan, 2025 1 commit
- [Doc] Basic guide for writing unit tests for new models (#11951) · a991f7d5
  Cyrus Leung authored Jan 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a991f7d5
10 Jan, 2025 4 commits
- [Hardware][CPU] Support MOE models on x86 CPU (#11831) · aa1e77a1
  Li, Jiang authored Jan 11, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  aa1e77a1
- [Doc] Rename offline inference examples (#11927) · 482cdc49
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  482cdc49
- [Doc] [1/N] Initial guide for merged multi-modal processor (#11925) · 12664ddd
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  12664ddd
- Replace "online inference" with "online serving" (#11923) · d85c47d6
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d85c47d6