Commits · 444b0f0f62989246abe115f0b24d2ba289612b23 · OpenDAS / vllm_cscc

24 Feb, 2025 1 commit

[Misc][Docs] Raise error when flashinfer is not installed and... · 444b0f0f

Nicolò Lucchesi authored Feb 24, 2025


[Misc][Docs] Raise error when flashinfer is not installed and `VLLM_ATTENTION_BACKEND` is set (#12513)
Signed-off-by: NickLucche <nlucches@redhat.com>

444b0f0f

20 Feb, 2025 1 commit
- Merge similar examples in `offline_inference` into single `basic` example (#12737) · 992e5c3d
  Harry Mellor authored Feb 20, 2025
  
  992e5c3d
18 Feb, 2025 1 commit
- [misc] fix debugging code (#13487) · 7b203b76
  youkaichao authored Feb 19, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  7b203b76
16 Feb, 2025 1 commit
- [Docs] Change myenv to vllm. Update python_env_setup.inc.md (#13325) · da833b0a
  凌 authored Feb 17, 2025
  
  da833b0a
13 Feb, 2025 1 commit
- [Build] Automatically use the wheel of the base commit with Python-only build (#13178) · 60c68df6
  Cody Yu authored Feb 12, 2025
  
  60c68df6
11 Feb, 2025 1 commit
- [Doc] Improve OpenVINO installation doc (#13102) · deb6c1c6
  Harry Mellor authored Feb 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  deb6c1c6
08 Feb, 2025 1 commit
- [CI/Build] Auto-fix Markdown files (#12941) · 8a69e0e2
  Cyrus Leung authored Feb 08, 2025
  
  8a69e0e2
07 Feb, 2025 1 commit

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation... · eaa92d44

TJian authored Feb 08, 2025

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)

eaa92d44

06 Feb, 2025 1 commit
- [Doc] double quote cmake package in build.inc.md (#12840) · afe74f7a
  Jitse Klomp authored Feb 06, 2025
  
  afe74f7a
02 Feb, 2025 1 commit
- [Hardware][Intel GPU] add XPU bf16 support (#12392) · f256ebe4
  Kunshang Ji authored Feb 02, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  f256ebe4
31 Jan, 2025 1 commit

[Doc] Improve installation signposting (#12575) · 60808bd4

Harry Mellor authored Jan 31, 2025

- Make device tab names more explicit
- Add comprehensive list of devices to
https://docs.vllm.ai/en/latest/getting_started/installation/index.html


- Add `attention` blocks to the intro of all devices that don't have
pre-built wheels/images

---------
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

60808bd4

29 Jan, 2025 1 commit
- [Doc] Convert docs to use colon fences (#12471) · dd6a3a02
  Harry Mellor authored Jan 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  dd6a3a02
28 Jan, 2025 1 commit
- [Doc] Fix typo for x86 CPU installation (#12514) · 925d2f19
  Jun Duan authored Jan 28, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  925d2f19
24 Jan, 2025 1 commit
- [Hardware][Gaudi][Doc] Add missing step in setup instructions (#12382) · 9a0f3bdb
  Mohit Deopujari authored Jan 24, 2025
  
  9a0f3bdb
23 Jan, 2025 2 commits
- [Doc] Troubleshooting errors during model inspection (#12351) · d07efb31
  Cyrus Leung authored Jan 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d07efb31
- [doc] explain common errors around torch.compile (#12340) · 51162744
  youkaichao authored Jan 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  51162744
21 Jan, 2025 2 commits
- [Documentation][AMD] Add information about prebuilt ROCm vLLM docker for perf... · 09ccc9c8
  Hongxia Yang authored Jan 21, 2025
```
[Documentation][AMD] Add information about prebuilt ROCm vLLM docker for perf validation purpose (#12281)
Signed-off-by: Hongxia Yang <hongxyan@amd.com>
```
  09ccc9c8
- [AMD][Build] Porting dockerfiles from the ROCm/vllm fork (#11777) · d4b62d46
  Gregory Shtrasberg authored Jan 20, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  d4b62d46
18 Jan, 2025 1 commit
- [AMD][CI/Build][Bugfix] use pytorch stale wheel (#12172) · c09503dd
  Hongxia Yang authored Jan 17, 2025
```
Signed-off-by: hongxyan <hongxyan@amd.com>
```
  c09503dd
13 Jan, 2025 1 commit
- [Doc] Organise installation documentation into categories and tabs (#11935) · e8c23ff9
  Harry Mellor authored Jan 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e8c23ff9
12 Jan, 2025 1 commit
- [CI/Build] Add markdown linter (#11857) · 43f3d9e6
  Rafael Vasquez authored Jan 12, 2025
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  43f3d9e6
10 Jan, 2025 3 commits
- [Hardware][CPU] Support MOE models on x86 CPU (#11831) · aa1e77a1
  Li, Jiang authored Jan 11, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  aa1e77a1
- [Doc] Rename offline inference examples (#11927) · 482cdc49
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  482cdc49
- Replace "online inference" with "online serving" (#11923) · d85c47d6
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d85c47d6
09 Jan, 2025 1 commit
- [Doc] Recommend uv and python 3.12 for quickstart guide (#11849) · 730e9592
  Michael Goin authored Jan 08, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  730e9592
08 Jan, 2025 5 commits
- [Doc][4/N] Reorganize API Reference (#11843) · 6cd40a5b
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6cd40a5b
- [Doc] Move examples into categories (#11840) · aba8d6ee
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aba8d6ee
- [Hardware][Apple] Native support for macOS Apple Silicon (#11696) · cfd3219f
  Wallas Henrique authored Jan 08, 2025
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  cfd3219f
- [doc] update wheels url (#11830) · ad9f1aa6
  youkaichao authored Jan 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ad9f1aa6
- [Doc] Group examples into categories (#11782) · 5950f555
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5950f555
07 Jan, 2025 3 commits
- [doc] update how pip can install nightly wheels (#11806) · d9fa1c05
  youkaichao authored Jan 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d9fa1c05
- [doc] add doc to explain how to use uv (#11773) · 869e829b
  youkaichao authored Jan 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  869e829b
- [Doc][3/N] Reorganize Serving section (#11766) · 8ceffbf3
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8ceffbf3
06 Jan, 2025 1 commit
- [Doc] [1/N] Reorganize Getting Started section (#11645) · 402d3783
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  402d3783
29 Dec, 2024 1 commit
- [Doc] Convert list tables to MyST (#11594) · 32b4c63f
  Cyrus Leung authored Dec 29, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32b4c63f
28 Dec, 2024 1 commit
- [Doc] Minor documentation fixes (#11580) · d427e5cf
  Cyrus Leung authored Dec 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d427e5cf
25 Dec, 2024 1 commit
- [Doc] Improve GitHub links (#11491) · 6ad909fd
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ad909fd
23 Dec, 2024 2 commits
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059
- [Bugfix] torch nightly version in ROCm installation guide (#11423) · 2e726680
  Yuan Tang authored Dec 23, 2024
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  2e726680
20 Dec, 2024 1 commit
- [doc] explain nccl requirements for rlhf (#11381) · 5d2248d8
  youkaichao authored Dec 20, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  5d2248d8