Commits · facbe2a114d4725420ac6a3da802202fb0801cf0 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "aa49f148322a39727be110da51a6782d43a2f5d8"

16 Apr, 2025 1 commit
- [Doc] Improve OOM troubleshooting (#16704) · facbe2a1
  Cyrus Leung authored Apr 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  facbe2a1
07 Apr, 2025 1 commit
- [V1] Revert the default `max_num_seqs` to V0 values for most hardware (#16158) · 66d433b9
  Cyrus Leung authored Apr 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  66d433b9
05 Apr, 2025 1 commit
- Revert "doc: add info for macos clang errors (#16049)" (#16091) · 6baeee70
  yihong authored Apr 05, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  6baeee70
04 Apr, 2025 1 commit
- doc: add info for macos clang errors (#16049) · 4ef0bb1f
  yihong authored Apr 04, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  4ef0bb1f
02 Apr, 2025 2 commits
- [CPU][Bugfix] Using custom allreduce for CPU backend (#15934) · 550b2801
  Li, Jiang authored Apr 02, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  550b2801
- [Doc] Update rocm.inc.md (#15917) · c920e012
  chun authored Apr 02, 2025
```
Signed-off-by: chun37 <chun.jb.37@gmail.com>
```
  c920e012
31 Mar, 2025 1 commit
- Move dockerfiles into their own directory (#14549) · e6e3c55e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6e3c55e
30 Mar, 2025 1 commit

[doc] update conda to usage link in installation (#15761) · 44c3a5ab

Reid authored Mar 30, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

44c3a5ab

29 Mar, 2025 1 commit
- [ROCm][AMD][Build] Update AMD supported arch list (#15632) · c802f543
  Gregory Shtrasberg authored Mar 28, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  c802f543
28 Mar, 2025 2 commits
- [Docs] Add "Generation quality changed" section to troubleshooting (#15701) · 0b416752
  Harry Mellor authored Mar 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0b416752
- [CPU][CI] Improve CPU Dockerfile (#15690) · 280d0741
  Li, Jiang authored Mar 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  280d0741
27 Mar, 2025 1 commit
- [Doc] Update V1 user guide for fp8 kv cache support (#15585) · 7f301dd8
  Wei Zeng authored Mar 26, 2025
```
Signed-off-by: weizeng <weizeng@roblox.com>
```
  7f301dd8
25 Mar, 2025 1 commit
- [Doc] Update V1 user guide for multi-modality (#15460) · 3f04a7fb
  Cyrus Leung authored Mar 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f04a7fb
24 Mar, 2025 1 commit

[Doc] Update docs on handling OOM (#15357) · 6dd55af6

Cyrus Leung authored Mar 25, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

6dd55af6

23 Mar, 2025 1 commit
- [Misc][Doc] Add note regarding loading `generation_config` by default (#15281) · 9c5c81b0
  Roger Wang authored Mar 23, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9c5c81b0
22 Mar, 2025 1 commit
- Remove openvino support in favor of external plugin (#15339) · b877031d
  Russell Bryant authored Mar 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  b877031d
18 Mar, 2025 1 commit
- [Doc] Minor v1_user_guide update (#15064) · 228b768d
  Jennifer Zhao authored Mar 18, 2025
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  228b768d
16 Mar, 2025 1 commit
- [Doc] Add guidance for using `ccache` with `pip install -e .` in doc (#14901) · 90df7f23
  Vadim Gimpelson authored Mar 17, 2025
  
  90df7f23
15 Mar, 2025 2 commits

[Doc] V1 user guide (#13991) · aaacf173

Jennifer Zhao authored Mar 14, 2025


Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Co-authored-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Jennifer Zhao <JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

aaacf173

[CPU] Support FP8 KV cache (#14741) · a2ae4965
Li, Jiang authored Mar 15, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
a2ae4965

14 Mar, 2025 2 commits

[Bugfix][IPEX] Add `VLLM_CPU_MOE_PREPACK` to allow disabling MoE prepack when... · 95d680b8

Thien Tran authored Mar 14, 2025


[Bugfix][IPEX] Add `VLLM_CPU_MOE_PREPACK` to allow disabling MoE prepack when CPU does not support it (#14681)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>

95d680b8

[Doc] Fix typo in documentation (#14783) · 3fb17d26
yasu52 authored Mar 13, 2025
```
Signed-off-by: yasu52 <tsuguro4649@gmail.com>
```
3fb17d26

11 Mar, 2025 2 commits
- [Hardware][Intel GPU] upgrade IPEX dependency to 2.6.10. (#14564) · c6e14a61
  Kunshang Ji authored Mar 11, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  c6e14a61
- docs: Add documentation for s390x cpu implementation (#14198) · 07964e2f
  Dilip Gowda Bhagavan authored Mar 11, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  07964e2f
10 Mar, 2025 1 commit
- [Docs] Make installation URLs nicer (#14556) · bc2d4473
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bc2d4473
08 Mar, 2025 1 commit
- Move requirements into their own directory (#12547) · 206e2577
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  206e2577
04 Mar, 2025 1 commit
- [doc] add "Failed to infer device type" to faq (#14200) · 3610fb49
  youkaichao authored Mar 04, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3610fb49
02 Mar, 2025 1 commit
- [Doc] Source building add clone step (#14086) · bc6ccb98
  qux-bbb authored Mar 02, 2025
```
Signed-off-by: qux-bbb <1147635419@qq.com>
```
  bc6ccb98
28 Feb, 2025 1 commit
- [Doc] Fix ROCm documentation (#14041) · 2aed2c9f
  Brayden Zhong authored Feb 28, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2aed2c9f
27 Feb, 2025 2 commits
- Update quickstart.md (#13958) · 512d77d5
  王博伟 authored Feb 28, 2025
  
  512d77d5
- Use CUDA 12.4 as default for release and nightly wheels (#12098) · ca377cf1
  Michael Goin authored Feb 26, 2025
  
  ca377cf1
24 Feb, 2025 1 commit

[Misc][Docs] Raise error when flashinfer is not installed and... · 444b0f0f

Nicolò Lucchesi authored Feb 24, 2025


[Misc][Docs] Raise error when flashinfer is not installed and `VLLM_ATTENTION_BACKEND` is set (#12513)
Signed-off-by: NickLucche <nlucches@redhat.com>

444b0f0f

20 Feb, 2025 1 commit
- Merge similar examples in `offline_inference` into single `basic` example (#12737) · 992e5c3d
  Harry Mellor authored Feb 20, 2025
  
  992e5c3d
18 Feb, 2025 1 commit
- [misc] fix debugging code (#13487) · 7b203b76
  youkaichao authored Feb 19, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  7b203b76
16 Feb, 2025 1 commit
- [Docs] Change myenv to vllm. Update python_env_setup.inc.md (#13325) · da833b0a
  凌 authored Feb 17, 2025
  
  da833b0a
13 Feb, 2025 1 commit
- [Build] Automatically use the wheel of the base commit with Python-only build (#13178) · 60c68df6
  Cody Yu authored Feb 12, 2025
  
  60c68df6
11 Feb, 2025 1 commit
- [Doc] Improve OpenVINO installation doc (#13102) · deb6c1c6
  Harry Mellor authored Feb 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  deb6c1c6
08 Feb, 2025 1 commit
- [CI/Build] Auto-fix Markdown files (#12941) · 8a69e0e2
  Cyrus Leung authored Feb 08, 2025
  
  8a69e0e2
07 Feb, 2025 1 commit

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation... · eaa92d44

TJian authored Feb 08, 2025

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)

eaa92d44

06 Feb, 2025 1 commit
- [Doc] double quote cmake package in build.inc.md (#12840) · afe74f7a
  Jitse Klomp authored Feb 06, 2025
  
  afe74f7a