Commits · a4e2b268568b335d8fe37f8eaaa894cec3ba9397 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "1df43de9bb2cceecdc0dc2dc5c650a327aeabe0f"

07 Jan, 2025 3 commits
- [doc] update how pip can install nightly wheels (#11806) · d9fa1c05
  youkaichao authored Jan 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d9fa1c05
- [doc] add doc to explain how to use uv (#11773) · 869e829b
  youkaichao authored Jan 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  869e829b
- [Doc][3/N] Reorganize Serving section (#11766) · 8ceffbf3
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8ceffbf3
06 Jan, 2025 1 commit
- [Doc] [1/N] Reorganize Getting Started section (#11645) · 402d3783
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  402d3783
29 Dec, 2024 1 commit
- [Doc] Convert list tables to MyST (#11594) · 32b4c63f
  Cyrus Leung authored Dec 29, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32b4c63f
28 Dec, 2024 1 commit
- [Doc] Minor documentation fixes (#11580) · d427e5cf
  Cyrus Leung authored Dec 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d427e5cf
25 Dec, 2024 1 commit
- [Doc] Improve GitHub links (#11491) · 6ad909fd
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ad909fd
23 Dec, 2024 2 commits
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059
- [Bugfix] torch nightly version in ROCm installation guide (#11423) · 2e726680
  Yuan Tang authored Dec 23, 2024
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  2e726680
20 Dec, 2024 2 commits
- [doc] explain nccl requirements for rlhf (#11381) · 5d2248d8
  youkaichao authored Dec 20, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  5d2248d8
- [doc] backward compatibility for 0.6.4 (#11359) · 1ecc645b
  youkaichao authored Dec 19, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1ecc645b
14 Dec, 2024 1 commit
- [Core] V1: Use multiprocessing by default (#11074) · 4863e5fb
  Russell Bryant authored Dec 13, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  4863e5fb
04 Dec, 2024 2 commits
- [CI/Build] improve python-only dev setup (#9621) · e4c34c23
  Daniele authored Dec 04, 2024
```
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  e4c34c23
- [ci/build] Update vLLM postmerge ECR repo (#10887) · c92acb96
  Kevin H. Luu authored Dec 04, 2024
  
  c92acb96
30 Nov, 2024 1 commit
- [doc] format fix (#10789) · 7e4bbda5
  wangxiyuan authored Nov 30, 2024
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  7e4bbda5
26 Nov, 2024 2 commits

custom allreduce + torch.compile (#10121) · 9a88f897

Sage Moore authored Nov 26, 2024


Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

9a88f897

[Feature] vLLM ARM Enablement for AARCH64 CPUs (#9228) · a6760f64

Sanket Kale authored Nov 26, 2024


Signed-off-by: Sanket Kale <sanketk.kale@fujitsu.com>
Co-authored-by: Sanket Kale <sanketk.kale@fujitsu.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

a6760f64

20 Nov, 2024 2 commits
- [Hardware][CPU] Support chunked-prefill and prefix-caching on CPU (#10355) · 63f1fde2
  Li, Jiang authored Nov 20, 2024
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  63f1fde2
- [CI/Build] Support compilation with local cutlass path (#10423) (#10424) · 7629a9c6
  wchen61 authored Nov 20, 2024
  
  7629a9c6
15 Nov, 2024 1 commit
- [Docs] Misc updates to TPU installation instructions (#10165) · 4f168f69
  Michael Green authored Nov 15, 2024
  
  4f168f69
12 Nov, 2024 2 commits
- Revert "[ci][build] limit cmake version" (#10271) · 377b74fe
  youkaichao authored Nov 12, 2024
  
  377b74fe
- [doc] improve debugging doc (#10270) · 18081451
  youkaichao authored Nov 12, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  18081451
11 Nov, 2024 2 commits
- [doc] update debugging guide (#10236) · d1c6799b
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d1c6799b
- [doc] improve debugging code (#10206) · f0f2e563
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f0f2e563
10 Nov, 2024 1 commit
- [ci][build] limit cmake version (#10188) · 9fa4bdde
  youkaichao authored Nov 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  9fa4bdde
07 Nov, 2024 2 commits
- [doc] add back Python 3.8 ABI (#10100) · e7b84c39
  youkaichao authored Nov 06, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e7b84c39
- [Hardware][CPU] Update torch 2.5 (#9911) · a4b3e0c1
  Li, Jiang authored Nov 07, 2024
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a4b3e0c1
06 Nov, 2024 3 commits

[CI/Build] Drop Python 3.8 support (#10038) · 098f94de

Russell Bryant authored Nov 06, 2024


Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

098f94de

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143) · a02a50e6

Konrad Zawora authored Nov 06, 2024


Signed-off-by: yuwenzho <yuwen.zhou@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Signed-off-by: Bob Zhu <bob.zhu@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Sanju C Sudhakaran <scsudhakaran@habana.ai>
Co-authored-by: Michal Adamczyk <madamczyk@habana.ai>
Co-authored-by: Marceli Fylcek <mfylcek@habana.ai>
Co-authored-by: Himangshu Lahkar <49579433+hlahkar@users.noreply.github.com>
Co-authored-by: Vivek Goel <vgoel@habana.ai>
Co-authored-by: yuwenzho <yuwen.zhou@intel.com>
Co-authored-by: Dominika Olszewska <dolszewska@habana.ai>
Co-authored-by: barak goldberg <149692267+bgoldberg-habana@users.noreply.github.com>
Co-authored-by: Michal Szutenberg <37601244+szutenberg@users.noreply.github.com>
Co-authored-by: Jan Kaniecki <jkaniecki@habana.ai>
Co-authored-by: Agata Dobrzynie...

a02a50e6

[CI/Build] drop support for Python 3.8 EOL (#8464) · 21063c11
Aaron Pham authored Nov 06, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
21063c11

05 Nov, 2024 1 commit
- Refactor TPU requirements file and pin build dependencies (#10010) · cd34029e
  Richard Liu authored Nov 05, 2024
```
Signed-off-by: Richard Liu <ricliu@google.com>
```
  cd34029e
02 Nov, 2024 1 commit
- [Doc] Updated tpu-installation.rst with more details (#9926) · 1d4cfe2b
  Michael Green authored Nov 02, 2024
```
Signed-off-by: Michael Green <mikegre@google.com>
```
  1d4cfe2b
01 Nov, 2024 1 commit
- [Frontend] Chat-based Embeddings API (#9759) · 06386a64
  Cyrus Leung authored Nov 01, 2024
  
  06386a64
30 Oct, 2024 2 commits
- [TPU] Correctly profile peak memory usage & Upgrade PyTorch XLA (#9438) · 211fe91a
  Woosuk Kwon authored Oct 30, 2024
  
  211fe91a
- [Bugfix] Fix multi nodes TP+PP for XPU (#8884) · 04a3ae0a
  Yan Ma authored Oct 30, 2024
```
Signed-off-by: YiSheng5 <syhm@mail.ustc.edu.cn>
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: YiSheng5 <syhm@mail.ustc.edu.cn>
```
  04a3ae0a
25 Oct, 2024 1 commit
- [Doc] Improve quickstart documentation (#9256) · 228cfbd0
  Rafael Vasquez authored Oct 25, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  228cfbd0
22 Oct, 2024 2 commits

[Hardware][Intel CPU][DOC] Update docs for CPU backend (#6212) · 32a1ee74

Yuan authored Oct 22, 2024


Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Gubrud, Aaron D <aaron.d.gubrud@intel.com>
Co-authored-by: adgubrud <96072084+adgubrud@users.noreply.github.com>

32a1ee74

[Doc] Use shell code-blocks and fix section headers (#9508) · f7db5f0f
Rafael Vasquez authored Oct 22, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
f7db5f0f

21 Oct, 2024 1 commit
- [doc] fix format (#9562) · d621c43d
  youkaichao authored Oct 21, 2024
  
  d621c43d
17 Oct, 2024 1 commit
- [Hardware][CPU] compressed-tensor INT8 W8A8 AZP support (#9344) · 5eda21e7
  Li, Jiang authored Oct 18, 2024
  
  5eda21e7