Commits · 848a6438aed2ef8d0de3d51e8ed2f970abf57853 · OpenDAS / vllm_cscc

03 Mar, 2025 1 commit
- [ROCm] Faster Custom Paged Attention kernels (#12348) · 848a6438
  TJian authored Mar 04, 2025
  
  848a6438
20 Feb, 2025 1 commit
- [ci] Add AWS creds for AMD (#13572) · 88f6ba32
  Kevin H. Luu authored Feb 19, 2025
  
  88f6ba32
11 Dec, 2024 1 commit
- [ci/build] Fix AMD CI dependencies (#11087) · 3fb4b4f1
  Kevin H. Luu authored Dec 11, 2024
  
  3fb4b4f1
27 Aug, 2024 1 commit
- [CI/Build][ROCm] Enabling tensorizer tests for ROCm (#7237) · 42e932c7
  alexeykondrat authored Aug 27, 2024
  
  42e932c7
20 Jul, 2024 1 commit
- [Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA,... · 06d6c5fe
  Matt Wong authored Jul 20, 2024
```
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)
```
  06d6c5fe
20 May, 2024 1 commit
- [Build/CI] Enabling AMD Entrypoints Test (#4834) · 943e72ca
  Alexei-V-Ivanov-AMD authored May 20, 2024
```
Co-authored-by: Alexey Kondratiev <alexey.kondratiev@amd.com>
```
  943e72ca
05 Apr, 2024 1 commit
- [Misc] Define common requirements (#3841) · cfaf49a1
  Woosuk Kwon authored Apr 05, 2024
  
  cfaf49a1
01 Apr, 2024 1 commit
- [Misc] Minor fixes in requirements.txt (#3769) · f03cc667
  Woosuk Kwon authored Apr 01, 2024
  
  f03cc667
29 Mar, 2024 2 commits
- [ROCm][Bugfix] Fixed several bugs related to rccl path and attention selector logic (#3699) · 9765b5c4
  Hongxia Yang authored Mar 29, 2024
  
  9765b5c4
- Usage Stats Collection (#2852) · d8658c8c
  yhu422 authored Mar 28, 2024
  
  d8658c8c
24 Mar, 2024 1 commit
- [Misc] Bump transformers version (#3592) · f8a12ecc
  Roger Wang authored Mar 24, 2024
  
  f8a12ecc
21 Mar, 2024 1 commit
- [Misc] Bump up transformers to v4.39.0 & Remove StarCoder2Config (#3551) · c188ecb0
  Woosuk Kwon authored Mar 21, 2024
```
Co-authored-by: Roy <jasonailu87@gmail.com>
Co-authored-by: Roger Meier <r.meier@siemens.com>
```
  c188ecb0
18 Mar, 2024 2 commits
- Cmake based build system (#2830) · 9fdf3de3
  bnellnm authored Mar 18, 2024
  
  9fdf3de3
- CI: Add ROCm Docker Build (#2886) · 8c654c04
  Simon Mo authored Mar 18, 2024
  
  8c654c04
28 Feb, 2024 1 commit
- Restrict prometheus_client >= 0.18.0 to prevent errors when importing pkgs (#3070) · e46fa5d5
  Allen.Dou authored Feb 28, 2024
  
  e46fa5d5
25 Feb, 2024 1 commit
- Port metrics from `aioprometheus` to `prometheus_client` (#2730) · ef978fe4
  Harry Mellor authored Feb 25, 2024
  
  ef978fe4
21 Feb, 2024 1 commit
- [ROCm] Upgrade transformers to v4.38.0 (#2967) · dc903e70
  Woosuk Kwon authored Feb 21, 2024
  
  dc903e70
28 Jan, 2024 1 commit
- Update Ray version requirements (#2636) · 7d648418
  Simon Mo authored Jan 28, 2024
  
  7d648418
22 Jan, 2024 2 commits
- Add qwen2 (#2495) · 94b5edeb
  Junyang Lin authored Jan 23, 2024
  
  94b5edeb
- migrate pydantic from v1 to v2 (#2531) · 71d63ed7
  Jannis Schönleber authored Jan 22, 2024
  
  71d63ed7
03 Jan, 2024 1 commit
- Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) · fd4ea8ef
  Zhuohan Li authored Jan 04, 2024
  
  fd4ea8ef
13 Dec, 2023 1 commit
- [ROCm] Upgrade xformers version for ROCm & update doc (#2079) · f375ec84
  TJian authored Dec 13, 2023
```
Co-authored-by: miloice <jeffaw99@hotmail.com>
```
  f375ec84
12 Dec, 2023 2 commits
- Remove einops from requirements (#2049) · 7e1b21da
  Woosuk Kwon authored Dec 12, 2023
  
  7e1b21da
- Upgrade transformers version to 4.36.0 (#2046) · cb3f30c6
  Woosuk Kwon authored Dec 11, 2023
  
  cb3f30c6
08 Dec, 2023 1 commit

Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836) · 6ccc0bff

TJian authored Dec 08, 2023


Co-authored-by: Philipp Moritz <pcmoritz@gmail.com>
Co-authored-by: Amir Balwel <amoooori04@gmail.com>
Co-authored-by: root <kuanfu.liu@akirakan.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kuanfu <kuanfu.liu@embeddedllm.com>
Co-authored-by: miloice <17350011+kliuae@users.noreply.github.com>

6ccc0bff

03 Dec, 2023 1 commit
- Add Production Metrics in Prometheus format (#1890) · 5313c2cb
  Simon Mo authored Dec 02, 2023
  
  5313c2cb
16 Nov, 2023 1 commit
- Support Microsoft Phi 1.5 (#1664) · 521b35f7
  maximzubkov authored Nov 16, 2023
  
  521b35f7
08 Nov, 2023 1 commit
- Upgrade to CUDA 12 (#1527) · 06458a0b
  Zhuohan Li authored Nov 08, 2023
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  06458a0b
21 Oct, 2023 1 commit
- Pin pydantic dependency versions (#1429) · bf31d360
  Thiago Salvatore authored Oct 21, 2023
  
  bf31d360
13 Oct, 2023 1 commit
- Bump up transformers version & Remove MistralConfig (#1254) · e7c8555d
  Woosuk Kwon authored Oct 13, 2023
  
  e7c8555d
10 Oct, 2023 1 commit
- lock torch version to 2.0.1 (#1290) · 6a611955
  yanxiyue authored Oct 11, 2023
  
  6a611955
28 Sep, 2023 2 commits
- [Mistral] Mistral-7B-v0.1 support (#1196) · bb1ba58f
  Chris Bamford authored Sep 28, 2023
```
Co-authored-by: timlacroix <t@mistral.ai>
```
  bb1ba58f
- Use standard extras for uvicorn (#1166) · 649aa730
  Danilo Peixoto authored Sep 27, 2023
  
  649aa730
19 Sep, 2023 1 commit
- Add pyarrow to dependencies & Print warning on Ray import error (#1094) · 400b8289
  Woosuk Kwon authored Sep 18, 2023
  
  400b8289
15 Sep, 2023 1 commit
- Add pandas to requirements.txt (#1047) · a5893696
  Woosuk Kwon authored Sep 14, 2023
```
* Add pandas to requirements.txt

* Minor
```
  a5893696
07 Sep, 2023 1 commit
- Bum up transformers version (#976) · 7a9c20c7
  Woosuk Kwon authored Sep 08, 2023
  
  7a9c20c7
23 Aug, 2023 1 commit
- Fix for breaking changes in xformers 0.0.21 (#834) · 2a4ec908
  Woosuk Kwon authored Aug 23, 2023
  
  2a4ec908
26 Jul, 2023 1 commit
- [Fix] Add chat completion Example and simplify dependencies (#576) · 82ad323d
  Zhuohan Li authored Jul 25, 2023
  
  82ad323d
20 Jul, 2023 2 commits
- Add support for LLaMA-2 (#505) · 6fc2a38b
  Zhuohan Li authored Jul 20, 2023
  
  6fc2a38b
- Ray placement group support (#397) · 9925c179
  Antoni Baum authored Jul 19, 2023
  
  9925c179