Commits · 55c5f16ffbe4c8149d6bbd89a0966097ec6e7da6 · OpenDAS / vllm_cscc

07 Nov, 2024 1 commit
- remove xformers deps · 55c5f16f
  zhuwenwen authored Nov 07, 2024
  
  55c5f16f
10 Oct, 2024 1 commit
- update benchmarks · 00d3d196
  zhuwenwen authored Oct 10, 2024
  
  00d3d196
09 Oct, 2024 1 commit
- 添加w8a8 rocblas非融合支持 · 35a8304d
  zhuwenwen authored Oct 09, 2024
  
  35a8304d
27 Sep, 2024 1 commit
- update version and deps · 5a9c236d
  zhuwenwen authored Sep 27, 2024
  
  5a9c236d
20 Sep, 2024 1 commit
- add pa tc · 0c70376b
  zhuwenwen authored Sep 20, 2024
  
  0c70376b
13 Sep, 2024 1 commit
- update torch version and support lm_head nn layout · aa1e273a
  zhuwenwen authored Sep 13, 2024
  
  aa1e273a
10 Sep, 2024 1 commit
- update version and requirements-rocm.txt · 6897826e
  zhuwenwen authored Sep 10, 2024
  
  6897826e
27 Aug, 2024 1 commit
- [CI/Build][ROCm] Enabling tensorizer tests for ROCm (#7237) · 42e932c7
  alexeykondrat authored Aug 27, 2024
  
  42e932c7
20 Jul, 2024 2 commits
- [Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA,... · 06d6c5fe
  Matt Wong authored Jul 20, 2024
```
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)
```
  06d6c5fe
- update ray version · 767bb050
  zhuwenwen authored Jul 20, 2024
  
  767bb050
20 May, 2024 1 commit
- [Build/CI] Enabling AMD Entrypoints Test (#4834) · 943e72ca
  Alexei-V-Ivanov-AMD authored May 20, 2024
```
Co-authored-by: Alexey Kondratiev <alexey.kondratiev@amd.com>
```
  943e72ca
06 May, 2024 1 commit
- update ray==2.9.1 · 96012705
  zhuwenwen authored May 06, 2024
  
  96012705
29 Apr, 2024 1 commit
- update ray==2.9.3 · 33809316
  zhuwenwen authored Apr 29, 2024
  
  33809316
05 Apr, 2024 1 commit
- [Misc] Define common requirements (#3841) · cfaf49a1
  Woosuk Kwon authored Apr 05, 2024
  
  cfaf49a1
01 Apr, 2024 1 commit
- [Misc] Minor fixes in requirements.txt (#3769) · f03cc667
  Woosuk Kwon authored Apr 01, 2024
  
  f03cc667
29 Mar, 2024 2 commits
- [ROCm][Bugfix] Fixed several bugs related to rccl path and attention selector logic (#3699) · 9765b5c4
  Hongxia Yang authored Mar 29, 2024
  
  9765b5c4
- Usage Stats Collection (#2852) · d8658c8c
  yhu422 authored Mar 28, 2024
  
  d8658c8c
24 Mar, 2024 1 commit
- [Misc] Bump transformers version (#3592) · f8a12ecc
  Roger Wang authored Mar 24, 2024
  
  f8a12ecc
21 Mar, 2024 1 commit
- [Misc] Bump up transformers to v4.39.0 & Remove StarCoder2Config (#3551) · c188ecb0
  Woosuk Kwon authored Mar 21, 2024
```
Co-authored-by: Roy <jasonailu87@gmail.com>
Co-authored-by: Roger Meier <r.meier@siemens.com>
```
  c188ecb0
18 Mar, 2024 2 commits
- Cmake based build system (#2830) · 9fdf3de3
  bnellnm authored Mar 18, 2024
  
  9fdf3de3
- CI: Add ROCm Docker Build (#2886) · 8c654c04
  Simon Mo authored Mar 18, 2024
  
  8c654c04
28 Feb, 2024 1 commit
- Restrict prometheus_client >= 0.18.0 to prevent errors when importing pkgs (#3070) · e46fa5d5
  Allen.Dou authored Feb 28, 2024
  
  e46fa5d5
25 Feb, 2024 1 commit
- Port metrics from `aioprometheus` to `prometheus_client` (#2730) · ef978fe4
  Harry Mellor authored Feb 25, 2024
  
  ef978fe4
21 Feb, 2024 1 commit
- [ROCm] Upgrade transformers to v4.38.0 (#2967) · dc903e70
  Woosuk Kwon authored Feb 21, 2024
  
  dc903e70
28 Jan, 2024 1 commit
- Update Ray version requirements (#2636) · 7d648418
  Simon Mo authored Jan 28, 2024
  
  7d648418
22 Jan, 2024 2 commits
- Add qwen2 (#2495) · 94b5edeb
  Junyang Lin authored Jan 23, 2024
  
  94b5edeb
- migrate pydantic from v1 to v2 (#2531) · 71d63ed7
  Jannis Schönleber authored Jan 22, 2024
  
  71d63ed7
03 Jan, 2024 1 commit
- Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) · fd4ea8ef
  Zhuohan Li authored Jan 04, 2024
  
  fd4ea8ef
13 Dec, 2023 1 commit
- [ROCm] Upgrade xformers version for ROCm & update doc (#2079) · f375ec84
  TJian authored Dec 13, 2023
```
Co-authored-by: miloice <jeffaw99@hotmail.com>
```
  f375ec84
12 Dec, 2023 2 commits
- Remove einops from requirements (#2049) · 7e1b21da
  Woosuk Kwon authored Dec 12, 2023
  
  7e1b21da
- Upgrade transformers version to 4.36.0 (#2046) · cb3f30c6
  Woosuk Kwon authored Dec 11, 2023
  
  cb3f30c6
08 Dec, 2023 1 commit

Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836) · 6ccc0bff

TJian authored Dec 08, 2023


Co-authored-by: Philipp Moritz <pcmoritz@gmail.com>
Co-authored-by: Amir Balwel <amoooori04@gmail.com>
Co-authored-by: root <kuanfu.liu@akirakan.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kuanfu <kuanfu.liu@embeddedllm.com>
Co-authored-by: miloice <17350011+kliuae@users.noreply.github.com>

6ccc0bff

03 Dec, 2023 1 commit
- Add Production Metrics in Prometheus format (#1890) · 5313c2cb
  Simon Mo authored Dec 02, 2023
  
  5313c2cb
16 Nov, 2023 1 commit
- Support Microsoft Phi 1.5 (#1664) · 521b35f7
  maximzubkov authored Nov 16, 2023
  
  521b35f7
08 Nov, 2023 1 commit
- Upgrade to CUDA 12 (#1527) · 06458a0b
  Zhuohan Li authored Nov 08, 2023
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  06458a0b
21 Oct, 2023 1 commit
- Pin pydantic dependency versions (#1429) · bf31d360
  Thiago Salvatore authored Oct 21, 2023
  
  bf31d360
13 Oct, 2023 1 commit
- Bump up transformers version & Remove MistralConfig (#1254) · e7c8555d
  Woosuk Kwon authored Oct 13, 2023
  
  e7c8555d
10 Oct, 2023 1 commit
- lock torch version to 2.0.1 (#1290) · 6a611955
  yanxiyue authored Oct 11, 2023
  
  6a611955
28 Sep, 2023 2 commits
- [Mistral] Mistral-7B-v0.1 support (#1196) · bb1ba58f
  Chris Bamford authored Sep 28, 2023
```
Co-authored-by: timlacroix <t@mistral.ai>
```
  bb1ba58f
- Use standard extras for uvicorn (#1166) · 649aa730
  Danilo Peixoto authored Sep 27, 2023
  
  649aa730