Commits · fcffb7c8dbbd498c3dc0d828b117a0829e1567bd · norm / vllm

03 Jan, 2024 1 commit
- Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) · fd4ea8ef
  Zhuohan Li authored Jan 04, 2024
  
  fd4ea8ef
17 Dec, 2023 4 commits
- [Minor] Fix xformers version (#2158) · c9fadda5
  Woosuk Kwon authored Dec 17, 2023
  
  c9fadda5
- Remove dependency on CuPy (#2152) · c3372e87
  Woosuk Kwon authored Dec 17, 2023
  
  c3372e87
- Pin PyTorch & xformers versions (#2155) · b0a1d667
  Woosuk Kwon authored Dec 17, 2023
  
  b0a1d667
- Optimize model execution with CUDA graph (#1926) · 37ca5581
  Woosuk Kwon authored Dec 16, 2023
```
Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  37ca5581
12 Dec, 2023 3 commits
- Remove einops from requirements (#2049) · 7e1b21da
  Woosuk Kwon authored Dec 12, 2023
  
  7e1b21da
- Upgrade transformers version to 4.36.0 (#2046) · cb3f30c6
  Woosuk Kwon authored Dec 11, 2023
  
  cb3f30c6
- [CI/CD] Upgrade PyTorch version to v2.1.1 (#2045) · f3e024be
  Woosuk Kwon authored Dec 11, 2023
  
  f3e024be
11 Dec, 2023 2 commits
- Revert adding Megablocks (#2030) · beeee69b
  Woosuk Kwon authored Dec 11, 2023
  
  beeee69b
- Update requirements.txt for mixtral (#2029) · 9bf28d0b
  Ram authored Dec 12, 2023
  
  9bf28d0b
03 Dec, 2023 1 commit
- Add Production Metrics in Prometheus format (#1890) · 5313c2cb
  Simon Mo authored Dec 02, 2023
  
  5313c2cb
16 Nov, 2023 1 commit
- Support Microsoft Phi 1.5 (#1664) · 521b35f7
  maximzubkov authored Nov 16, 2023
  
  521b35f7
08 Nov, 2023 1 commit
- Upgrade to CUDA 12 (#1527) · 06458a0b
  Zhuohan Li authored Nov 08, 2023
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  06458a0b
21 Oct, 2023 1 commit
- Pin pydantic dependency versions (#1429) · bf31d360
  Thiago Salvatore authored Oct 21, 2023
  
  bf31d360
13 Oct, 2023 1 commit
- Bump up transformers version & Remove MistralConfig (#1254) · e7c8555d
  Woosuk Kwon authored Oct 13, 2023
  
  e7c8555d
10 Oct, 2023 1 commit
- lock torch version to 2.0.1 (#1290) · 6a611955
  yanxiyue authored Oct 11, 2023
  
  6a611955
28 Sep, 2023 2 commits
- [Mistral] Mistral-7B-v0.1 support (#1196) · bb1ba58f
  Chris Bamford authored Sep 28, 2023
```
Co-authored-by: timlacroix <t@mistral.ai>
```
  bb1ba58f
- Use standard extras for uvicorn (#1166) · 649aa730
  Danilo Peixoto authored Sep 27, 2023
  
  649aa730
19 Sep, 2023 1 commit
- Add pyarrow to dependencies & Print warning on Ray import error (#1094) · 400b8289
  Woosuk Kwon authored Sep 18, 2023
  
  400b8289
15 Sep, 2023 1 commit
- Add pandas to requirements.txt (#1047) · a5893696
  Woosuk Kwon authored Sep 14, 2023
```
* Add pandas to requirements.txt

* Minor
```
  a5893696
07 Sep, 2023 1 commit
- Bum up transformers version (#976) · 7a9c20c7
  Woosuk Kwon authored Sep 08, 2023
  
  7a9c20c7
23 Aug, 2023 1 commit
- Fix for breaking changes in xformers 0.0.21 (#834) · 2a4ec908
  Woosuk Kwon authored Aug 23, 2023
  
  2a4ec908
26 Jul, 2023 1 commit
- [Fix] Add chat completion Example and simplify dependencies (#576) · 82ad323d
  Zhuohan Li authored Jul 25, 2023
  
  82ad323d
20 Jul, 2023 2 commits
- Add support for LLaMA-2 (#505) · 6fc2a38b
  Zhuohan Li authored Jul 20, 2023
  
  6fc2a38b
- Ray placement group support (#397) · 9925c179
  Antoni Baum authored Jul 19, 2023
  
  9925c179
12 Jul, 2023 1 commit
- fix: freeze pydantic to v1 (#429) · 51be3651
  Keming authored Jul 12, 2023
  
  51be3651
04 Jul, 2023 1 commit
- [Server] Add option to specify chat template for chat endpoint (#345) · 98fe8cb5
  Zhuohan Li authored Jul 03, 2023
  
  98fe8cb5
24 May, 2023 1 commit
- OpenAI Compatible Frontend (#116) · 057daef7
  Zhuohan Li authored May 23, 2023
  
  057daef7
07 May, 2023 1 commit
- Specify python package dependencies in requirements.txt (#78) · 7addca59
  Woosuk Kwon authored May 07, 2023
  
  7addca59