Commits · f8a12ecc7f7ebcffe26e1ae405c6aa533fc400cd · OpenDAS / vllm_cscc

24 Mar, 2024 1 commit
- [Misc] Bump transformers version (#3592) · f8a12ecc
  Roger Wang authored Mar 24, 2024
  
  f8a12ecc
21 Mar, 2024 1 commit
- [Misc] Bump up transformers to v4.39.0 & Remove StarCoder2Config (#3551) · c188ecb0
  Woosuk Kwon authored Mar 21, 2024
```
Co-authored-by: Roy <jasonailu87@gmail.com>
Co-authored-by: Roger Meier <r.meier@siemens.com>
```
  c188ecb0
18 Mar, 2024 1 commit
- Cmake based build system (#2830) · 9fdf3de3
  bnellnm authored Mar 18, 2024
  
  9fdf3de3
14 Mar, 2024 1 commit
- [Hotfix] [Debug] test_openai_server.py::test_guided_regex_completion (#3383) · 81653d96
  Simon Mo authored Mar 13, 2024
  
  81653d96
29 Feb, 2024 1 commit
- Add guided decoding for OpenAI API server (#2819) · 703e42ee
  felixzhu555 authored Feb 29, 2024
```
Co-authored-by: br3no <breno@veltefaria.de>
Co-authored-by: simon-mo <simon.mo@hey.com>
```
  703e42ee
28 Feb, 2024 1 commit
- Restrict prometheus_client >= 0.18.0 to prevent errors when importing pkgs (#3070) · e46fa5d5
  Allen.Dou authored Feb 28, 2024
  
  e46fa5d5
25 Feb, 2024 1 commit
- Port metrics from `aioprometheus` to `prometheus_client` (#2730) · ef978fe4
  Harry Mellor authored Feb 25, 2024
  
  ef978fe4
21 Feb, 2024 1 commit
- Upgrade transformers to v4.38.0 (#2965) · c20ecb6a
  Woosuk Kwon authored Feb 21, 2024
  
  c20ecb6a
14 Feb, 2024 1 commit
- Fix docker python version (#2845) · 87069ccf
  Nikola Borisov authored Feb 14, 2024
  
  87069ccf
13 Feb, 2024 1 commit
- Use CuPy for CUDA graphs (#2811) · a463c333
  Woosuk Kwon authored Feb 13, 2024
  
  a463c333
05 Feb, 2024 1 commit
- Require triton >= 2.1.0 (#2746) · c9b45ade
  whyiug authored Feb 05, 2024
```
Co-authored-by: yangrui1 <yangrui@lanjingren.com>
```
  c9b45ade
28 Jan, 2024 1 commit
- Update Ray version requirements (#2636) · 7d648418
  Simon Mo authored Jan 28, 2024
  
  7d648418
27 Jan, 2024 1 commit
- Implement custom all reduce kernels (#2192) · 38017003
  Hanzhi Zhou authored Jan 28, 2024
  
  38017003
22 Jan, 2024 2 commits
- Add qwen2 (#2495) · 94b5edeb
  Junyang Lin authored Jan 23, 2024
  
  94b5edeb
- migrate pydantic from v1 to v2 (#2531) · 71d63ed7
  Jannis Schönleber authored Jan 22, 2024
  
  71d63ed7
03 Jan, 2024 1 commit
- Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) · fd4ea8ef
  Zhuohan Li authored Jan 04, 2024
  
  fd4ea8ef
17 Dec, 2023 4 commits
- [Minor] Fix xformers version (#2158) · c9fadda5
  Woosuk Kwon authored Dec 17, 2023
  
  c9fadda5
- Remove dependency on CuPy (#2152) · c3372e87
  Woosuk Kwon authored Dec 17, 2023
  
  c3372e87
- Pin PyTorch & xformers versions (#2155) · b0a1d667
  Woosuk Kwon authored Dec 17, 2023
  
  b0a1d667
- Optimize model execution with CUDA graph (#1926) · 37ca5581
  Woosuk Kwon authored Dec 16, 2023
```
Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  37ca5581
12 Dec, 2023 3 commits
- Remove einops from requirements (#2049) · 7e1b21da
  Woosuk Kwon authored Dec 12, 2023
  
  7e1b21da
- Upgrade transformers version to 4.36.0 (#2046) · cb3f30c6
  Woosuk Kwon authored Dec 11, 2023
  
  cb3f30c6
- [CI/CD] Upgrade PyTorch version to v2.1.1 (#2045) · f3e024be
  Woosuk Kwon authored Dec 11, 2023
  
  f3e024be
11 Dec, 2023 2 commits
- Revert adding Megablocks (#2030) · beeee69b
  Woosuk Kwon authored Dec 11, 2023
  
  beeee69b
- Update requirements.txt for mixtral (#2029) · 9bf28d0b
  Ram authored Dec 12, 2023
  
  9bf28d0b
03 Dec, 2023 1 commit
- Add Production Metrics in Prometheus format (#1890) · 5313c2cb
  Simon Mo authored Dec 02, 2023
  
  5313c2cb
16 Nov, 2023 1 commit
- Support Microsoft Phi 1.5 (#1664) · 521b35f7
  maximzubkov authored Nov 16, 2023
  
  521b35f7
08 Nov, 2023 1 commit
- Upgrade to CUDA 12 (#1527) · 06458a0b
  Zhuohan Li authored Nov 08, 2023
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  06458a0b
21 Oct, 2023 1 commit
- Pin pydantic dependency versions (#1429) · bf31d360
  Thiago Salvatore authored Oct 21, 2023
  
  bf31d360
13 Oct, 2023 1 commit
- Bump up transformers version & Remove MistralConfig (#1254) · e7c8555d
  Woosuk Kwon authored Oct 13, 2023
  
  e7c8555d
10 Oct, 2023 1 commit
- lock torch version to 2.0.1 (#1290) · 6a611955
  yanxiyue authored Oct 11, 2023
  
  6a611955
28 Sep, 2023 2 commits
- [Mistral] Mistral-7B-v0.1 support (#1196) · bb1ba58f
  Chris Bamford authored Sep 28, 2023
```
Co-authored-by: timlacroix <t@mistral.ai>
```
  bb1ba58f
- Use standard extras for uvicorn (#1166) · 649aa730
  Danilo Peixoto authored Sep 27, 2023
  
  649aa730
19 Sep, 2023 1 commit
- Add pyarrow to dependencies & Print warning on Ray import error (#1094) · 400b8289
  Woosuk Kwon authored Sep 18, 2023
  
  400b8289
15 Sep, 2023 1 commit
- Add pandas to requirements.txt (#1047) · a5893696
  Woosuk Kwon authored Sep 14, 2023
```
* Add pandas to requirements.txt

* Minor
```
  a5893696
07 Sep, 2023 1 commit
- Bum up transformers version (#976) · 7a9c20c7
  Woosuk Kwon authored Sep 08, 2023
  
  7a9c20c7
23 Aug, 2023 1 commit
- Fix for breaking changes in xformers 0.0.21 (#834) · 2a4ec908
  Woosuk Kwon authored Aug 23, 2023
  
  2a4ec908
26 Jul, 2023 1 commit
- [Fix] Add chat completion Example and simplify dependencies (#576) · 82ad323d
  Zhuohan Li authored Jul 25, 2023
  
  82ad323d
20 Jul, 2023 2 commits
- Add support for LLaMA-2 (#505) · 6fc2a38b
  Zhuohan Li authored Jul 20, 2023
  
  6fc2a38b
- Ray placement group support (#397) · 9925c179
  Antoni Baum authored Jul 19, 2023
  
  9925c179