Commits · ff7ec82c4dd6170ea8fedbd4d974c0a670e84c97 · OpenDAS / vllm_cscc

19 Aug, 2024 1 commit
- [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) · ff7ec82c
  SangBin Cho authored Aug 18, 2024
  
  ff7ec82c
17 Aug, 2024 1 commit
- [Bugfix] add >= 1.0 constraint for openai dependency (#7612) · 7c0b7ea2
  Xander Johnson authored Aug 16, 2024
  
  7c0b7ea2
15 Aug, 2024 1 commit
- [Misc] Update dockerfile for CPU to cover protobuf installation (#7182) · f4da5f7b
  PHILO-HE authored Aug 16, 2024
  
  f4da5f7b
14 Aug, 2024 1 commit
- [Misc] Revert `compressed-tensors` code reuse (#7521) · f55a9aea
  Kyle Sayers authored Aug 14, 2024
  
  f55a9aea
13 Aug, 2024 3 commits
- [misc][plugin] add plugin system implementation (#7426) · 16422ea7
  youkaichao authored Aug 13, 2024
  
  16422ea7
- [Misc] `compressed-tensors` code reuse (#7277) · 373538f9
  Kyle Sayers authored Aug 13, 2024
  
  373538f9
- [Frontend][Core] Add plumbing to support audio language models (#7446) · 00c3d68e
  Peter Salas authored Aug 13, 2024
  
  00c3d68e
12 Aug, 2024 1 commit
- [CI/Build] bump minimum cmake version (#6999) · 774cd1d3
  Daniele authored Aug 13, 2024
  
  774cd1d3
11 Aug, 2024 1 commit
- Updating LM Format Enforcer version to v0.10.6 (#7189) · 4fb7b52a
  Noam Gat authored Aug 11, 2024
  
  4fb7b52a
09 Aug, 2024 1 commit
- [Core] Support serving encoder/decoder models (#7258) · 7eb4a51c
  Cyrus Leung authored Aug 09, 2024
  
  7eb4a51c
05 Aug, 2024 1 commit
- [Core] Support loading GGUF model (#5191) · 360bd67c
  Isotr0py authored Aug 06, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  360bd67c
24 Jul, 2024 1 commit
- [Bugfix] Bump transformers to 4.43.2 (#6752) · 421e218b
  Michael Goin authored Jul 24, 2024
  
  421e218b
23 Jul, 2024 1 commit
- Bump `transformers` version for Llama 3.1 hotfix and patch Chameleon (#6690) · 1bedf210
  Roger Wang authored Jul 23, 2024
  
  1bedf210
13 Jul, 2024 1 commit
- Updating LM Format Enforcer version to v10.3 (#6411) · 9da4aad4
  Noam Gat authored Jul 13, 2024
  
  9da4aad4
12 Jul, 2024 1 commit
- [Misc][Bugfix] Update transformers for tokenizer issue (#6364) · f7160d94
  Roger Wang authored Jul 12, 2024
  
  f7160d94
11 Jul, 2024 1 commit
- [BugFix]: set outlines pkg version (#6262) · fc17110b
  Lim Xiang Yang authored Jul 11, 2024
  
  fc17110b
10 Jul, 2024 1 commit
- [core][distributed] zmq fallback for broadcasting large objects (#6183) · da78caec
  youkaichao authored Jul 09, 2024
```
[core][distributed] add zmq fallback for broadcasting large objects (#6183)
```
  da78caec
02 Jul, 2024 1 commit
- [Frontend] Add template related params to request (#5709) · 2c37540a
  danieljannai21 authored Jul 02, 2024
  
  2c37540a
27 Jun, 2024 1 commit
- [Model] Add Gemma 2 (#5908) · 79c92c7c
  Woosuk Kwon authored Jun 27, 2024
  
  79c92c7c
19 Jun, 2024 1 commit
- [CI/Build] Add tqdm to dependencies (#5680) · e9c2732b
  Cyrus Leung authored Jun 19, 2024
  
  e9c2732b
16 Jun, 2024 1 commit
- [build][misc] limit numpy version (#5582) · f07d5133
  youkaichao authored Jun 16, 2024
  
  f07d5133
05 Jun, 2024 1 commit
- [Frontend][Core] Update Outlines Integration from `FSM` to `Guide` (#4109) · 7b0a0dfb
  Breno Faria authored Jun 06, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Breno Faria <breno.faria@intrafind.com>
```
  7b0a0dfb
03 Jun, 2024 1 commit
- [Core] Support image processor (#4197) · 7a64d24a
  Cyrus Leung authored Jun 03, 2024
  
  7a64d24a
17 May, 2024 1 commit
- [Bugfix] Relax tiktoken to >= 0.6.0 (#4890) · 86b45ae0
  Michael Goin authored May 17, 2024
  
  86b45ae0
15 May, 2024 1 commit
- [Frontend] Support OpenAI batch file format (#4794) · 52f8107c
  Alex Wu authored May 15, 2024
```
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
```
  52f8107c
06 May, 2024 1 commit
- Update lm-format-enforcer to 0.10.1 (#4631) · bd99d226
  Noam Gat authored May 07, 2024
  
  bd99d226
28 Apr, 2024 1 commit

Add more Prometheus metrics (#2764) · bf480c53

Ronen Schaffer authored Apr 29, 2024


Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

bf480c53

27 Apr, 2024 1 commit
- [Frontend][Bugfix] Disallow extra fields in OpenAI API (#4355) · 8947bc3c
  Cyrus Leung authored Apr 27, 2024
  
  8947bc3c
20 Apr, 2024 1 commit
- Updating lm-format-enforcer version and adding links to decoding libraries in docs (#4222) · cc74b2b2
  Noam Gat authored Apr 20, 2024
  
  cc74b2b2
18 Apr, 2024 1 commit
- [Misc] Bump transformers to latest version (#4176) · 87fa80c9
  Nick Hill authored Apr 18, 2024
  
  87fa80c9
16 Apr, 2024 1 commit
- LM Format Enforcer Guided Decoding Support (#3868) · 05434764
  Noam Gat authored Apr 16, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  05434764
15 Apr, 2024 1 commit
- [Bugfix] Fix filelock version requirement (#4075) · e11e2007
  Zhuohan Li authored Apr 14, 2024
  
  e11e2007
12 Apr, 2024 1 commit
- [mypy] Add mypy type annotation part 1 (#4006) · 09473ee4
  SangBin Cho authored Apr 13, 2024
  
  09473ee4
05 Apr, 2024 3 commits
- [Chunked Prefill][4/n] Chunked prefill scheduler. (#3853) · 18de8834
  SangBin Cho authored Apr 06, 2024
  
  18de8834
- [Misc] Define common requirements (#3841) · cfaf49a1
  Woosuk Kwon authored Apr 05, 2024
  
  cfaf49a1
- [Bugfix] Fixing requirements.txt (#3865) · 9edec652
  Noam Gat authored Apr 05, 2024
  
  9edec652
04 Apr, 2024 1 commit
- [Core] manage nccl via a pypi package & upgrade to pt 2.2.1 (#3805) · ca81ff51
  youkaichao authored Apr 04, 2024
  
  ca81ff51
01 Apr, 2024 1 commit
- [Misc] Minor fixes in requirements.txt (#3769) · f03cc667
  Woosuk Kwon authored Apr 01, 2024
  
  f03cc667
29 Mar, 2024 1 commit
- Usage Stats Collection (#2852) · d8658c8c
  yhu422 authored Mar 28, 2024
  
  d8658c8c
27 Mar, 2024 1 commit
- [Model] Add support for DBRX (#3660) · e24336b5
  Megha Agarwal authored Mar 27, 2024
  
  e24336b5