Commits · 64384bbcdfe6bdf4b50ff82bda90e728160325f5 · OpenDAS / vllm_cscc

18 Oct, 2024 1 commit
- [BugFix] Stop silent failures on compressed-tensors parsing (#9381) · 48138a84
  Dipika Sikka authored Oct 17, 2024
  
  48138a84
16 Oct, 2024 1 commit
- [Misc] Standardize RoPE handling for Qwen2-VL (#9250) · 7e7eae33
  Cyrus Leung authored Oct 16, 2024
  
  7e7eae33
15 Oct, 2024 1 commit
- [Misc] Directly use compressed-tensors for checkpoint definitions (#8909) · 22f8a695
  Michael Goin authored Oct 15, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  22f8a695
30 Sep, 2024 1 commit
- [Misc][CI/Build] Include `cv2` via `mistral_common[opencv]` (#8951) · b6d73925
  Roger Wang authored Sep 29, 2024
  
  b6d73925
28 Sep, 2024 1 commit

[Bugfix][Intel] Fix XPU Dockerfile Build (#7824) · 260024a3

Tyler Titsworth authored Sep 27, 2024


Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Co-authored-by: youkaichao <youkaichao@126.com>

260024a3

26 Sep, 2024 1 commit
- [Installation] Allow lower versions of FastAPI to maintain Ray 2.9 compatibility (#8764) · 1b49148e
  Cyrus Leung authored Sep 27, 2024
  
  1b49148e
25 Sep, 2024 1 commit

[Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602

Chen Zhang authored Sep 25, 2024


Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

770ec602

22 Sep, 2024 2 commits
- [misc] upgrade mistral-common (#8715) · 92ba7e74
  youkaichao authored Sep 22, 2024
  
  92ba7e74
- [build] enable existing pytorch (for GH200, aarch64, nightly) (#8713) · d4a2ac83
  youkaichao authored Sep 22, 2024
  
  d4a2ac83
17 Sep, 2024 1 commit
- [Bugfix] Fix 3.12 builds on main (#8510) · cca61642
  Joe Runde authored Sep 16, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cca61642
15 Sep, 2024 1 commit
- [Bugfix][Kernel] Add `IQ1_M` quantization implementation to GGUF kernel (#8357) · fc990f97
  Isotr0py authored Sep 16, 2024
  
  fc990f97
13 Sep, 2024 2 commits
- [Installation] Gate FastAPI version for Python 3.8 (#8456) · ecd7a1d5
  Cyrus Leung authored Sep 14, 2024
  
  ecd7a1d5
- [Bugfix] Bump fastapi and pydantic version (#8435) · 3f79bc3d
  Cyrus Leung authored Sep 13, 2024
  
  3f79bc3d
11 Sep, 2024 2 commits

Pixtral (#8377) · d394787e
Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
d394787e

[Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77

Yang Fan authored Sep 12, 2024


Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

3b7fea77

07 Sep, 2024 1 commit
- [CI/Build] Use python 3.12 in cuda image (#8133) · cfe712bf
  Joe Runde authored Sep 07, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cfe712bf
05 Sep, 2024 1 commit
- [bugfix] >1.43 constraint for openai (#8169) · 1afc9319
  William Lin authored Sep 04, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  1afc9319
04 Sep, 2024 1 commit

[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649) · e02ce498

Kyle Mistele authored Sep 04, 2024


Co-authored-by: constellate <constellate@1-ai-appserver-staging.codereach.com>
Co-authored-by: Kyle Mistele <kyle@constellate.ai>

e02ce498

01 Sep, 2024 1 commit
- [Misc] Optional installation of audio related packages (#8063) · 5b86b199
  Roger Wang authored Sep 01, 2024
  
  5b86b199
30 Aug, 2024 1 commit

[Frontend]-config-cli-args (#7737) · 058344f8

Kaunil Dhruv authored Aug 30, 2024


Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Kaunil Dhruv <kaunil_dhruv@intuit.com>

058344f8

27 Aug, 2024 1 commit
- [Model] Add Mistral Tokenization to improve robustness and chat encoding (#7739) · 6fc4e6e0
  Patrick von Platen authored Aug 27, 2024
  
  6fc4e6e0
21 Aug, 2024 1 commit
- [mypy] Enable following imports for entrypoints (#7248) · baaedfdb
  Cyrus Leung authored Aug 21, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Fei <dfdfcai4@gmail.com>
```
  baaedfdb
19 Aug, 2024 1 commit
- [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) · ff7ec82c
  SangBin Cho authored Aug 18, 2024
  
  ff7ec82c
17 Aug, 2024 1 commit
- [Bugfix] add >= 1.0 constraint for openai dependency (#7612) · 7c0b7ea2
  Xander Johnson authored Aug 16, 2024
  
  7c0b7ea2
15 Aug, 2024 1 commit
- [Misc] Update dockerfile for CPU to cover protobuf installation (#7182) · f4da5f7b
  PHILO-HE authored Aug 16, 2024
  
  f4da5f7b
14 Aug, 2024 1 commit
- [Misc] Revert `compressed-tensors` code reuse (#7521) · f55a9aea
  Kyle Sayers authored Aug 14, 2024
  
  f55a9aea
13 Aug, 2024 3 commits
- [misc][plugin] add plugin system implementation (#7426) · 16422ea7
  youkaichao authored Aug 13, 2024
  
  16422ea7
- [Misc] `compressed-tensors` code reuse (#7277) · 373538f9
  Kyle Sayers authored Aug 13, 2024
  
  373538f9
- [Frontend][Core] Add plumbing to support audio language models (#7446) · 00c3d68e
  Peter Salas authored Aug 13, 2024
  
  00c3d68e
12 Aug, 2024 1 commit
- [CI/Build] bump minimum cmake version (#6999) · 774cd1d3
  Daniele authored Aug 13, 2024
  
  774cd1d3
11 Aug, 2024 1 commit
- Updating LM Format Enforcer version to v0.10.6 (#7189) · 4fb7b52a
  Noam Gat authored Aug 11, 2024
  
  4fb7b52a
09 Aug, 2024 1 commit
- [Core] Support serving encoder/decoder models (#7258) · 7eb4a51c
  Cyrus Leung authored Aug 09, 2024
  
  7eb4a51c
05 Aug, 2024 1 commit
- [Core] Support loading GGUF model (#5191) · 360bd67c
  Isotr0py authored Aug 06, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  360bd67c
24 Jul, 2024 1 commit
- [Bugfix] Bump transformers to 4.43.2 (#6752) · 421e218b
  Michael Goin authored Jul 24, 2024
  
  421e218b
23 Jul, 2024 1 commit
- Bump `transformers` version for Llama 3.1 hotfix and patch Chameleon (#6690) · 1bedf210
  Roger Wang authored Jul 23, 2024
  
  1bedf210
13 Jul, 2024 1 commit
- Updating LM Format Enforcer version to v10.3 (#6411) · 9da4aad4
  Noam Gat authored Jul 13, 2024
  
  9da4aad4
12 Jul, 2024 1 commit
- [Misc][Bugfix] Update transformers for tokenizer issue (#6364) · f7160d94
  Roger Wang authored Jul 12, 2024
  
  f7160d94
11 Jul, 2024 1 commit
- [BugFix]: set outlines pkg version (#6262) · fc17110b
  Lim Xiang Yang authored Jul 11, 2024
  
  fc17110b
10 Jul, 2024 1 commit
- [core][distributed] zmq fallback for broadcasting large objects (#6183) · da78caec
  youkaichao authored Jul 09, 2024
```
[core][distributed] add zmq fallback for broadcasting large objects (#6183)
```
  da78caec
02 Jul, 2024 1 commit
- [Frontend] Add template related params to request (#5709) · 2c37540a
  danieljannai21 authored Jul 02, 2024
  
  2c37540a