Commits · 68988d4e0d8765901c51f07f9bfbda58f35f6f63 · OpenDAS / vllm_cscc

"csrc/vscode:/vscode.git/clone" did not exist on "c721b814e31d1646ce95bca2acf68fe285fdc34e"

26 Sep, 2024 1 commit
- [Misc] Update config loading for Qwen2-VL and remove Granite (#8837) · 4bb98f21
  Roger Wang authored Sep 26, 2024
  
  4bb98f21
25 Sep, 2024 6 commits
- [Doc] Update doc for Transformers 4.45 (#8817) · e2c6e0a8
  Roger Wang authored Sep 25, 2024
  
  e2c6e0a8
- [Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602
  Chen Zhang authored Sep 25, 2024
```
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  770ec602
- Revert "rename PromptInputs and inputs with backward compatibility (#8760) (#8810) · 4f1ba084
  Simon Mo authored Sep 25, 2024
  
  4f1ba084
- rename PromptInputs and inputs with backward compatibility (#8760) · 28e1299e
  Cyrus Leung authored Sep 26, 2024
  
  28e1299e
- [CI/Build][Bugfix][Doc][ROCm] CI fix and doc update after ROCm 6.2 upgrade (#8777) · 1c046447
  Hongxia Yang authored Sep 25, 2024
  
  1c046447
- [[Misc]Upgrade bitsandbytes to the latest version 0.44.0 (#8768) · 13f9f7a3
  Jee Jee Li authored Sep 25, 2024
  
  13f9f7a3
24 Sep, 2024 2 commits
- Revert "[Core] Rename `PromptInputs` to `PromptType`, and `inputs` to `prompt`" (#8750) · 3185fb0c
  Simon Mo authored Sep 23, 2024
  
  3185fb0c
- [Hardware][AMD] ROCm6.2 upgrade (#8674) · 530821d0
  Hongxia Yang authored Sep 23, 2024
  
  530821d0
23 Sep, 2024 2 commits
- [CI/Build] use setuptools-scm to set __version__ (#4738) · ee5f34b1
  Daniele authored Sep 23, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  ee5f34b1
- [Bugfix] fix docker build for xpu (#8652) · d23679eb
  Yan Ma authored Sep 23, 2024
  
  d23679eb
22 Sep, 2024 2 commits

[build] enable existing pytorch (for GH200, aarch64, nightly) (#8713) · d4a2ac83
youkaichao authored Sep 22, 2024

d4a2ac83

[Model][VLM] Add LLaVA-Onevision model support (#8486) · 5b595327

litianjian authored Sep 23, 2024


Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

5b595327

21 Sep, 2024 2 commits
- [Doc] Fix typo in AMD installation guide (#8689) · 4dfdf431
  Andy Dai authored Sep 21, 2024
  
  4dfdf431
- [Core] Rename `PromptInputs` and `inputs`(#8673) · 0057894e
  Cyrus Leung authored Sep 21, 2024
  
  0057894e
20 Sep, 2024 3 commits
- [Doc] neuron documentation update (#8671) · 7c8566aa
  omrishiv authored Sep 20, 2024
```
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
```
  7c8566aa
- [Model] Add OLMoE (#7922) · 3b63de93
  Niklas Muennighoff authored Sep 20, 2024
  
  3b63de93
- [Core] Support Lora lineage and base model metadata management (#6315) · 260d40b5
  Jiaxin Shan authored Sep 19, 2024
  
  260d40b5
19 Sep, 2024 1 commit
- [Doc] Add documentation for GGUF quantization (#8618) · ea4647b7
  Isotr0py authored Sep 20, 2024
  
  ea4647b7
18 Sep, 2024 2 commits

[Model] Support Solar Model (#8386) · e18749ff
Geun, Lim authored Sep 19, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
e18749ff

[Core][Bugfix][Perf] Introduce `MQLLMEngine` to avoid `asyncio` OH (#8157) · 7c7714d8

Alexander Matveev authored Sep 18, 2024


Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

7c7714d8

17 Sep, 2024 1 commit
- [doc] improve installation doc (#8550) · fa0c114f
  youkaichao authored Sep 17, 2024
```
Co-authored-by: Andy Dai <76841985+Imss27@users.noreply.github.com>
```
  fa0c114f
16 Sep, 2024 1 commit
- [doc] update doc on testing and debugging (#8514) · 2759a43a
  youkaichao authored Sep 16, 2024
  
  2759a43a
14 Sep, 2024 1 commit
- [Model] support minicpm3 (#8297) · 8a0cf1dd
  ywfang authored Sep 14, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a0cf1dd
13 Sep, 2024 3 commits
- [Doc] Add oneDNN installation to CPU backend documentation (#8467) · f57092c0
  Isotr0py authored Sep 14, 2024
  
  f57092c0
- [CI/Build] Reorganize models tests (#7820) · a84e598e
  Cyrus Leung authored Sep 14, 2024
  
  a84e598e
- [doc] recommend pip instead of conda (#8446) · cab69a15
  youkaichao authored Sep 12, 2024
  
  cab69a15
12 Sep, 2024 1 commit

[Model] Support multiple images for qwen-vl (#8247) · c6202dae

Alex Brooks authored Sep 12, 2024


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

c6202dae

11 Sep, 2024 3 commits

Pixtral (#8377) · d394787e
Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
d394787e

[Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77

Yang Fan authored Sep 12, 2024


Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

3b7fea77

[model] Support for Llava-Next-Video model (#7559) · 6a512a00

Yangshen⚡Deng authored Sep 11, 2024


Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

6a512a00

10 Sep, 2024 1 commit
- Add NVIDIA Meetup slides, announce AMD meetup, and add contact info (#8319) · a1d87422
  Simon Mo authored Sep 09, 2024
  
  a1d87422
07 Sep, 2024 3 commits
- [Model][VLM] Support multi-images inputs for InternVL2 models (#8201) · e8071259
  Isotr0py authored Sep 07, 2024
  
  e8071259
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb
- [misc] [doc] [frontend] LLM torch profiler support (#7943) · 12dd7158
  William Lin authored Sep 06, 2024
  
  12dd7158
06 Sep, 2024 2 commits
- [Misc] Remove `SqueezeLLM` (#8220) · 23f32229
  Dipika Sikka authored Sep 06, 2024
  
  23f32229
- [Core] Support load and unload LoRA in api server (#6566) · db3bf7c9
  Jiaxin Shan authored Sep 05, 2024
```
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db3bf7c9
05 Sep, 2024 3 commits
- [Documentation][Spec Decode] Add documentation about lossless guarantees in... · 2febcf27
  sroy745 authored Sep 05, 2024
```
[Documentation][Spec Decode] Add documentation about lossless guarantees in Speculative Decoding in vLLM (#7962)
```
  2febcf27
- [MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029) · 9da25a88
  Alex Brooks authored Sep 05, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9da25a88
- [Doc] Indicate more information about supported modalities (#8181) · 288a9388
  Cyrus Leung authored Sep 05, 2024
  
  288a9388