Commits · 2759a43a26e4eecb7ff7d741c2b6da0d544462ad · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "b8a45721576e8cc0a0a6b8f82e7aec423068dc64"

16 Sep, 2024 1 commit
- [doc] update doc on testing and debugging (#8514) · 2759a43a
  youkaichao authored Sep 16, 2024
  
  2759a43a
14 Sep, 2024 1 commit
- [Model] support minicpm3 (#8297) · 8a0cf1dd
  ywfang authored Sep 14, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a0cf1dd
13 Sep, 2024 3 commits
- [Doc] Add oneDNN installation to CPU backend documentation (#8467) · f57092c0
  Isotr0py authored Sep 14, 2024
  
  f57092c0
- [CI/Build] Reorganize models tests (#7820) · a84e598e
  Cyrus Leung authored Sep 14, 2024
  
  a84e598e
- [doc] recommend pip instead of conda (#8446) · cab69a15
  youkaichao authored Sep 12, 2024
  
  cab69a15
12 Sep, 2024 1 commit

[Model] Support multiple images for qwen-vl (#8247) · c6202dae

Alex Brooks authored Sep 12, 2024


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

c6202dae

11 Sep, 2024 3 commits

Pixtral (#8377) · d394787e
Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
d394787e

[Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77

Yang Fan authored Sep 12, 2024


Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

3b7fea77

[model] Support for Llava-Next-Video model (#7559) · 6a512a00

Yangshen⚡Deng authored Sep 11, 2024


Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

6a512a00

10 Sep, 2024 1 commit
- Add NVIDIA Meetup slides, announce AMD meetup, and add contact info (#8319) · a1d87422
  Simon Mo authored Sep 09, 2024
  
  a1d87422
07 Sep, 2024 3 commits
- [Model][VLM] Support multi-images inputs for InternVL2 models (#8201) · e8071259
  Isotr0py authored Sep 07, 2024
  
  e8071259
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb
- [misc] [doc] [frontend] LLM torch profiler support (#7943) · 12dd7158
  William Lin authored Sep 06, 2024
  
  12dd7158
06 Sep, 2024 2 commits
- [Misc] Remove `SqueezeLLM` (#8220) · 23f32229
  Dipika Sikka authored Sep 06, 2024
  
  23f32229
- [Core] Support load and unload LoRA in api server (#6566) · db3bf7c9
  Jiaxin Shan authored Sep 05, 2024
```
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db3bf7c9
05 Sep, 2024 3 commits
- [Documentation][Spec Decode] Add documentation about lossless guarantees in... · 2febcf27
  sroy745 authored Sep 05, 2024
```
[Documentation][Spec Decode] Add documentation about lossless guarantees in Speculative Decoding in vLLM (#7962)
```
  2febcf27
- [MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029) · 9da25a88
  Alex Brooks authored Sep 05, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9da25a88
- [Doc] Indicate more information about supported modalities (#8181) · 288a9388
  Cyrus Leung authored Sep 05, 2024
  
  288a9388
04 Sep, 2024 2 commits
- [Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649) · e02ce498
  Kyle Mistele authored Sep 04, 2024
```
Co-authored-by: constellate <constellate@1-ai-appserver-staging.codereach.com>
Co-authored-by: Kyle Mistele <kyle@constellate.ai>
```
  e02ce498
- [TPU][Bugfix] Use XLA rank for persistent cache path (#8137) · 61f4a93d
  Woosuk Kwon authored Sep 03, 2024
  
  61f4a93d
30 Aug, 2024 3 commits
- [Model] Adding support for MSFT Phi-3.5-MoE (#7729) · 1248e850
  Wenxiang authored Aug 31, 2024
```
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Zeqi Lin <zelin@microsoft.com>
Co-authored-by: Zeqi Lin <Zeqi.Lin@microsoft.com>
```
  1248e850
- [Frontend]-config-cli-args (#7737) · 058344f8
  Kaunil Dhruv authored Aug 30, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Kaunil Dhruv <kaunil_dhruv@intuit.com>
```
  058344f8
- [MODEL] add Exaone model support (#7819) · dc13e993
  Yohan Na authored Aug 30, 2024
  
  dc13e993
28 Aug, 2024 4 commits
- [Doc] fix 404 link (#7966) · 8c56e57d
  Stas Bekman authored Aug 28, 2024
  
  8c56e57d
- [TPU] Upgrade PyTorch XLA nightly (#7967) · eeffde1a
  Woosuk Kwon authored Aug 28, 2024
  
  eeffde1a
- [Doc] fix the autoAWQ example (#7937) · 98c12cff
  Stas Bekman authored Aug 28, 2024
  
  98c12cff
- [Core][VLM] Stack multimodal tensors to represent multiple images within each prompt (#7902) · fab5f53e
  Peter Salas authored Aug 27, 2024
  
  fab5f53e
27 Aug, 2024 1 commit
- [Model] Add Mistral Tokenization to improve robustness and chat encoding (#7739) · 6fc4e6e0
  Patrick von Platen authored Aug 27, 2024
  
  6fc4e6e0
22 Aug, 2024 2 commits
- [Doc] Fix incorrect docs from #7615 (#7788) · 57792ed4
  Peter Salas authored Aug 22, 2024
  
  57792ed4
- [Model] Fix Phi-3.5-vision-instruct 'num_crops' issue (#7710) · df1a2113
  zifeitong authored Aug 21, 2024
  
  df1a2113
21 Aug, 2024 4 commits
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
- [misc] Add Torch profiler support (#7451) · dd53c4b0
  William Lin authored Aug 21, 2024
```
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  dd53c4b0
- [mypy] Enable following imports for entrypoints (#7248) · baaedfdb
  Cyrus Leung authored Aug 21, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Fei <dfdfcai4@gmail.com>
```
  baaedfdb
- [Doc] Section for Multimodal Language Models (#7719) · 45066412
  Roger Wang authored Aug 20, 2024
  
  45066412
20 Aug, 2024 2 commits
- [OpenVINO] Updated documentation (#7687) · 398521ad
  Ilya Lavrenov authored Aug 20, 2024
  
  398521ad
- [doc] fix doc build error caused by msgspec (#7659) · e54ebc2f
  youkaichao authored Aug 19, 2024
  
  e54ebc2f
16 Aug, 2024 2 commits
- [Doc] Update quantization supported hardware table (#7595) · d4f0f17b
  Michael Goin authored Aug 16, 2024
  
  d4f0f17b
- [Doc] Add docs for llmcompressor INT8 and FP8 checkpoints (#7444) · b3f4e179
  Michael Goin authored Aug 16, 2024
  
  b3f4e179
14 Aug, 2024 2 commits
- llama_index serving integration documentation (#6973) · 22b39e11
  Kameshwara Pavan Kumar Mantha authored Aug 15, 2024
```
Co-authored-by: pavanmantha <pavan.mantha@thevaslabs.io>
```
  22b39e11
- [VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126) · 3f674a49
  Cyrus Leung authored Aug 15, 2024
  
  3f674a49