Commits · 9da25a88aa35da4b5ad7da545e6189e08c5f52f4 · OpenDAS / vllm_cscc · GitLab

05 Sep, 2024 2 commits
- [MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029) · 9da25a88
  Alex Brooks authored Sep 05, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9da25a88
- [Doc] Indicate more information about supported modalities (#8181) · 288a9388
  Cyrus Leung authored Sep 05, 2024
  
  288a9388
04 Sep, 2024 2 commits
- [Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649) · e02ce498
  Kyle Mistele authored Sep 04, 2024
```
Co-authored-by: constellate <constellate@1-ai-appserver-staging.codereach.com>
Co-authored-by: Kyle Mistele <kyle@constellate.ai>
```
  e02ce498
- [TPU][Bugfix] Use XLA rank for persistent cache path (#8137) · 61f4a93d
  Woosuk Kwon authored Sep 03, 2024
  
  61f4a93d
30 Aug, 2024 3 commits
- [Model] Adding support for MSFT Phi-3.5-MoE (#7729) · 1248e850
  Wenxiang authored Aug 31, 2024
```
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Zeqi Lin <zelin@microsoft.com>
Co-authored-by: Zeqi Lin <Zeqi.Lin@microsoft.com>
```
  1248e850
- [Frontend]-config-cli-args (#7737) · 058344f8
  Kaunil Dhruv authored Aug 30, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Kaunil Dhruv <kaunil_dhruv@intuit.com>
```
  058344f8
- [MODEL] add Exaone model support (#7819) · dc13e993
  Yohan Na authored Aug 30, 2024
  
  dc13e993
28 Aug, 2024 4 commits
- [Doc] fix 404 link (#7966) · 8c56e57d
  Stas Bekman authored Aug 28, 2024
  
  8c56e57d
- [TPU] Upgrade PyTorch XLA nightly (#7967) · eeffde1a
  Woosuk Kwon authored Aug 28, 2024
  
  eeffde1a
- [Doc] fix the autoAWQ example (#7937) · 98c12cff
  Stas Bekman authored Aug 28, 2024
  
  98c12cff
- [Core][VLM] Stack multimodal tensors to represent multiple images within each prompt (#7902) · fab5f53e
  Peter Salas authored Aug 27, 2024
  
  fab5f53e
22 Aug, 2024 2 commits
- [Doc] Fix incorrect docs from #7615 (#7788) · 57792ed4
  Peter Salas authored Aug 22, 2024
  
  57792ed4
- [Model] Fix Phi-3.5-vision-instruct 'num_crops' issue (#7710) · df1a2113
  zifeitong authored Aug 21, 2024
  
  df1a2113
21 Aug, 2024 3 commits
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
- [misc] Add Torch profiler support (#7451) · dd53c4b0
  William Lin authored Aug 21, 2024
```
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  dd53c4b0
- [Doc] Section for Multimodal Language Models (#7719) · 45066412
  Roger Wang authored Aug 20, 2024
  
  45066412
20 Aug, 2024 1 commit
- [OpenVINO] Updated documentation (#7687) · 398521ad
  Ilya Lavrenov authored Aug 20, 2024
  
  398521ad
16 Aug, 2024 2 commits
- [Doc] Update quantization supported hardware table (#7595) · d4f0f17b
  Michael Goin authored Aug 16, 2024
  
  d4f0f17b
- [Doc] Add docs for llmcompressor INT8 and FP8 checkpoints (#7444) · b3f4e179
  Michael Goin authored Aug 16, 2024
  
  b3f4e179
14 Aug, 2024 4 commits
- llama_index serving integration documentation (#6973) · 22b39e11
  Kameshwara Pavan Kumar Mantha authored Aug 15, 2024
```
Co-authored-by: pavanmantha <pavan.mantha@thevaslabs.io>
```
  22b39e11
- [VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126) · 3f674a49
  Cyrus Leung authored Aug 15, 2024
  
  3f674a49
- [doc] update test script to include cudagraph (#7501) · 199adbb7
  youkaichao authored Aug 13, 2024
  
  199adbb7
- [Bugfix][Docs] Update list of mock imports (#7493) · dd164d72
  Cyrus Leung authored Aug 14, 2024
  
  dd164d72
13 Aug, 2024 3 commits
- [TPU] Support multi-host inference (#7457) · a08df832
  Woosuk Kwon authored Aug 13, 2024
  
  a08df832
- [Frontend][Core] Add plumbing to support audio language models (#7446) · 00c3d68e
  Peter Salas authored Aug 13, 2024
  
  00c3d68e
- Revert "[Doc] Update supported_hardware.rst (#7276)" (#7467) · e20233d3
  Woosuk Kwon authored Aug 13, 2024
  
  e20233d3
12 Aug, 2024 3 commits
- [Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208) · a046f863
  jon-chuang authored Aug 12, 2024
```
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  a046f863
- [Core][VLM] Support image embeddings as input (#6613) · e6e42e4b
  Roger Wang authored Aug 12, 2024
  
  e6e42e4b
- [Docs] Update readme (#7316) · f020a629
  Simon Mo authored Aug 11, 2024
  
  f020a629
11 Aug, 2024 2 commits
- [Doc] building vLLM with VLLM_TARGET_DEVICE=empty (#7403) · 02b1988b
  tomeras91 authored Aug 12, 2024
  
  02b1988b
- [TPU] Use mark_dynamic to reduce compilation time (#7340) · 90bab18f
  Woosuk Kwon authored Aug 10, 2024
  
  90bab18f
08 Aug, 2024 2 commits
- Add Skywork AI as Sponsor (#7314) · 5923532e
  Simon Mo authored Aug 08, 2024
  
  5923532e
- [Model] Rename MiniCPMVQwen2 to MiniCPMV2.6 (#7273) · 757ac70a
  Jee Jee Li authored Aug 08, 2024
  
  757ac70a
07 Aug, 2024 4 commits
- [Doc] Update supported_hardware.rst (#7276) · 6d944202
  Michael Goin authored Aug 07, 2024
  
  6d944202
- [Doc] add online speculative decoding example (#7243) · 0e12cd67
  Stas Bekman authored Aug 07, 2024
  
  0e12cd67
- [OpenVINO] migrate to latest dependencies versions (#7251) · 80cbe10c
  Ilya Lavrenov authored Aug 07, 2024
  
  80cbe10c
- [Doc] Mock new dependencies for documentation (#7245) · 2385c8f3
  Roger Wang authored Aug 06, 2024
  
  2385c8f3
05 Aug, 2024 2 commits
- [Doc] [SpecDecode] Update MLPSpeculator documentation (#7100) · 789937af
  Thomas Parnell authored Aug 06, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  789937af
- bump version to v0.5.4 (#7139) · 4db5176d
  Simon Mo authored Aug 05, 2024
  
  4db5176d
04 Aug, 2024 1 commit
- [Model]Refactor MiniCPMV (#7020) · 179a6a36
  Jee Jee Li authored Aug 04, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  179a6a36