Commits · 4851c202bbfb5dadc5a3b3b4409d3f083f4e8e90 · OpenDAS / vllm_cscc

11 Sep, 2024 3 commits

Pixtral (#8377) · d394787e
Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
d394787e

[Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77

Yang Fan authored Sep 12, 2024


Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

3b7fea77

[model] Support for Llava-Next-Video model (#7559) · 6a512a00

Yangshen⚡Deng authored Sep 11, 2024


Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

6a512a00

10 Sep, 2024 1 commit
- Add NVIDIA Meetup slides, announce AMD meetup, and add contact info (#8319) · a1d87422
  Simon Mo authored Sep 09, 2024
  
  a1d87422
07 Sep, 2024 3 commits
- [Model][VLM] Support multi-images inputs for InternVL2 models (#8201) · e8071259
  Isotr0py authored Sep 07, 2024
  
  e8071259
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb
- [misc] [doc] [frontend] LLM torch profiler support (#7943) · 12dd7158
  William Lin authored Sep 06, 2024
  
  12dd7158
06 Sep, 2024 2 commits
- [Misc] Remove `SqueezeLLM` (#8220) · 23f32229
  Dipika Sikka authored Sep 06, 2024
  
  23f32229
- [Core] Support load and unload LoRA in api server (#6566) · db3bf7c9
  Jiaxin Shan authored Sep 05, 2024
```
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db3bf7c9
05 Sep, 2024 3 commits
- [Documentation][Spec Decode] Add documentation about lossless guarantees in... · 2febcf27
  sroy745 authored Sep 05, 2024
```
[Documentation][Spec Decode] Add documentation about lossless guarantees in Speculative Decoding in vLLM (#7962)
```
  2febcf27
- [MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029) · 9da25a88
  Alex Brooks authored Sep 05, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9da25a88
- [Doc] Indicate more information about supported modalities (#8181) · 288a9388
  Cyrus Leung authored Sep 05, 2024
  
  288a9388
04 Sep, 2024 2 commits
- [Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649) · e02ce498
  Kyle Mistele authored Sep 04, 2024
```
Co-authored-by: constellate <constellate@1-ai-appserver-staging.codereach.com>
Co-authored-by: Kyle Mistele <kyle@constellate.ai>
```
  e02ce498
- [TPU][Bugfix] Use XLA rank for persistent cache path (#8137) · 61f4a93d
  Woosuk Kwon authored Sep 03, 2024
  
  61f4a93d
30 Aug, 2024 3 commits
- [Model] Adding support for MSFT Phi-3.5-MoE (#7729) · 1248e850
  Wenxiang authored Aug 31, 2024
```
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Zeqi Lin <zelin@microsoft.com>
Co-authored-by: Zeqi Lin <Zeqi.Lin@microsoft.com>
```
  1248e850
- [Frontend]-config-cli-args (#7737) · 058344f8
  Kaunil Dhruv authored Aug 30, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Kaunil Dhruv <kaunil_dhruv@intuit.com>
```
  058344f8
- [MODEL] add Exaone model support (#7819) · dc13e993
  Yohan Na authored Aug 30, 2024
  
  dc13e993
28 Aug, 2024 4 commits
- [Doc] fix 404 link (#7966) · 8c56e57d
  Stas Bekman authored Aug 28, 2024
  
  8c56e57d
- [TPU] Upgrade PyTorch XLA nightly (#7967) · eeffde1a
  Woosuk Kwon authored Aug 28, 2024
  
  eeffde1a
- [Doc] fix the autoAWQ example (#7937) · 98c12cff
  Stas Bekman authored Aug 28, 2024
  
  98c12cff
- [Core][VLM] Stack multimodal tensors to represent multiple images within each prompt (#7902) · fab5f53e
  Peter Salas authored Aug 27, 2024
  
  fab5f53e
22 Aug, 2024 2 commits
- [Doc] Fix incorrect docs from #7615 (#7788) · 57792ed4
  Peter Salas authored Aug 22, 2024
  
  57792ed4
- [Model] Fix Phi-3.5-vision-instruct 'num_crops' issue (#7710) · df1a2113
  zifeitong authored Aug 21, 2024
  
  df1a2113
21 Aug, 2024 3 commits
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
- [misc] Add Torch profiler support (#7451) · dd53c4b0
  William Lin authored Aug 21, 2024
```
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  dd53c4b0
- [Doc] Section for Multimodal Language Models (#7719) · 45066412
  Roger Wang authored Aug 20, 2024
  
  45066412
20 Aug, 2024 1 commit
- [OpenVINO] Updated documentation (#7687) · 398521ad
  Ilya Lavrenov authored Aug 20, 2024
  
  398521ad
16 Aug, 2024 2 commits
- [Doc] Update quantization supported hardware table (#7595) · d4f0f17b
  Michael Goin authored Aug 16, 2024
  
  d4f0f17b
- [Doc] Add docs for llmcompressor INT8 and FP8 checkpoints (#7444) · b3f4e179
  Michael Goin authored Aug 16, 2024
  
  b3f4e179
14 Aug, 2024 4 commits
- llama_index serving integration documentation (#6973) · 22b39e11
  Kameshwara Pavan Kumar Mantha authored Aug 15, 2024
```
Co-authored-by: pavanmantha <pavan.mantha@thevaslabs.io>
```
  22b39e11
- [VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126) · 3f674a49
  Cyrus Leung authored Aug 15, 2024
  
  3f674a49
- [doc] update test script to include cudagraph (#7501) · 199adbb7
  youkaichao authored Aug 13, 2024
  
  199adbb7
- [Bugfix][Docs] Update list of mock imports (#7493) · dd164d72
  Cyrus Leung authored Aug 14, 2024
  
  dd164d72
13 Aug, 2024 3 commits
- [TPU] Support multi-host inference (#7457) · a08df832
  Woosuk Kwon authored Aug 13, 2024
  
  a08df832
- [Frontend][Core] Add plumbing to support audio language models (#7446) · 00c3d68e
  Peter Salas authored Aug 13, 2024
  
  00c3d68e
- Revert "[Doc] Update supported_hardware.rst (#7276)" (#7467) · e20233d3
  Woosuk Kwon authored Aug 13, 2024
  
  e20233d3
12 Aug, 2024 3 commits
- [Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208) · a046f863
  jon-chuang authored Aug 12, 2024
```
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  a046f863
- [Core][VLM] Support image embeddings as input (#6613) · e6e42e4b
  Roger Wang authored Aug 12, 2024
  
  e6e42e4b
- [Docs] Update readme (#7316) · f020a629
  Simon Mo authored Aug 11, 2024
  
  f020a629
11 Aug, 2024 1 commit
- [Doc] building vLLM with VLLM_TARGET_DEVICE=empty (#7403) · 02b1988b
  tomeras91 authored Aug 12, 2024
  
  02b1988b