Commits · 9389380015b80c109b899a08840132780b9b3fc0 · OpenDAS / vllm_cscc

06 Jul, 2024 2 commits
- [Doc] Move guide for multimodal model and other improvements (#6168) · 93893800
  Cyrus Leung authored Jul 06, 2024
  
  93893800
- [Doc] Reorganize Supported Models by Type (#6167) · 175c43ec
  Roger Wang authored Jul 05, 2024
  
  175c43ec
05 Jul, 2024 1 commit
- [Docs] Fix readthedocs for tag build (#6158) · 79d406e9
  Simon Mo authored Jul 05, 2024
  
  79d406e9
04 Jul, 2024 2 commits
- [VLM] Calculate maximum number of multi-modal tokens by model (#6121) · ae96ef8f
  Cyrus Leung authored Jul 05, 2024
  
  ae96ef8f
- [misc][doc] try to add warning for latest html (#5979) · 27902d42
  youkaichao authored Jul 04, 2024
  
  27902d42
03 Jul, 2024 5 commits
- [doc][misc] bump up py version in installation doc (#6119) · 966fe721
  youkaichao authored Jul 03, 2024
  
  966fe721
- [vlm] Remove vision language config. (#6089) · d9e98f42
  xwjiang2010 authored Jul 03, 2024
```
Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  d9e98f42
- [Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin (#5975) · 47f0954a
  Michael Goin authored Jul 03, 2024
  
  47f0954a
- [Doc] Fix Mock Import (#6094) · f1c78138
  Roger Wang authored Jul 03, 2024
  
  f1c78138
- [Core] Dynamic image size support for VLMs (#5276) · 9831aec4
  Cyrus Leung authored Jul 03, 2024
```
Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: ywang96 <ywang@roblox.com>
Co-authored-by: xwjiang2010 <87673679+xwjiang2010@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  9831aec4
02 Jul, 2024 2 commits

[Model] Jamba support (#4115) · 9d6a8daa

Mor Zusman authored Jul 03, 2024


Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Erez Schwartz <erezs@ai21.com>
Co-authored-by: Mor Zusman <morz@ai21.com>
Co-authored-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Tomer Asida <tomera@ai21.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

9d6a8daa

[VLM] Remove `image_input_type` from VLM config (#5852) · 98d6682c

xwjiang2010 authored Jul 02, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

98d6682c

01 Jul, 2024 3 commits
- [Bugfix][Doc] Fix Doc Formatting (#6048) · 8e0817c2
  Roger Wang authored Jul 01, 2024
  
  8e0817c2
- add FAQ doc under 'serving' (#5946) · 83bdcb6a
  ning.zhang authored Jul 01, 2024
  
  83bdcb6a
- [doc][misc] remove deprecated api server in doc (#6037) · 4050d646
  youkaichao authored Jul 01, 2024
  
  4050d646
28 Jun, 2024 2 commits
- [Hardware][Intel] OpenVINO vLLM backend (#5379) · 57f09a41
  Ilya Lavrenov authored Jun 28, 2024
  
  57f09a41
- [Core] Registry for processing model inputs (#5214) · 5cbe8d15
  Cyrus Leung authored Jun 28, 2024
```
Co-authored-by: ywang96 <ywang@roblox.com>
```
  5cbe8d15
27 Jun, 2024 3 commits
- [Model] Add Gemma 2 (#5908) · 79c92c7c
  Woosuk Kwon authored Jun 27, 2024
  
  79c92c7c
- [doc][misc] add note for Kubernetes users (#5916) · 3fd02bda
  youkaichao authored Jun 27, 2024
  
  3fd02bda
- [Model] Add base class for LoRA-supported models (#5018) · 96354d6a
  Cyrus Leung authored Jun 27, 2024
  
  96354d6a
26 Jun, 2024 2 commits
- [doc] update usage of env var to avoid conflict (#5873) · 294104c3
  youkaichao authored Jun 26, 2024
  
  294104c3
- [Misc][Doc] Add Example of using OpenAI Server with VLM (#5832) · 3aa7b6cf
  Roger Wang authored Jun 25, 2024
  
  3aa7b6cf
25 Jun, 2024 3 commits
- [Hardware][AMD][CI/Build][Doc] Upgrade to ROCm 6.1, Dockerfile improvements, test fixes (#5422) · dd793d1d
  Matt Wong authored Jun 25, 2024
  
  dd793d1d
- [doc][distributed] add both gloo and nccl tests (#5834) · c18ebfdd
  youkaichao authored Jun 25, 2024
  
  c18ebfdd
- [Doc] Add notice about breaking changes to VLMs (#5818) · f23871e9
  Cyrus Leung authored Jun 25, 2024
  
  f23871e9
24 Jun, 2024 3 commits
- [Doc] Add Phi-3-medium to list of supported models (#5788) · 1744cc99
  Michael Goin authored Jun 24, 2024
  
  1744cc99
- [Doc] Add "Suggest edit" button to doc pages (#5789) · e72dc6cb
  Michael Goin authored Jun 24, 2024
  
  e72dc6cb
- [doc][faq] add warning to download models for every nodes (#5783) · c2462129
  youkaichao authored Jun 24, 2024
  
  c2462129
22 Jun, 2024 1 commit
- [Docs][TPU] Add installation tip for TPU (#5761) · 8c00f9c1
  Woosuk Kwon authored Jun 21, 2024
  
  8c00f9c1
21 Jun, 2024 1 commit
- [Doc] Documentation on supported hardware for quantization methods (#5745) · 5b15bde5
  Michael Goin authored Jun 21, 2024
  
  5b15bde5
20 Jun, 2024 1 commit
- [Bugfix][Doc] FIx Duplicate Explicit Target Name Errors (#5703) · 1b2eaac3
  Roger Wang authored Jun 19, 2024
  
  1b2eaac3
19 Jun, 2024 1 commit
- [Doc] Update docker references (#5614) · e83db9e7
  Rafael Vasquez authored Jun 19, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  e83db9e7
18 Jun, 2024 2 commits
- [Doc] Added cerebrium as Integration option (#5553) · 2bd231a7
  milo157 authored Jun 18, 2024
  
  2bd231a7
- [Model] Initialize Phi-3-vision support (#4986) · daef218b
  Isotr0py authored Jun 18, 2024
  
  daef218b
17 Jun, 2024 2 commits
- [Hardware][Intel GPU] Add Intel GPU(XPU) inference backend (#3814) · 728c4c8a
  Kunshang Ji authored Jun 18, 2024
```
Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Abhilash Majumder <abhilash.majumder@intel.com>
Co-authored-by: Abhilash Majumder <30946547+abhilash1910@users.noreply.github.com>
```
  728c4c8a
- [Doc] add debugging tips for crash and multi-node debugging (#5581) · 845a3f26
  youkaichao authored Jun 16, 2024
  
  845a3f26
14 Jun, 2024 2 commits
- [Doc] Update documentation on Tensorizer (#5471) · 6e2527a7
  Sanger Steel authored Jun 14, 2024
  
  6e2527a7
- [Docs] Add ZhenFund as a Sponsor (#5548) · cdab68dc
  Simon Mo authored Jun 14, 2024
  
  cdab68dc
13 Jun, 2024 2 commits
- [Doc] Update LLaVA docs (#5437) · 0ce7b952
  Cyrus Leung authored Jun 14, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  0ce7b952
- [Docs] Add 4th meetup slides (#5509) · a65634d3
  Woosuk Kwon authored Jun 13, 2024
  
  a65634d3