Commits · edd5fe5fa29b8f9cc5fa37a30cc7211e0ff37067 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "493c275352bddf7d4877602e19b8bd29d662de63"

22 Jun, 2024 1 commit
- [Docs][TPU] Add installation tip for TPU (#5761) · 8c00f9c1
  Woosuk Kwon authored Jun 21, 2024
  
  8c00f9c1
21 Jun, 2024 1 commit
- [Doc] Documentation on supported hardware for quantization methods (#5745) · 5b15bde5
  Michael Goin authored Jun 21, 2024
  
  5b15bde5
20 Jun, 2024 1 commit
- [Bugfix][Doc] FIx Duplicate Explicit Target Name Errors (#5703) · 1b2eaac3
  Roger Wang authored Jun 19, 2024
  
  1b2eaac3
19 Jun, 2024 1 commit
- [Doc] Update docker references (#5614) · e83db9e7
  Rafael Vasquez authored Jun 19, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  e83db9e7
18 Jun, 2024 2 commits
- [Doc] Added cerebrium as Integration option (#5553) · 2bd231a7
  milo157 authored Jun 18, 2024
  
  2bd231a7
- [Model] Initialize Phi-3-vision support (#4986) · daef218b
  Isotr0py authored Jun 18, 2024
  
  daef218b
17 Jun, 2024 2 commits
- [Hardware][Intel GPU] Add Intel GPU(XPU) inference backend (#3814) · 728c4c8a
  Kunshang Ji authored Jun 18, 2024
```
Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Abhilash Majumder <abhilash.majumder@intel.com>
Co-authored-by: Abhilash Majumder <30946547+abhilash1910@users.noreply.github.com>
```
  728c4c8a
- [Doc] add debugging tips for crash and multi-node debugging (#5581) · 845a3f26
  youkaichao authored Jun 16, 2024
  
  845a3f26
14 Jun, 2024 2 commits
- [Doc] Update documentation on Tensorizer (#5471) · 6e2527a7
  Sanger Steel authored Jun 14, 2024
  
  6e2527a7
- [Docs] Add ZhenFund as a Sponsor (#5548) · cdab68dc
  Simon Mo authored Jun 14, 2024
  
  cdab68dc
13 Jun, 2024 3 commits
- [Doc] Update LLaVA docs (#5437) · 0ce7b952
  Cyrus Leung authored Jun 14, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  0ce7b952
- [Docs] Add 4th meetup slides (#5509) · a65634d3
  Woosuk Kwon authored Jun 13, 2024
  
  a65634d3
- [Hardware][Intel] Optimize CPU backend and add more performance tips (#4971) · 80aa7e91
  Li, Jiang authored Jun 14, 2024
```
Co-authored-by: Jianan Gu <jianan.gu@intel.com>
```
  80aa7e91
12 Jun, 2024 2 commits
- [Doc] Update debug docs (#5438) · b8d4dfff
  Cyrus Leung authored Jun 13, 2024
  
  b8d4dfff
- [Hardware] Initial TPU integration (#5292) · 1a8bfd92
  Woosuk Kwon authored Jun 12, 2024
  
  1a8bfd92
11 Jun, 2024 9 commits
- [Doc] add common case for long waiting time (#5430) · 8f89d720
  youkaichao authored Jun 11, 2024
  
  8f89d720
- [Core][Doc] Default to multiprocessing for single-node distributed case (#5230) · 99dac099
  Nick Hill authored Jun 11, 2024
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  99dac099
- [Docs] [Spec decode] Fix docs error in code example (#5427) · 89ec06c3
  Cade Daniel authored Jun 11, 2024
  
  89ec06c3
- [Doc] Add an automatic prefix caching section in vllm documentation (#5324) · 9fde251b
  Kuntai Du authored Jun 11, 2024
```
Co-authored-by: simon-mo <simon.mo@hey.com>
```
  9fde251b
- [Speculative decoding] Initial spec decode docs (#5400) · 4c2ffb28
  Cade Daniel authored Jun 11, 2024
  
  4c2ffb28
- [CI] docfix (#5410) · 246598a6
  SangBin Cho authored Jun 11, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: ywang96 <ywang@roblox.com>
```
  246598a6
- [Doc][Typo] Fixing Missing Comma (#5403) · 3c4cebf7
  Roger Wang authored Jun 11, 2024
  
  3c4cebf7
- [Doc] add debugging tips (#5409) · d8f31f2f
  youkaichao authored Jun 10, 2024
  
  d8f31f2f
- [Doc] Add documentation for FP8 W8A8 (#5388) · 77c87beb
  Michael Goin authored Jun 10, 2024
  
  77c87beb
10 Jun, 2024 3 commits
- [Docs] Alphabetically sort sponsors (#5386) · cb77ad83
  Woosuk Kwon authored Jun 10, 2024
  
  cb77ad83
- [Docs] Add Docs on Limitations of VLM Support (#5383) · 856c9900
  Roger Wang authored Jun 10, 2024
  
  856c9900
- [Model] Initial support for LLaVA-NeXT (#4199) · 6b29d6fe
  Cyrus Leung authored Jun 10, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  6b29d6fe
07 Jun, 2024 1 commit
- [Frontend] Add OpenAI Vision API Support (#5237) · 7a9cb294
  Roger Wang authored Jun 07, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7a9cb294
05 Jun, 2024 1 commit
- [Docs] Add Sequoia as sponsors (#5287) · f270a395
  Simon Mo authored Jun 05, 2024
  
  f270a395
04 Jun, 2024 1 commit
- [Bugfix] Fix a bug caused by pip install setuptools>=49.4.0 for CPU backend (#5249) · 87d5abef
  Jie Fu (傅杰) authored Jun 05, 2024
  
  87d5abef
03 Jun, 2024 2 commits
- [FRONTEND] OpenAI `tools` support named functions (#5032) · f775a07e
  Breno Faria authored Jun 04, 2024
  
  f775a07e
- [Core] Support image processor (#4197) · 7a64d24a
  Cyrus Leung authored Jun 03, 2024
  
  7a64d24a
01 Jun, 2024 1 commit
- [Doc] Add checkmark for GPTBigCodeForCausalLM LoRA support (#5171) · 65757911
  Nick Hill authored May 31, 2024
  
  65757911
30 May, 2024 2 commits
- add doc about serving option on dstack (#3074) · 429d8972
  Chansung Park authored May 31, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  429d8972
- [Doc] Use intersphinx and update entrypoints docs (#5125) · a9bcc7af
  Cyrus Leung authored May 31, 2024
  
  a9bcc7af
29 May, 2024 1 commit
- [Doc][Build] update after removing vllm-nccl (#5103) · 4fbcb0f2
  youkaichao authored May 29, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  4fbcb0f2
28 May, 2024 2 commits
- [Core] Consolidate prompt arguments to LLM engines (#4328) · 5ae5ed1e
  Cyrus Leung authored May 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  5ae5ed1e
- [Docs] Add Dropbox as sponsors (#5089) · 290f4ada
  Simon Mo authored May 28, 2024
  
  290f4ada
25 May, 2024 1 commit

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9

23 May, 2024 1 commit
- [Doc] add ccache guide in doc (#5012) · 6a50f4ca
  youkaichao authored May 23, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  6a50f4ca