Commits · 3dcb3e8b9838cbbef83ce326b1a35b31a3cf14f2 · OpenDAS / vllm_cscc

02 Apr, 2024 1 commit

[Hardware][Intel] Add CPU inference backend (#3634) · 0e3f06fe

bigPYJ1151 authored Apr 02, 2024


Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yuan Zhou <yuan.zhou@intel.com>

0e3f06fe

29 Mar, 2024 1 commit
- Usage Stats Collection (#2852) · d8658c8c
  yhu422 authored Mar 28, 2024
  
  d8658c8c
19 Mar, 2024 1 commit
- [Doc] Add docs about OpenAI compatible server (#3288) · ef65dcfa
  Simon Mo authored Mar 18, 2024
  
  ef65dcfa
12 Mar, 2024 1 commit
- docs: Add BentoML deployment doc (#3336) · b0925b38
  Sherlock Xu authored Mar 13, 2024
```
Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>
```
  b0925b38
04 Mar, 2024 2 commits
- Add document for vllm paged attention kernel. (#2978) · 27a7b070
  Jialun Lyu authored Mar 04, 2024
  
  27a7b070
- [DOC] add setup document to support neuron backend (#2777) · d0fae881
  Liangfu Chen authored Mar 03, 2024
  
  d0fae881
01 Mar, 2024 1 commit
- docs: Add tutorial on deploying vLLM model with KServe (#2586) · 49d849b3
  Yuan Tang authored Mar 01, 2024
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  49d849b3
13 Feb, 2024 1 commit
- [CI] Ensure documentation build is checked in CI (#2842) · f9644932
  Simon Mo authored Feb 12, 2024
  
  f9644932
12 Feb, 2024 1 commit
- Add documentation section about LoRA (#2834) · 4ca2c358
  Philipp Moritz authored Feb 12, 2024
  
  4ca2c358
31 Jan, 2024 1 commit
- Bump up version to v0.3.0 (#2656) · 1af090b5
  Zhuohan Li authored Jan 31, 2024
  
  1af090b5
12 Jan, 2024 1 commit
- [DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011) · 6549aef2
  Jiaxiang authored Jan 12, 2024
  
  6549aef2
17 Dec, 2023 1 commit
- [Docs] Add CUDA graph support to docs (#2148) · 26c52a5e
  Woosuk Kwon authored Dec 17, 2023
  
  26c52a5e
15 Dec, 2023 1 commit
- [Docs] Add supported quantization methods to docs (#2135) · b81a6a6b
  Woosuk Kwon authored Dec 15, 2023
  
  b81a6a6b
08 Dec, 2023 1 commit

Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836) · 6ccc0bff

TJian authored Dec 08, 2023


Co-authored-by: Philipp Moritz <pcmoritz@gmail.com>
Co-authored-by: Amir Balwel <amoooori04@gmail.com>
Co-authored-by: root <kuanfu.liu@akirakan.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kuanfu <kuanfu.liu@embeddedllm.com>
Co-authored-by: miloice <17350011+kliuae@users.noreply.github.com>

6ccc0bff

03 Dec, 2023 1 commit
- Add Production Metrics in Prometheus format (#1890) · 5313c2cb
  Simon Mo authored Dec 02, 2023
  
  5313c2cb
30 Nov, 2023 1 commit
- docs: add instruction for langchain (#1162) · 05a38612
  Massimiliano Pronesti authored Nov 30, 2023
  
  05a38612
22 Nov, 2023 1 commit
- [DOCS] Add engine args documentation (#1741) · a921d8be
  Casper authored Nov 22, 2023
  
  a921d8be
05 Nov, 2023 1 commit
- Add Quantization and AutoAWQ to docs (#1235) · 85169994
  Casper authored Nov 05, 2023
  
  85169994
31 Oct, 2023 1 commit
- Add Dockerfile (#1350) · 9cabcb76
  Stephen Krider authored Oct 31, 2023
  
  9cabcb76
20 Sep, 2023 1 commit
- Add documentation to Triton server tutorial (#983) · 6f2dd6c3
  Tanmay Verma authored Sep 20, 2023
  
  6f2dd6c3
14 Sep, 2023 1 commit
- Announce paper release (#1036) · eda1a7ca
  Woosuk Kwon authored Sep 13, 2023
  
  eda1a7ca
16 Jul, 2023 1 commit
- [Doc] Add doc for running vLLM on the cloud (#426) · 58df2883
  Zhanghao Wu authored Jul 16, 2023
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  58df2883
26 Jun, 2023 1 commit
- [Doc] Documentation for distributed inference (#261) · 2cf1a333
  Zhuohan Li authored Jun 26, 2023
  
  2cf1a333
20 Jun, 2023 4 commits
- [Minor] Fix URLs (#166) · 794e578d
  Woosuk Kwon authored Jun 19, 2023
  
  794e578d
- [Minor] Fix icons in doc (#165) · caddfc14
  Woosuk Kwon authored Jun 19, 2023
  
  caddfc14
- Fix repo & documentation URLs (#163) · b7e62d34
  Woosuk Kwon authored Jun 19, 2023
  
  b7e62d34
- [Docs] Minor fix (#162) · 364536ac
  Woosuk Kwon authored Jun 19, 2023
  
  364536ac
19 Jun, 2023 1 commit
- Add logo and polish readme (#156) · a255885f
  Zhuohan Li authored Jun 19, 2023
  
  a255885f
18 Jun, 2023 1 commit
- Write README and front page of doc (#147) · dcda03b4
  Woosuk Kwon authored Jun 18, 2023
  
  dcda03b4
17 Jun, 2023 2 commits
- Add quickstart guide (#148) · bec7b2dc
  Zhuohan Li authored Jun 18, 2023
  
  bec7b2dc
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
03 Jun, 2023 1 commit
- Document supported models (#127) · 62ec38ea
  Woosuk Kwon authored Jun 02, 2023
  
  62ec38ea
23 May, 2023 1 commit
- Add initial sphinx docs (#120) · 19d28994
  Woosuk Kwon authored May 22, 2023
  
  19d28994