- 27 Jul, 2024 1 commit
-
-
Joe authored
-
- 24 Jul, 2024 1 commit
-
-
Antoni Baum authored
-
- 22 Jul, 2024 1 commit
-
-
Tyler Michael Smith authored
-
- 21 Jul, 2024 1 commit
-
-
Alexander Matveev authored
-
- 20 Jul, 2024 1 commit
-
-
Varun Sundar Rabindranath authored
Co-authored-by:Varun Sundar Rabindranth <varun@neuralmagic.com>
-
- 19 Jul, 2024 1 commit
-
-
Robert Shaw authored
-
- 18 Jul, 2024 1 commit
-
-
Varun Sundar Rabindranath authored
Co-authored-by:
-
- 16 Jul, 2024 1 commit
-
-
Michael Goin authored
-
- 11 Jul, 2024 1 commit
-
-
Robert Shaw authored
Co-authored-by:Robert Shaw <rshaw@neuralmagic.com>
-
- 08 Jul, 2024 1 commit
-
-
afeldman-nm authored
[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888) Co-authored-by:Woosuk Kwon <woosuk.kwon@berkeley.edu>
-
- 04 Jul, 2024 1 commit
-
-
Lily Liu authored
Co-authored-by:Simon Mo <simon.mo@hey.com>
-
- 03 Jul, 2024 2 commits
-
-
Michael Goin authored
-
youkaichao authored
-
- 02 Jul, 2024 1 commit
-
-
Robert Shaw authored
Co-authored-by:
Robert Shaw <rshaw@neuralmagic> Co-authored-by:
Michael Goin <michael@neuralmagic.com>
-
- 01 Jul, 2024 2 commits
-
-
Avshalom Manevich authored
-
youkaichao authored
-
- 28 Jun, 2024 2 commits
-
-
Tyler Michael Smith authored
-
Ilya Lavrenov authored
-
- 26 Jun, 2024 1 commit
-
-
Luka Govedič authored
Co-authored-by:
Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com> Co-authored-by:
Lucas Wilkinson <lwilkinson@neuralmagic.com>
-
- 15 Jun, 2024 1 commit
-
-
Cyrus Leung authored
-
- 13 Jun, 2024 1 commit
-
-
Tyler Michael Smith authored
Co-authored-by:
youkaichao <youkaichao@gmail.com> Co-authored-by:
zifeitong <zifei.tong@parasail.io> Co-authored-by:
Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
-
- 09 Jun, 2024 1 commit
-
-
bnellnm authored
-
- 07 Jun, 2024 1 commit
-
-
Dipika Sikka authored
Co-authored-by:
Varun Sundar Rabindranath <varunsundar08@gmail.com> Co-authored-by:
-
- 05 Jun, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 04 Jun, 2024 1 commit
-
-
afeldman-nm authored
[Bugfix]: During testing, use pytest monkeypatch for safely overriding the env var that indicates the vLLM backend (#5210)
-
- 03 Jun, 2024 1 commit
-
-
Tyler Michael Smith authored
-
- 01 Jun, 2024 2 commits
-
-
Varun Sundar Rabindranath authored
Co-authored-by:
-
Tyler Michael Smith authored
-
- 31 May, 2024 1 commit
-
-
SnowDist authored
Co-authored-by:Zhuohan Li <zhuohan123@gmail.com>
-
- 25 May, 2024 1 commit
-
-
Eric Xihui Lin authored
Co-authored-by:
beagleski <yunanzhang@microsoft.com> Co-authored-by:
bapatra <bapatra@microsoft.com> Co-authored-by:
Barun Patra <codedecde@users.noreply.github.com> Co-authored-by:
-
- 23 May, 2024 2 commits
-
-
Dipika Sikka authored
Co-authored-by:
-
Alexander Matveev authored
-
- 22 May, 2024 2 commits
-
-
Cody Yu authored
-
Tyler Michael Smith authored
Pass the CUDA stream into the CUTLASS GEMMs, to avoid future issues with CUDA graphs
-
- 20 May, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 19 May, 2024 1 commit
-
-
Alexander Matveev authored
-
- 17 May, 2024 1 commit
-
-
Jinzhen Lin authored
-
- 16 May, 2024 2 commits
-
-
Tyler Michael Smith authored
-
alexm-nm authored
-
- 15 May, 2024 1 commit
-
-
SangBin Cho authored
Lora 3 & 4 test seems to have illegal memory access failure after this commit; [2024-05-14 23:51:18,182 E 22 22] logging.cc:101: Unhandled exception: N3c105ErrorE. what(): CUDA error: an illegal memory access was encountered <br class="Apple-interchange-newline"> Exmaple: https://buildkite.com/vllm/ci/builds/7382#018f793d-1527-4e1c-ab59-c3a34ec55241 This reverts commit 1356df53. FILL IN THE PR DESCRIPTION HERE FIX #xxxx (link existing issues this PR will resolve)
-
