Commits · d081da0064b5cda9e344f0fd519d67523a437a39 · OpenDAS / vllm_cscc

"vllm/entrypoints/openai/chat_completion/serving.py" did not exist on "34a984274eae2f8fb9d1d6413abd08d7fcde741c"

29 Sep, 2024 4 commits
- [Bugfix] Fix Marlin MoE act order when is_k_full == False (#8741) · d081da00
  ElizaWszola authored Sep 29, 2024
```
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  d081da00
- [Bugfix] Block manager v2 with preemption and lookahead slots (#8824) · 5bf8789b
  sroy745 authored Sep 28, 2024
  
  5bf8789b
- [Core] Improve choice of Python multiprocessing method (#8823) · d1537039
  Russell Bryant authored Sep 28, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: youkaichao <youkaichao@126.com>
```
  d1537039
- [doc] organize installation doc and expose per-commit docker (#8931) · cc276443
  youkaichao authored Sep 28, 2024
  
  cc276443
28 Sep, 2024 8 commits
- [Bugfix] Support testing prefill throughput with benchmark_serving.py --hf-output-len 1 (#8891) · e585b583
  Chen Zhang authored Sep 28, 2024
  
  e585b583
- [Frontend] Make beam search emulator temperature modifiable (#8928) · 090e945e
  Edouard B. authored Sep 28, 2024
```
Co-authored-by: Eduard Balzin <nfunctor@yahoo.fr>
```
  090e945e
- [CI/Build] Update models tests & examples (#8874) · e1a3f5e8
  Cyrus Leung authored Sep 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  e1a3f5e8
- [Bugfix] Fix PP for Multi-Step (#8887) · 19d02ff9
  Varun Sundar Rabindranath authored Sep 28, 2024
  
  19d02ff9
- [Bugfix] Fix code for downloading models from modelscope (#8443) · 39d3f8d9
  tastelikefeet authored Sep 28, 2024
  
  39d3f8d9
- [Misc] Remove vLLM patch of `BaichuanTokenizer` (#8921) · b0298aa8
  Cyrus Leung authored Sep 28, 2024
  
  b0298aa8
- [Bugfix][Intel] Fix XPU Dockerfile Build (#7824) · 260024a3
  Tyler Titsworth authored Sep 27, 2024
```
Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Co-authored-by: youkaichao <youkaichao@126.com>
```
  260024a3
- [misc] fix wheel name (#8919) · d86f6b2a
  youkaichao authored Sep 27, 2024
  
  d86f6b2a
27 Sep, 2024 12 commits
- [Core] Priority-based scheduling in async engine (#8850) · bd429f2b
  Sebastian Schoennenbeck authored Sep 28, 2024
  
  bd429f2b
- [misc][distributed] add VLLM_SKIP_P2P_CHECK flag (#8911) · 18e60d7d
  youkaichao authored Sep 27, 2024
  
  18e60d7d
- [Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378) · c2ec430a
  Varun Sundar Rabindranath authored Sep 27, 2024
```
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  c2ec430a
- [Bugfix] fix for deepseek w4a16 (#8906) · c5d55356
  Lucas Wilkinson authored Sep 27, 2024
```
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  c5d55356
- [Kernel] AQ AZP 4/4: Integrate asymmetric quantization to linear method (#7271) · 172d1cd2
  Luka Govedič authored Sep 27, 2024
  
  172d1cd2
- [torch.compile] use empty tensor instead of None for profiling (#8875) · a9b15c60
  youkaichao authored Sep 27, 2024
  
  a9b15c60
- [TPU] Update pallas.py to support trillium (#8871) · 8df2dc3c
  Brittany authored Sep 27, 2024
  
  8df2dc3c
- [Bugfix][VLM] Fix Fuyu batching inference with `max_num_seqs>1` (#8892) · 6d792d2f
  Isotr0py authored Sep 27, 2024
  
  6d792d2f
- [MISC] Fix invalid escape sequence '\' (#8830) · 0e088750
  Peter Pan authored Sep 27, 2024
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  0e088750
- [misc] fix collect env (#8894) · dc4e3df5
  youkaichao authored Sep 27, 2024
  
  dc4e3df5
- [Core] rename`PromptInputs` and `inputs` (#8876) · 3b00b9c2
  Cyrus Leung authored Sep 27, 2024
  
  3b00b9c2
- [Feature] Add support for Llama 3.1 and 3.2 tool use (#8343) · 344cd2b6
  Maximilien de Bayser authored Sep 26, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  344cd2b6
26 Sep, 2024 13 commits
- [Installation] Allow lower versions of FastAPI to maintain Ray 2.9 compatibility (#8764) · 1b49148e
  Cyrus Leung authored Sep 27, 2024
  
  1b49148e
- [BugFix] Fix test breakages from transformers 4.45 upgrade (#8829) · 4b377d6f
  Nick Hill authored Sep 27, 2024
  
  4b377d6f
- [Bugfix] Fixup advance_step.cu warning (#8815) · 71d21c73
  Tyler Michael Smith authored Sep 26, 2024
  
  71d21c73
- fix validation: Only set tool_choice `auto` if at least one tool is provided (#8568) · ee2da3e9
  Chirag Jain authored Sep 27, 2024
  
  ee2da3e9
- [Bugfix] Fix print_warning_once's line info (#8867) · e2f6f26e
  Tyler Michael Smith authored Sep 26, 2024
  
  e2f6f26e
- [Misc] Change dummy profiling and BOS fallback warns to log once (#8820) · b28d2104
  Michael Goin authored Sep 26, 2024
  
  b28d2104
- [Bugfix] Include encoder prompts len to non-stream api usage response (#8861) · 93d364da
  Pernekhan Utemuratov authored Sep 26, 2024
  
  93d364da
- [ci] Soft fail Entrypoints, Samplers, LoRA, Decoder-only VLM (#8872) · d9cfbc89
  Kevin H. Luu authored Sep 26, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  d9cfbc89
- [misc][installation] build from source without compilation (#8818) · 70de39f6
  youkaichao authored Sep 26, 2024
  
  70de39f6
- [CI/Build] Fix missing ci dependencies (#8834) · 68988d4e
  fyuan1316 authored Sep 27, 2024
  
  68988d4e
- [Docs] Add README to the build docker image (#8825) · 520db4db
  Michael Goin authored Sep 26, 2024
  
  520db4db
- [Build/CI] Upgrade to gcc 10 in the base build Docker image (#8814) · f70bccac
  Tyler Michael Smith authored Sep 26, 2024
  
  f70bccac
- [Misc] Update config loading for Qwen2-VL and remove Granite (#8837) · 4bb98f21
  Roger Wang authored Sep 26, 2024
  
  4bb98f21
25 Sep, 2024 3 commits
- [Misc] Support quantization of MllamaForCausalLM (#8822) · 7193774b
  Michael Goin authored Sep 25, 2024
  
  7193774b
- [Doc] Update doc for Transformers 4.45 (#8817) · e2c6e0a8
  Roger Wang authored Sep 25, 2024
  
  e2c6e0a8
- [Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602
  Chen Zhang authored Sep 25, 2024
```
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  770ec602