Commits · a491d6f535d96939d17e5290991dc975495c9580 · OpenDAS / vllm_cscc

23 Dec, 2024 11 commits
- [V1] TP Ray executor (#11107) · a491d6f5
  Rui Qiao authored Dec 23, 2024
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  a491d6f5
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059
- [Doc] Fix typo in the help message of '--guided-decoding-backend' (#11440) · 94d545a1
  yansh97 authored Dec 24, 2024
  
  94d545a1
- [Bugfix] Add kv cache scales to gemma2.py (#11269) · 60fb4f3b
  Michael Goin authored Dec 23, 2024
  
  60fb4f3b
- [CI] Expand OpenAI test_chat.py guided decoding tests (#11048) · 63afbe92
  Michael Goin authored Dec 23, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  63afbe92
- [Misc] add w8a8 asym models (#11075) · 8cef6e02
  Dipika Sikka authored Dec 23, 2024
  
  8cef6e02
- [Misc] Add assertion and helpful message for marlin24 compressed models (#11388) · b866cdbd
  Dipika Sikka authored Dec 23, 2024
  
  b866cdbd
- [Bugfix] torch nightly version in ROCm installation guide (#11423) · 2e726680
  Yuan Tang authored Dec 23, 2024
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  2e726680
- [Bugfix] Fix CFGGuide and use outlines for grammars that can't convert to GBNF (#11389) · 5bfb30a5
  Michael Goin authored Dec 23, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  5bfb30a5
- mypy type checking for vllm/worker (#11418) · e51719ae
  Lucas Tucker authored Dec 23, 2024
```
Signed-off-by: lucast2021 <lucast2021@headroyce.org>
Co-authored-by: lucast2021 <lucast2021@headroyce.org>
```
  e51719ae
- [misc][perf] remove old code (#11425) · f30581c5
  youkaichao authored Dec 23, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f30581c5
22 Dec, 2024 5 commits
- [CI] Unboock H100 Benchmark (#11419) · 048fc57a
  Simon Mo authored Dec 22, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  048fc57a
- [Bugfix] Fix fully sharded LoRAs with Mixtral (#11390) · f1d1bf62
  Jason T. Greene authored Dec 22, 2024
```
Signed-off-by: Jason Greene <jason.greene@redhat.com>
```
  f1d1bf62
- [cd][release] fix race conditions (#11407) · 72d9c316
  youkaichao authored Dec 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  72d9c316
- [cd][release] add pypi index for every commit and nightly build (#11404) · 4a913978
  youkaichao authored Dec 21, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  4a913978
- [CI] Fix flaky entrypoint tests (#11403) · 29c74893
  Roger Wang authored Dec 21, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  29c74893
21 Dec, 2024 4 commits
- [Bugfix] Fix issues for `Pixtral-Large-Instruct-2411` (#11393) · c2d1b075
  Roger Wang authored Dec 21, 2024
```
Signed-off-by: ywang96 <ywang@example.com>
Co-authored-by: ywang96 <ywang@example.com>
```
  c2d1b075
- [V1] Make AsyncLLMEngine v1-v0 opaque (#11383) · 584f0ae4
  Ricky Xu authored Dec 20, 2024
```
Signed-off-by: Ricky Xu <xuchen727@hotmail.com>
```
  584f0ae4
- [Bugfix] update should_ignore_layer (#11354) · 51ff216d
  George authored Dec 21, 2024
```
Signed-off-by: George Ohashi <george@neuralmagic.com>
```
  51ff216d
- [V1][Bugfix] Skip hashing empty or None mm_data (#11386) · dd2b5633
  Woosuk Kwon authored Dec 21, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dd2b5633
20 Dec, 2024 12 commits
- Add ray[default] to wget to run distributed inference out of box (#11265) · 47a0b615
  Jiaxin Shan authored Dec 20, 2024
```
Signed-off-by: Jiaxin Shan <seedjeffwan@gmail.com>
```
  47a0b615
- [doc] explain nccl requirements for rlhf (#11381) · 5d2248d8
  youkaichao authored Dec 20, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  5d2248d8
- [Bugfix] Don't log OpenAI field aliases as ignored (#11378) · d573aead
  Michael Goin authored Dec 20, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  d573aead
- [Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192) · 995f5623
  omer-dayan authored Dec 20, 2024
```
Signed-off-by: OmerD <omer@run.ai>
```
  995f5623
- [CI/Build] fix pre-compiled wheel install for exact tag (#11373) · 7c7aa37c
  Daniele authored Dec 20, 2024
```
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
```
  7c7aa37c
- [V1] Fix profiling for models with merged input processor (#11370) · 04139ade
  Roger Wang authored Dec 20, 2024
```
Signed-off-by: ywang96 <ywang@roblox.com>
```
  04139ade
- [doc] backward compatibility for 0.6.4 (#11359) · 1ecc645b
  youkaichao authored Dec 19, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1ecc645b
- [misc] add early error message for custom ops (#11355) · c954f21a
  youkaichao authored Dec 19, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c954f21a
- [Bugfix] Fix spec decoding when seed is none in a batch (#10863) · 86c2d8fd
  Wallas Henrique authored Dec 20, 2024
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
```
  86c2d8fd
- [Misc] Add tqdm progress bar during graph capture (#11349) · b880ffb8
  Michael Goin authored Dec 19, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  b880ffb8
- [ci][gh200] dockerfile clean up (#11351) · 7801f56e
  youkaichao authored Dec 19, 2024
```
Signed-off-by: drikster80 <ed.sealing@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: cenzhiyao <2523403608@qq.com>
```
  7801f56e
- [Bugfix][Hardware][POWERPC] Fix auto dtype failure in case of POWER10 (#11331) · 48edab80
  Akash kaothalkar authored Dec 20, 2024
```
Signed-off-by: Akash Kaothalkar <0052v2@linux.vnet.ibm.com>
```
  48edab80
19 Dec, 2024 8 commits

[CI] Adding CPU docker pipeline (#11261) · a985f7af

Yuan authored Dec 20, 2024


Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
Co-authored-by: Kevin H. Luu <kevin@anyscale.com>

a985f7af

[Misc] Remove unused vllm/block.py (#11336) · e461c262
yangzhibin authored Dec 20, 2024

e461c262
[Bugfix] Fix broken CPU compressed-tensors test (#11338) · 276738ce
Isotr0py authored Dec 20, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
276738ce
[Misc] Clean up and consolidate LRUCache (#11339) · cdf22afd
Cyrus Leung authored Dec 20, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
cdf22afd

[Model] Refactor Qwen2-VL to use merged multimodal processor (#11258) · e24113a8

Isotr0py authored Dec 20, 2024


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

e24113a8

[V1] Fix multimodal profiling for `Molmo` (#11325) · 7379b3d4
Roger Wang authored Dec 19, 2024
```
Signed-off-by: ywang96 <ywang@example.com>
Co-authored-by: ywang96 <ywang@example.com>
```
7379b3d4

[Model] Add JambaForSequenceClassification model (#10860) · 6c7f8815

Yehoshua Cohen authored Dec 19, 2024


Signed-off-by: Yehoshua Cohen <yehoshuaco@ai21.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Yehoshua Cohen <yehoshuaco@ai21.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

6c7f8815

[Bugfix] Cleanup Pixtral HF code (#11333) · a0f7d53b
Cyrus Leung authored Dec 19, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
a0f7d53b