Commits · 4d3a2c284ecc47748273664c9a6ef302ff3adcbe · OpenDAS / vllm_cscc

17 Dec, 2024 1 commit
- fix gh200 tests on main (#11246) · 35bae114
  youkaichao authored Dec 16, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  35bae114
16 Dec, 2024 2 commits
- [ci][tests] add gh200 tests (#11244) · c301616e
  youkaichao authored Dec 16, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c301616e
- [misc] Layerwise profile updates (#10242) · efbce85f
  Varun Sundar Rabindranath authored Dec 16, 2024
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  efbce85f
13 Dec, 2024 1 commit
- [Frontend] Separate pooling APIs in offline inference (#11129) · eeec9e33
  Cyrus Leung authored Dec 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eeec9e33
12 Dec, 2024 1 commit
- [core][distributed] initialization from StatelessProcessGroup (#10986) · 62de37a3
  youkaichao authored Dec 12, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  62de37a3
11 Dec, 2024 2 commits
- [CI/Build] Split up VLM tests (#11083) · d1e21a97
  Cyrus Leung authored Dec 12, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d1e21a97
- [CI/Build] Enable prefix caching test for AMD (#11098) · b2f77545
  hissu-hyvarinen authored Dec 11, 2024
```
Signed-off-by: Hissu Hyvarinen <hissu.hyvarinen@amd.com>
```
  b2f77545
09 Dec, 2024 1 commit

Build tpu image in release pipeline (#10936) · 5ed5d5f1

Richard Liu authored Dec 09, 2024


Signed-off-by: Richard Liu <ricliu@google.com>
Co-authored-by: Kevin H. Luu <kevin@anyscale.com>

5ed5d5f1

07 Dec, 2024 2 commits
- [Model] Update multi-modal processor to support Mantis(LLaVA) model (#10711) · 39e227c7
  Cyrus Leung authored Dec 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39e227c7
- [Bugfix] Fix test-pipeline.yaml (#10973) · acf092d3
  Jee Jee Li authored Dec 07, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  acf092d3
05 Dec, 2024 2 commits
- [ci][build] add tests for python only compilation (#10915) · 9743d64e
  youkaichao authored Dec 05, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  9743d64e
- [benchmark] Make H100 benchmark optional (#10908) · 7883c2bb
  Kevin H. Luu authored Dec 04, 2024
  
  7883c2bb
04 Dec, 2024 3 commits
- [ci/build] Update vLLM postmerge ECR repo (#10887) · c92acb96
  Kevin H. Luu authored Dec 04, 2024
  
  c92acb96
- [ci/build] Job to build and push release image (#10877) · c9ca4fce
  Kevin H. Luu authored Dec 03, 2024
  
  c9ca4fce
- [ci/build] Change queue name for Release jobs (#10875) · fa2dea61
  Kevin H. Luu authored Dec 03, 2024
  
  fa2dea61
03 Dec, 2024 2 commits
- [MISC][XPU] quick fix for XPU CI (#10859) · 2f2cdc74
  Yan Ma authored Dec 04, 2024
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  2f2cdc74
- [Bugfix] Fix QKVParallelLinearWithShardedLora bias bug (#10844) · a4cf2561
  Jee Jee Li authored Dec 03, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a4cf2561
02 Dec, 2024 2 commits

[Misc][XPU] Avoid torch compile for XPU platform (#10747) · 519cc6ca
Yan Ma authored Dec 03, 2024
```
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
519cc6ca

[Core] Implement disagg prefill by StatelessProcessGroup (#10502) · 0590ec3f

Kuntai Du authored Dec 01, 2024



This PR provides initial support for single-node disaggregated prefill in 1P1D scenario.
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: YaoJiayi <120040070@link.cuhk.edu.cn>

0590ec3f

01 Dec, 2024 1 commit
- [Model] Replace embedding models with pooling adapter (#10769) · 13370712
  Cyrus Leung authored Dec 01, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13370712
26 Nov, 2024 1 commit
- [v1] EngineArgs for better config handling for v1 (#10382) · 519e8e41
  Ricky Xu authored Nov 25, 2024
```
Signed-off-by: rickyx <rickyx@anyscale.com>
```
  519e8e41
24 Nov, 2024 3 commits
- Revert "Print running script to enhance CI log readability" (#10601) · eda2b358
  youkaichao authored Nov 23, 2024
  
  eda2b358
- [CI/Build] Print running script to enhance CI log readability (#10594) · 1c445dca
  Jee Jee Li authored Nov 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1c445dca
- [Bugfix] Fix LoRA weight sharding (#10450) · 1700c543
  Jee Jee Li authored Nov 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  1700c543
23 Nov, 2024 2 commits
- For ppc64le, disabled tests for now and addressed space issues (#10538) · 651f6c31
  Nishidha authored Nov 23, 2024
  
  651f6c31
- [AMD] Add support for GGUF quantization on ROCm (#10254) · 7c25fe45
  kliuae authored Nov 23, 2024
  
  7c25fe45
22 Nov, 2024 1 commit
- [Benchmark] Add new H100 machine (#10547) · aed07486
  Simon Mo authored Nov 21, 2024
  
  aed07486
21 Nov, 2024 2 commits
- [CI][Installation] Avoid uploading CUDA 11.8 wheel (#10535) · edec3385
  Yunmeng authored Nov 22, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
Co-authored-by: simon-mo <simon.mo@hey.com>
```
  edec3385
- [torch.compile] limit inductor threads and lazy import quant (#10482) · 388ee3de
  youkaichao authored Nov 20, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  388ee3de
20 Nov, 2024 3 commits
- [perf bench] H200 development (#9768) · 5f1d6af2
  Simon Mo authored Nov 20, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  5f1d6af2
- [Hardware][CPU] Support chunked-prefill and prefix-caching on CPU (#10355) · 63f1fde2
  Li, Jiang authored Nov 20, 2024
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  63f1fde2
- [ci/build] Combine nightly and optional (#10465) · ed701ca9
  Kevin H. Luu authored Nov 19, 2024
  
  ed701ca9
19 Nov, 2024 1 commit
- [CI][CPU] adding numa node number as container name suffix (#10441) · b4614656
  Yuan authored Nov 19, 2024
```
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
```
  b4614656
17 Nov, 2024 1 commit
- [CI/Build] Fix IDC hpu [Device not found] issue (#10384) · 905d0f0a
  Chendi.Xue authored Nov 17, 2024
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  905d0f0a
15 Nov, 2024 3 commits
- [Build] skip renaming files for release wheels pipeline (#9671) · 02dbf30e
  Simon Mo authored Nov 14, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02dbf30e
- [Model] Support Qwen2 embeddings and use tags to select model tests (#10184) · b40cf640
  Cyrus Leung authored Nov 15, 2024
  
  b40cf640
- [Bugfix] Fix unable to load some models (#10312) · 972112d8
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  972112d8
14 Nov, 2024 2 commits
- [CI/Build] Make shellcheck happy (#10285) · 675d6034
  Cyrus Leung authored Nov 14, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  675d6034
- [CI/Build] Fix CPU CI online inference timeout (#10314) · 03025c02
  Isotr0py authored Nov 14, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  03025c02
12 Nov, 2024 1 commit
- [CI][CPU]refactor CPU tests to allow to bind with different cores (#10222) · d201d419
  Yuan authored Nov 12, 2024
```
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
```
  d201d419