Commits · 4eabe1237f5b3a5e0b004e938b266bb337ff64a9 · OpenDAS / vllm_cscc

27 May, 2025 2 commits
- [V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010) · 06a03380
  Mark McLoughlin authored May 27, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  06a03380
- [Hardware][Intel-Gaudi] [CI/Build] Fix multiple containers using the same name... · bbd9a84d
  Łukasz Durejko authored May 27, 2025
```
[Hardware][Intel-Gaudi] [CI/Build] Fix multiple containers using the same name in run-hpu-test.sh (#18752)
Signed-off-by: Lukasz Durejko <ldurejko@habana.ai>
```
  bbd9a84d
26 May, 2025 3 commits
- [Doc] Move examples and further reorganize user guide (#18666) · 82e2339b
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82e2339b
- [Hardware][Intel-Gaudi] [CI/Build] Add tensor parallel size = 2 test to HPU CI (#18709) · e76be065
  Łukasz Durejko authored May 26, 2025
```
Signed-off-by: Lukasz Durejko <ldurejko@habana.ai>
```
  e76be065
- [CI/Build] Split pooling and generation extended language models tests in CI (#18705) · 08777500
  Isotr0py authored May 26, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  08777500
23 May, 2025 6 commits
- [CI] Enable test_initialization to run on V1 (#16736) · 0ddf88e1
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0ddf88e1
- [CI/Build] Fix V1 flag being set in entrypoints tests (#18598) · 6dd51c7e
  Cyrus Leung authored May 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6dd51c7e
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
- [Feature]Add async tensor parallelism using compilation pass (#17882) · 71ea614d
  cascade authored May 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  71ea614d
- [Neuron] Remove bypass on EAGLEConfig and add a test (#18514) · ed5d4082
  aws-elaineyz authored May 22, 2025
```
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
```
  ed5d4082
- [Frontend] [Core] Add Tensorizer support for V1, LoRA adapter serialization... · c32e249a
  Sanger Steel authored May 22, 2025
```
[Frontend] [Core] Add Tensorizer support for V1, LoRA adapter serialization and deserialization (#17926)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
```
  c32e249a
22 May, 2025 2 commits
- [Bugfix] make `test_openai_schema.py` pass (#18224) · 1f3a1200
  David Xia authored May 22, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1f3a1200
- [Bugfix] Add kwargs to RequestOutput __init__ to be forward compatible (#18513) · a35a4947
  lkchen authored May 22, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  a35a4947
21 May, 2025 1 commit
- [Bugfix][Failing Test] Fix test_events.py (#18460) · 61acfc45
  Rabi Mishra authored May 21, 2025
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  61acfc45
20 May, 2025 1 commit
- [release] Change dockerhub username for TPU release (#18389) · d9813967
  Kevin H. Luu authored May 19, 2025
  
  d9813967
19 May, 2025 2 commits
- [neuron] fix authorization issue (#18364) · d565e097
  Liangfu Chen authored May 19, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  d565e097
- [Build] Supports CUDA 12.6 and 11.8 after Blackwell Update (#18316) · 47fda6d0
  Simon Mo authored May 18, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  47fda6d0
16 May, 2025 1 commit
- [Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1 (#17827) · 3d2779c2
  Lucia Fang authored May 15, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  3d2779c2
15 May, 2025 3 commits
- Adding "AMD: Tensorizer Test" to amdproduction. (#18216) · 0b345930
  Alexei-V-Ivanov-AMD authored May 15, 2025
  
  0b345930
- Adding "Basic Models Test" and "Multi-Modal Models Test (Extended) 3" in AMD Pipeline (#18106) · 566ec04c
  Alexei-V-Ivanov-AMD authored May 15, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  566ec04c
- [V1][Metrics] Remove unused code (#18158) · 65334ef3
  Mark McLoughlin authored May 15, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  65334ef3
14 May, 2025 2 commits
- Upload vllm index for the rc builds (#18173) · 09f106a9
  Andrey Talman authored May 14, 2025
  
  09f106a9
- [AMD][torch.compile] Enable silu+fp8_quant fusion for rocm (#18082) · 7b2f28de
  Charlie Fu authored May 14, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  7b2f28de
13 May, 2025 3 commits
- Convert `benchmarks` to `ruff format` (#18068) · 009d9e75
  Harry Mellor authored May 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  009d9e75
- Convert `.buildkite` to `ruff format` (#17656) · 98fcba15
  Harry Mellor authored May 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  98fcba15
- [BugFix] Fix 4-GPU RLHF tests (#18007) · ee5be834
  Nick Hill authored May 12, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ee5be834
12 May, 2025 6 commits

Enable standard language model for torhc nightly (#18004) · 2b0db9b0
Yang Wang authored May 12, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
2b0db9b0
Enabling "Weight Loading Multiple GPU Test - Large Models" (#18020) · e9c730c9
Alexei-V-Ivanov-AMD authored May 12, 2025

e9c730c9
[CI/Build] Fix TPU V1 Test mixed use of & and && across tests (#17968) · b9fd0d7a
Carol Zheng authored May 12, 2025

b9fd0d7a
[Lora][Frontend]Add default local directory LoRA resolver plugin. (#16855) · 98ea3560
Jonathan Berkhahn authored May 12, 2025
```
Signed-off-by: jberkhahn <jaberkha@us.ibm.com>
```
98ea3560

[P/D] NIXL Integration (#17751) · d1911020

Robert Shaw authored May 12, 2025


Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Brent Salisbury <bsalisbu@redhat.com>

d1911020

Correcting testcases in builkite job for IBM Power (#17675) · 9fbf2bfb
Aaruni Aggarwal authored May 12, 2025
```
Signed-off-by: Aaruni Aggarwal <aaruniagg@gmail.com>
```
9fbf2bfb

09 May, 2025 1 commit
- AMD conditional all test execution // new test groups (#17556) · 3b602cde
  Alexei-V-Ivanov-AMD authored May 09, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
```
  3b602cde
08 May, 2025 2 commits
- [CI] Prune down lm-eval small tests (#17012) · 8342e3ab
  Michael Goin authored May 08, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8342e3ab
- [Test] Attempt all TPU V1 tests, even if some of them fail. (#17334) · a83a0f92
  yarongmu-google authored May 08, 2025
```
Signed-off-by: Yarong Mu <ymu@google.com>
```
  a83a0f92
07 May, 2025 3 commits
- [Hardware][TPU][V1] Multi-LoRA implementation for the V1 TPU backend (#14238) · c20ef40f
  Akshat Tripathi authored May 07, 2025
```
Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  c20ef40f
- Replace lm-eval bash script with pytest and use enforce_eager for faster CI (#17717) · 950b7118
  Michael Goin authored May 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  950b7118
- [TPU] Add kernel test for moe_pallas (#17496) · e50a1f1a
  Michael Goin authored May 06, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e50a1f1a
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
03 May, 2025 1 commit
- [release] Add command to clean up Docker containers/images in TPU release machine (#17606) · 3ec97e2c
  Kevin H. Luu authored May 02, 2025
  
  3ec97e2c