Commits · 8eeb85708428b7735bbd1156c81692431fd5ff34 · OpenDAS / vllm_cscc · GitLab

06 Oct, 2024 1 commit
- [Model] PP support for embedding models and update docs (#9090) · b22b7984
  Cyrus Leung authored Oct 06, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  b22b7984
04 Oct, 2024 1 commit

[Models] Add remaining model PP support (#7168) · 0f6d7a9a

Murali Andoorveedu authored Oct 03, 2024

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

0f6d7a9a

29 Sep, 2024 1 commit
- [CI/Build] Add test decorator for minimum GPU memory (#8925) · 26a68d5d
  Cyrus Leung authored Sep 29, 2024
  
  26a68d5d
28 Sep, 2024 1 commit
- [Bugfix] Fix PP for Multi-Step (#8887) · 19d02ff9
  Varun Sundar Rabindranath authored Sep 28, 2024
  
  19d02ff9
18 Sep, 2024 2 commits

[Core] *Prompt* logprobs support in Multi-step (#8199) · a8c1d161
afeldman-nm authored Sep 18, 2024

a8c1d161

[Core][Bugfix][Perf] Introduce `MQLLMEngine` to avoid `asyncio` OH (#8157) · 7c7714d8

Alexander Matveev authored Sep 18, 2024


Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

7c7714d8

13 Sep, 2024 2 commits
- [CI/Build] Reorganize models tests (#7820) · a84e598e
  Cyrus Leung authored Sep 14, 2024
  
  a84e598e
- [Bugfix] Mapping physical device indices for e2e test utils (#8290) · 40c39653
  shangmingc authored Sep 13, 2024
  
  40c39653
07 Sep, 2024 1 commit
- [Bugfix] Fix broken OpenAI tensorizer test (#8258) · 9f68e00d
  Cyrus Leung authored Sep 07, 2024
  
  9f68e00d
05 Sep, 2024 1 commit
- Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860) · 8685ba1a
  manikandan.tm@zucisystems.com authored Sep 05, 2024
  
  8685ba1a
30 Aug, 2024 1 commit
- [Core] Logprobs support in Multi-step (#7652) · 428dd144
  afeldman-nm authored Aug 29, 2024
  
  428dd144
27 Aug, 2024 1 commit
- [Tests] Disable retries and use context manager for openai client (#7565) · 39178c7f
  Nick Hill authored Aug 26, 2024
  
  39178c7f
26 Aug, 2024 1 commit
- [CI/Build] Avoid downloading all HF files in `RemoteOpenAIServer` (#7836) · 029c71de
  Cyrus Leung authored Aug 26, 2024
  
  029c71de
24 Aug, 2024 2 commits
- [ci][test] fix RemoteOpenAIServer (#7838) · aab0fcdb
  youkaichao authored Aug 24, 2024
  
  aab0fcdb
- [ci][test] exclude model download time in server start time (#7834) · ea9fa160
  youkaichao authored Aug 24, 2024
  
  ea9fa160
21 Aug, 2024 1 commit
- [ci][test] adjust max wait time for cpu offloading test (#7709) · 9e51b6a6
  youkaichao authored Aug 20, 2024
  
  9e51b6a6
17 Aug, 2024 2 commits
- [ci][test] allow longer wait time for api server (#7629) · 832163b8
  youkaichao authored Aug 17, 2024
  
  832163b8
- [aDAG] Unflake aDAG + PP tests (#7600) · 4706eb62
  SangBin Cho authored Aug 16, 2024
  
  4706eb62
14 Aug, 2024 1 commit
- [misc][ci] fix cpu test with plugins (#7489) · ea49e6a3
  youkaichao authored Aug 13, 2024
  
  ea49e6a3
13 Aug, 2024 1 commit
- [mypy] Misc. typing improvements (#7417) · 9ba85bc1
  Cyrus Leung authored Aug 13, 2024
  
  9ba85bc1
07 Aug, 2024 2 commits
- [Frontend] Gracefully handle missing chat template and fix CI failure (#7238) · 66d617e3
  Cyrus Leung authored Aug 07, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  66d617e3
- [Bugfix] Fix GPTQ and GPTQ Marlin CPU Offloading (#7225) · f9a56006
  Michael Goin authored Aug 06, 2024
  
  f9a56006
03 Aug, 2024 2 commits
- [ci][test] finalize fork_new_process_for_each_test (#7114) · 44dcb52e
  youkaichao authored Aug 03, 2024
  
  44dcb52e
- [ci][distributed] shorten wait time if server hangs (#7098) · 69ea15e5
  youkaichao authored Aug 02, 2024
  
  69ea15e5
02 Aug, 2024 2 commits
- [Core] Pipeline parallel with Ray ADAG (#6837) · 05308891
  Rui Qiao authored Aug 02, 2024
```
Support pipeline-parallelism with Ray accelerated DAG.
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  05308891
- [ci][distributed] try to fix pp test (#7054) · 25235779
  youkaichao authored Aug 01, 2024
  
  25235779
30 Jul, 2024 1 commit
- [BugFix] Fix use of per-request seed with pipeline parallel (#6698) · 5cf9254a
  Nick Hill authored Jul 30, 2024
  
  5cf9254a
18 Jul, 2024 1 commit
- [ci][test] add correctness test for cpu offloading (#6549) · f53b8f0d
  youkaichao authored Jul 18, 2024
  
  f53b8f0d
17 Jul, 2024 1 commit
- [Doc][CI/Build] Update docs and tests to use `vllm serve` (#6431) · 5bf35a91
  Cyrus Leung authored Jul 17, 2024
  
  5bf35a91
14 Jul, 2024 1 commit
- [Feature] vLLM CLI (#5090) · dbfe254e
  Ethan Xu authored Jul 14, 2024
```
Co-authored-by: simon-mo <simon.mo@hey.com>
```
  dbfe254e
13 Jul, 2024 1 commit

[ci] try to add multi-node tests (#6280) · 41708e50

youkaichao authored Jul 12, 2024


Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

41708e50

02 Jul, 2024 1 commit
- [Core] Pipeline Parallel Support (#4412) · c5832d2a
  Murali Andoorveedu authored Jul 02, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  c5832d2a
30 Jun, 2024 1 commit
- [CI/Build] [3/3] Reorganize entrypoints tests (#5966) · 9d47f64e
  Cyrus Leung authored Jun 30, 2024
  
  9d47f64e
25 Jun, 2024 1 commit
- [Hardware][AMD][CI/Build][Doc] Upgrade to ROCm 6.1, Dockerfile improvements, test fixes (#5422) · dd793d1d
  Matt Wong authored Jun 25, 2024
  
  dd793d1d
23 Jun, 2024 1 commit
- [Distributed] Add send and recv helpers (#5719) · 5d4d9053
  Murali Andoorveedu authored Jun 23, 2024
  
  5d4d9053
19 Jun, 2024 1 commit
- [Bugfix] AsyncLLMEngine hangs with asyncio.run (#5654) · 78687504
  zifeitong authored Jun 19, 2024
  
  78687504
15 Jun, 2024 1 commit
- [mypy] Enable type checking for test directory (#5017) · 0e9164b4
  Cyrus Leung authored Jun 15, 2024
  
  0e9164b4
13 Jun, 2024 1 commit
- [CI/Build] Simplify OpenAI server setup in tests (#5100) · 39873476
  Cyrus Leung authored Jun 14, 2024
  
  39873476
03 Jun, 2024 1 commit
- [FRONTEND] OpenAI `tools` support named functions (#5032) · f775a07e
  Breno Faria authored Jun 04, 2024
  
  f775a07e
28 May, 2024 1 commit
- [Core] Consolidate prompt arguments to LLM engines (#4328) · 5ae5ed1e
  Cyrus Leung authored May 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  5ae5ed1e