Commits · 3a28f18b0bb954cc9886e5ee63cd616997165024 · OpenDAS / vllm_cscc · GitLab

12 Nov, 2024 5 commits
- [doc] explain the class hierarchy in vLLM (#10240) · 3a28f18b
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3a28f18b
- Splitting attention kernel file (#10091) · 812c981f
  Aleksandr Malyshev authored Nov 11, 2024
```
Signed-off-by: maleksan85 <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  812c981f
- [Misc][LoRA] Replace hardcoded cuda device with configurable argument (#10223) · 7f5edb59
  Jee Jee Li authored Nov 12, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7f5edb59
- [1/N] torch.compile user interface design (#10237) · eea55cca
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eea55cca
- [Doc] Update help text for `--distributed-executor-backend` (#10231) · 9cdba966
  Russell Bryant authored Nov 11, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  9cdba966
11 Nov, 2024 23 commits
- [doc] update debugging guide (#10236) · d1c6799b
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d1c6799b
- [V1] `AsyncLLM` Implementation (#9826) · 6ace6fba
  Robert Shaw authored Nov 11, 2024
```
Signed-off-by: Nick Hill <nickhill@us.ibm.com>
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  6ace6fba
- Make shutil rename in python_only_dev (#10233) · 08f93e74
  Nikolai Shcheglov authored Nov 11, 2024
```
Signed-off-by: shcheglovnd <shcheglovnd@avride.ai>
```
  08f93e74
- [V1] Enable custom ops with piecewise CUDA graphs (#10228) · 9d5b4e4d
  Woosuk Kwon authored Nov 11, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9d5b4e4d
- [misc][distributed] auto port selection and disable tests (#10226) · 8a7fe47d
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  8a7fe47d
- Add docs on serving with Llama Stack (#10183) · 4800339c
  Yuan Tang authored Nov 11, 2024
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  4800339c
- [V1] Use custom ops for piecewise CUDA graphs (#10227) · fe15729a
  Woosuk Kwon authored Nov 11, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  fe15729a
- [v1][torch.compile] support managing cudagraph buffer (#10203) · 330e82d3
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  330e82d3
- [V1] Do not use inductor for piecewise CUDA graphs (#10225) · d7a4f220
  Woosuk Kwon authored Nov 11, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d7a4f220
- [V1] Fix detokenizer ports (#10224) · f9dadfbe
  Woosuk Kwon authored Nov 11, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f9dadfbe
- Bump actions/setup-python from 5.2.0 to 5.3.0 (#10209) · 25144cee
  dependabot[bot] authored Nov 11, 2024
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  25144cee
- [core][distributed] add stateless process group (#10216) · e6de9784
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e6de9784
- [Doc] fix doc string typo in block_manager `swap_out` function (#10212) · 36fc439d
  Yangcheng Li authored Nov 12, 2024
  
  36fc439d
- [Metrics] add more metrics (#4464) · 874f551b
  harrywu authored Nov 12, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  874f551b
- [Bugfix][Hardware][CPU] Fix broken encoder-decoder CPU runner (#10218) · 2cebda42
  Isotr0py authored Nov 11, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2cebda42
- [V1] Allow `tokenizer_mode` and `trust_remote_code` for Detokenizer (#10211) · 5fb1f935
  Roger Wang authored Nov 11, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  5fb1f935
- [LoRA][Kernel] Remove the unused libentry module (#10214) · 36e4acd0
  Jee Jee Li authored Nov 11, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  36e4acd0
- [Hardware][CPU] Add embedding models support for CPU backend (#10193) · 58170d65
  Isotr0py authored Nov 11, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  58170d65
- Bump the patch-update group with 5 updates (#10210) · 9804ac7c
  dependabot[bot] authored Nov 11, 2024
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  9804ac7c
- [6/N] pass whole config to inner model (#10205) · f89d18ff
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f89d18ff
- [doc] improve debugging code (#10206) · f0f2e563
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f0f2e563
- [Doc] Fix typo error in vllm/entrypoints/openai/cli_args.py (#10196) · ad9a78bf
  yansh97 authored Nov 11, 2024
  
  ad9a78bf
- [misc] improve cloudpickle registration and tests (#10202) · 73b9083e
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  73b9083e
10 Nov, 2024 4 commits
- [Misc] small fixes to function tracing file path (#9543) · 20cf2f55
  Shawn Du authored Nov 11, 2024
```
Signed-off-by: Shawn Du <shawnd200@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  20cf2f55
- [doc] Polish the integration with huggingface doc (#10195) · bfb7d61a
  Yongzao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  bfb7d61a
- [Doc] Fix typo error in CONTRIBUTING.md (#10190) · 19682023
  FuryMartin authored Nov 10, 2024
```
Signed-off-by: FuryMartin <furymartin9910@outlook.com>
```
  19682023
- [ci][build] limit cmake version (#10188) · 9fa4bdde
  youkaichao authored Nov 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  9fa4bdde
09 Nov, 2024 8 commits
- [CI/Build] Split up models tests (#10069) · 51c2e1fc
  Cyrus Leung authored Nov 10, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51c2e1fc
- [Frontend][Core] Override HF `config.json` via CLI (#5836) · b09895a6
  Krishna Mandal authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b09895a6
- [Frontend] add `add_request_id` middleware (#9594) · d88bff1b
  cjackal authored Nov 09, 2024
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  d88bff1b
- bugfix: fix the bug that stream generate not work (#2756) · 9e372664
  Zhao Yingzhuo authored Nov 09, 2024
  
  9e372664
- [doc] explaining the integration with huggingface (#10173) · 8a4358ec
  youkaichao authored Nov 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  8a4358ec
- [bugfix] fix broken tests of mlp speculator (#10177) · bd46357a
  youkaichao authored Nov 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  bd46357a
- [Bugfix] Enable some fp8 and quantized fullgraph tests (#10171) · f192aeba
  bnellnm authored Nov 09, 2024
```
Signed-off-by: Bill Nell <bill@neuralmagic.com>
```
  f192aeba
- [CI/Build] Add run-hpu-test.sh script (#10167) · 8e1529dc
  Chendi.Xue authored Nov 09, 2024
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  8e1529dc