Commits · 6a7988c55bb0a54240f479033313eb98344e6431 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "9f8cb81b44ce2433facc60dec709dc8bf116c315"

23 May, 2025 36 commits
- Refactor pplx init logic to make it modular (prepare for deepep) (#18200) · 6a7988c5
  youkaichao authored May 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6a7988c5
- [Doc] Use a different color for the announcement (#18616) · 022d8abe
  Cyrus Leung authored May 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  022d8abe
- [Doc] Fix markdown list indentation for MkDocs rendering (#18620) · 5221815a
  Hyogeun Oh (오효근) authored May 24, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  5221815a
- [Bugfix][Build/CI] Fixup CUDA compiler version check for CUDA_SUPPORTED_ARCHS (#18579) · 1068556b
  Simon Mo authored May 23, 2025
  
  1068556b
- [Misc] add Haystack integration (#18601) · 2cd1fa45
  Reid authored May 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2cd1fa45
- Include private attributes in API documentation (#18614) · d4c29197
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d4c29197
- [Bugfix] Fix transformers model impl ignored for mixtral quant (#18602) · 6220f3c6
  Tristan Leclercq authored May 23, 2025
```
Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>
```
  6220f3c6
- Fix examples with code blocks in docs (#18609) · 52fb23f4
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  52fb23f4
- [CI/Build] Fix V1 flag being set in entrypoints tests (#18598) · 6dd51c7e
  Cyrus Leung authored May 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6dd51c7e
- Replace `{func}` with mkdocs style links (#18610) · 2edb533a
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2edb533a
- [Doc] Fix indent of contributing to vllm (#18611) · 38a95cb4
  Hyogeun Oh (오효근) authored May 23, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  38a95cb4
- [CI] fix kv_cache_type argument (#18594) · cd821ea5
  Ning Xie authored May 23, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  cd821ea5
- [Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to... · 7ab056c2
  Kay Yan authored May 23, 2025
```
[Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to `requirements/cpu.txt`  (#18542)
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  7ab056c2
- Add myself as docs code owner (#18605) · 6526e051
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6526e051
- [V0][Bugfix] Fix parallel sampling performance regression when guided decoding is enabled (#17731) · e493e485
  Madeesh Kannan authored May 23, 2025
```
Signed-off-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  e493e485
- [Bugfix][Model] Fix baichuan model loader for tp (#18597) · 4ce64e2d
  Mengqing Cao authored May 23, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  4ce64e2d
- Revert "[V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (#18034)" (#18600) · fbb13a2c
  Cyrus Leung authored May 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fbb13a2c
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
- [Bugfix] Add half type support in reshape_and_cache_cpu_impl on x86 cpu platform (#18430) · d0bc2f81
  Yuqi Zhang authored May 23, 2025
```
Signed-off-by: Yuqi Zhang <yuqizhang@google.com>
Co-authored-by: Yuqi Zhang <yuqizhang@google.com>
```
  d0bc2f81
- [Feature][V1]: suupports cached_tokens in response usage (#18149) · b046cf79
  Chauncey authored May 23, 2025
```
Co-authored-by: simon-mo <xmo@berkeley.edu>
```
  b046cf79
- [Doc] Update quickstart and install for cu128 using `--torch-backend=auto` (#18505) · 54af9159
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  54af9159
- [Feature]Add async tensor parallelism using compilation pass (#17882) · 71ea614d
  cascade authored May 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  71ea614d
- [V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (#18034) · 4c611348
  RonaldBXu authored May 23, 2025
```
Signed-off-by: Ronald Xu <ronaldxu@amazon.com>
```
  4c611348
- [Hardware] correct method signatures for HPU,ROCm,XPU (#18551) · 60cad94b
  Ning Xie authored May 23, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  60cad94b
- [Misc] Replace `cuda` hard code with `current_platform` (#16983) · 9c1baa5b
  Shanshan Shen authored May 23, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  9c1baa5b
- [Bugfix][Benchmarks] Fix a benchmark of deepspeed-mii backend to use api_key (#17291) · 4be2255c
  Teruaki Ishizaki authored May 23, 2025
```
Signed-off-by: Teruaki Ishizaki <teruaki.ishizaki@ntt.com>
```
  4be2255c
- [Neuron] Remove bypass on EAGLEConfig and add a test (#18514) · ed5d4082
  aws-elaineyz authored May 22, 2025
```
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
```
  ed5d4082
- [Spec Decode] Make EAGLE3 draft token ID mapping optional (#18488) · 583507d1
  Benjamin Chislett authored May 22, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  583507d1
- [Bugfix] Set `KVTransferConfig.engine_id` in post_init (#18576) · e44d8ce8
  lkchen authored May 22, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  e44d8ce8
- [BugFix] Increase TP execute_model timeout (#18558) · 93ecb813
  Nick Hill authored May 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  93ecb813
- [Misc] refactor: simplify input validation and num_requests handling in _convert_v1_inputs (#18482) · fae453f8
  CYJiang authored May 23, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  fae453f8
- Enable hybrid attention models for Transformers backend (#18494) · 4b0da7b6
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4b0da7b6
- [V1][Spec Decoding] Use model_loader.get_model() to load models (#18273) · c6b636f9
  Mark McLoughlin authored May 23, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  c6b636f9
- Re-submit: Fix: Proper RGBA -> RGB conversion for PIL images. (#18569) · 04eb88dc
  Chenheli Hua authored May 22, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  04eb88dc
- [AMD] [P/D] Compute num gpus for ROCm correctly in run_accuracy_test.sh (#18568) · 46791e1b
  rasmith authored May 22, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  46791e1b
- [Frontend] [Core] Add Tensorizer support for V1, LoRA adapter serialization... · c32e249a
  Sanger Steel authored May 22, 2025
```
[Frontend] [Core] Add Tensorizer support for V1, LoRA adapter serialization and deserialization (#17926)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
```
  c32e249a
22 May, 2025 4 commits
- [Frontend][Bug Fix] Update llama4 pythonic jinja template and llama4_pythonic parser (#17917) · c91fe7b1
  Kai Wu authored May 22, 2025
```
Signed-off-by: Kai Wu <kaiwu@meta.com>
```
  c91fe7b1
- [V1][Spec Decode][Bugfix] Load quantize weights for EAGLE (#18290) · a04720bc
  Ekagra Ranjan authored May 22, 2025
  
  a04720bc
- [Tool] Add NIXL installation script (#18172) · 7b9d832c
  lkchen authored May 22, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  7b9d832c
- [Build/CI] Fix CUDA 11.8 build (#17679) · 6e588da0
  Tyler Michael Smith authored May 22, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  6e588da0