Commits · 0ddf88e16e6ef4d985716f5bdec60fd053a260fa · OpenDAS / vllm_cscc · GitLab

23 May, 2025 40 commits
- [CI] Enable test_initialization to run on V1 (#16736) · 0ddf88e1
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0ddf88e1
- Use prebuilt FlashInfer x86_64 PyTorch 2.7 CUDA 12.8 wheel for CI (#18537) · 1645b601
  Huy Do authored May 23, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  1645b601
- [V1] Support Deepseek MTP (#18435) · 2628a69e
  Jiayi Yao authored May 23, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  2628a69e
- [Doc] Fix broken links and unlinked docs, add shortcuts to home sidebar (#18627) · 371f7e4c
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  371f7e4c
- [Doc] Avoid documenting dynamic / internal modules (#18626) · 15b45ffb
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  15b45ffb
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- [Doc] fix list formatting (#18624) · 8ddd1cf2
  David Xia authored May 23, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  8ddd1cf2
- [v1] Redo "Support multiple KV cache groups in GPU model runner (#17945)" (#18593) · 6550114c
  Chen Zhang authored May 24, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6550114c
- [Docs] Change mkdocs to not use directory urls (#18622) · 9520a989
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  9520a989
- Fix figures in design doc (#18612) · 3d28ad34
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3d28ad34
- Refactor pplx init logic to make it modular (prepare for deepep) (#18200) · 6a7988c5
  youkaichao authored May 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6a7988c5
- [Doc] Use a different color for the announcement (#18616) · 022d8abe
  Cyrus Leung authored May 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  022d8abe
- [Doc] Fix markdown list indentation for MkDocs rendering (#18620) · 5221815a
  Hyogeun Oh (오효근) authored May 24, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  5221815a
- [Bugfix][Build/CI] Fixup CUDA compiler version check for CUDA_SUPPORTED_ARCHS (#18579) · 1068556b
  Simon Mo authored May 23, 2025
  
  1068556b
- [Misc] add Haystack integration (#18601) · 2cd1fa45
  Reid authored May 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2cd1fa45
- Include private attributes in API documentation (#18614) · d4c29197
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d4c29197
- [Bugfix] Fix transformers model impl ignored for mixtral quant (#18602) · 6220f3c6
  Tristan Leclercq authored May 23, 2025
```
Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>
```
  6220f3c6
- Fix examples with code blocks in docs (#18609) · 52fb23f4
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  52fb23f4
- [CI/Build] Fix V1 flag being set in entrypoints tests (#18598) · 6dd51c7e
  Cyrus Leung authored May 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6dd51c7e
- Replace `{func}` with mkdocs style links (#18610) · 2edb533a
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2edb533a
- [Doc] Fix indent of contributing to vllm (#18611) · 38a95cb4
  Hyogeun Oh (오효근) authored May 23, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  38a95cb4
- [CI] fix kv_cache_type argument (#18594) · cd821ea5
  Ning Xie authored May 23, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  cd821ea5
- [Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to... · 7ab056c2
  Kay Yan authored May 23, 2025
```
[Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to `requirements/cpu.txt`  (#18542)
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  7ab056c2
- Add myself as docs code owner (#18605) · 6526e051
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6526e051
- [V0][Bugfix] Fix parallel sampling performance regression when guided decoding is enabled (#17731) · e493e485
  Madeesh Kannan authored May 23, 2025
```
Signed-off-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  e493e485
- [Bugfix][Model] Fix baichuan model loader for tp (#18597) · 4ce64e2d
  Mengqing Cao authored May 23, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  4ce64e2d
- Revert "[V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (#18034)" (#18600) · fbb13a2c
  Cyrus Leung authored May 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fbb13a2c
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
- [Bugfix] Add half type support in reshape_and_cache_cpu_impl on x86 cpu platform (#18430) · d0bc2f81
  Yuqi Zhang authored May 23, 2025
```
Signed-off-by: Yuqi Zhang <yuqizhang@google.com>
Co-authored-by: Yuqi Zhang <yuqizhang@google.com>
```
  d0bc2f81
- [Feature][V1]: suupports cached_tokens in response usage (#18149) · b046cf79
  Chauncey authored May 23, 2025
```
Co-authored-by: simon-mo <xmo@berkeley.edu>
```
  b046cf79
- [Doc] Update quickstart and install for cu128 using `--torch-backend=auto` (#18505) · 54af9159
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  54af9159
- [Feature]Add async tensor parallelism using compilation pass (#17882) · 71ea614d
  cascade authored May 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  71ea614d
- [V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (#18034) · 4c611348
  RonaldBXu authored May 23, 2025
```
Signed-off-by: Ronald Xu <ronaldxu@amazon.com>
```
  4c611348
- [Hardware] correct method signatures for HPU,ROCm,XPU (#18551) · 60cad94b
  Ning Xie authored May 23, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  60cad94b
- [Misc] Replace `cuda` hard code with `current_platform` (#16983) · 9c1baa5b
  Shanshan Shen authored May 23, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  9c1baa5b
- [Bugfix][Benchmarks] Fix a benchmark of deepspeed-mii backend to use api_key (#17291) · 4be2255c
  Teruaki Ishizaki authored May 23, 2025
```
Signed-off-by: Teruaki Ishizaki <teruaki.ishizaki@ntt.com>
```
  4be2255c
- [Neuron] Remove bypass on EAGLEConfig and add a test (#18514) · ed5d4082
  aws-elaineyz authored May 22, 2025
```
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
```
  ed5d4082
- [Spec Decode] Make EAGLE3 draft token ID mapping optional (#18488) · 583507d1
  Benjamin Chislett authored May 22, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  583507d1
- [Bugfix] Set `KVTransferConfig.engine_id` in post_init (#18576) · e44d8ce8
  lkchen authored May 22, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  e44d8ce8
- [BugFix] Increase TP execute_model timeout (#18558) · 93ecb813
  Nick Hill authored May 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  93ecb813