Commits · cfbcb9ed87b342663b212150053fb2ddb6f59a57 · OpenDAS / vllm_cscc

"tests/utils_/test_argparse_utils.py" did not exist on "8a297115e2367d463b781adb86b55ac740594cf6"

16 Jul, 2025 14 commits
- [Voxtral] Add more tests (#21010) · cfbcb9ed
  Patrick von Platen authored Jul 16, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  cfbcb9ed
- [Doc] Remove duplicate docstring (#21012) · 76ddeff2
  Wentao Ye authored Jul 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  76ddeff2
- [Bugfix] Fix Mistral3 support on SM100/SM120 (#20998) · f4609833
  Michael Goin authored Jul 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f4609833
- [CI][HPU] update for v0 deprecate by switching to VLLM_TARGET_DEVICE=empty (#21006) · e9534c72
  Chendi.Xue authored Jul 15, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  e9534c72
- Add Dockerfile argument for VLLM_USE_PRECOMPILED environment (#20943) · 79764460
  Doug Smith authored Jul 15, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  79764460
- [Bugfix] Correct per_act_token in CompressedTensorsW8A8Fp8MoECutlassM… (#20937) · fcb9f879
  Ming Yang authored Jul 15, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  fcb9f879
- [Docs] Enhance Anyscale documentation, add quickstart links for vLLM (#21018) · 3ed94f9d
  Ricardo Decal authored Jul 15, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  3ed94f9d
- [Misc] Refactor: Improve argument handling for `conda` command (#20481) · fa839565
  Reid authored Jul 16, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  fa839565
- [Chore] Remove outdated transformers check (#20989) · 75a99b98
  Brayden Zhong authored Jul 15, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  75a99b98
- [Misc] bump xgrammar version to v0.1.21 (#20992) · b5c3b683
  Chauncey authored Jul 16, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  b5c3b683
- [Model] Add ModelConfig class for GraniteMoeHybrid to override default... · 6cbc4d4b
  Thomas Parnell authored Jul 16, 2025
```
[Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture (#20923)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  6cbc4d4b
- [Frontend] Remove print left in FrontendArgs.add_cli_args (#21004) · 153c6f1e
  Michael Goin authored Jul 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  153c6f1e
- [Frontend] OpenAI Responses API supports input image (#20975) · 34cda778
  Chauncey authored Jul 16, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  34cda778
- [Nvidia] Integrate SM100 cudnn prefill API to MLA prefill (#20411) · 30800b01
  Elfie Guo authored Jul 15, 2025
```
Signed-off-by: Elfie Guo <elfieg@nvidia.com>
Co-authored-by: Elfie Guo <eflieg@nvidia.com>
```
  30800b01
15 Jul, 2025 26 commits
- [Bug Fix] get_distributed_init_method should get the ip from get_ip i… (#20889) · 10be2094
  Chen LI authored Jul 15, 2025
```
Signed-off-by: Chen Li <lcpingping@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  10be2094
- [Frontend] Support cache_salt in /v1/completions and /v1/responses (#20981) · 19c86306
  Marko Rosenmueller authored Jul 15, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
  19c86306
- [BugFix] fix 3 issues: (1) using metadata for causal-conv1d, (2) indexing... · f29fd8a7
  Tuan, Hoang-Trong authored Jul 15, 2025
```
[BugFix] fix 3 issues: (1) using metadata for causal-conv1d, (2) indexing overflow in v1 vLLM, and (3) init_states in v0 (#20838)
Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
```
  f29fd8a7
- [ROCm] warpSize is being made non constexpr in ROCm 7.0 (#20330) · ed10f3ce
  Gregory Shtrasberg authored Jul 15, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  ed10f3ce
- Add full serve CLI reference back to docs (#20978) · b637e9dc
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b637e9dc
- [Deprecation] Remove `nullable_kvs` (#20969) · 1e36c868
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1e36c868
- Configure Gemini (#20971) · 5bac6136
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5bac6136
- [Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979) · 313ae8c1
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  313ae8c1
- [CI/Build] Fix wrong path in Transformers Nightly Models Test (#20994) · c847e34b
  Cyrus Leung authored Jul 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c847e34b
- Voxtral (#20970) · e7e3e6d2
  Patrick von Platen authored Jul 15, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e7e3e6d2
- [v1][core] Support for attention free models (#20811) · 4ffd963f
  Christian Pinto authored Jul 15, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  4ffd963f
- [Deprecation] Remove `TokenizerPoolConfig` (#20968) · 56fe4bed
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  56fe4bed
- [doc] Add more details for Ray-based DP (#20948) · d9127818
  Rui Qiao authored Jul 15, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  d9127818
- [MISC] Add init files for python package (#20908) · 20149d84
  Li Wang authored Jul 15, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  20149d84
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
- [TPU] Optimize kv cache update kernel (#20415) · c586b556
  Yifei Teng authored Jul 15, 2025
```
Signed-off-by: Yifei Teng <tengyifei88@gmail.com>
```
  c586b556
- [Docs] Improve documentation for ray cluster launcher helper script (#20602) · 33d56000
  Ricardo Decal authored Jul 15, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  33d56000
- [frontend] Refactor CLI Args for a better modular integration (#20206) · f148c44c
  kourosh hakhamaneshi authored Jul 15, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  f148c44c
- [Docs] Improve documentation for RLHF example (#20598) · 235bfd5d
  Ricardo Decal authored Jul 15, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  235bfd5d
- [frontend] Add --help=page option for paginated help output (#20961) · 68d28e37
  Reid authored Jul 15, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  68d28e37
- [Misc] Refactor AllReduceFusionPass. Remove parameter (#20918) · 37a7d5d7
  Ilya Markov authored Jul 15, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  37a7d5d7
- Implement Async Scheduling (#19970) · d4d30940
  Woosuk Kwon authored Jul 14, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d4d30940
- [Model] Add AutoWeightsLoader support for BERT, RoBERTa (#20534) · 85bd6599
  Jennifer He authored Jul 15, 2025
```
Signed-off-by: Jennifer He <islandhe@gmail.com>
Signed-off-by: <islandhe@gmail.com>
Signed-off-by: Jen H <islandhe@gmail.com>
```
  85bd6599
- [cold start] replace VLLM_COMPILE_DEPYF with debug_dump_dir (#20940) · 91b3d190
  Boyuan Feng authored Jul 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  91b3d190
- [Doc] Clearer mistral3 and pixtral model support description (#20926) · fc017915
  Isotr0py authored Jul 15, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  fc017915
- [Bugfix] Switch bailout logic for kv-cache-dtype with SM100 Flashinfer (#20934) · 9ad0a458
  Pavani Majety authored Jul 14, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  9ad0a458