Commits · 58bb902186a87007deeeef2d2af02ed2b13bb182 · OpenDAS / vllm_cscc

31 Jul, 2025 1 commit
- fix(setup): improve precompiled wheel setup for Docker builds (#22025) · 58bb9021
  Doug Smith authored Jul 31, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  58bb9021
30 Jul, 2025 1 commit
- [Docs] Reduce the size of the built docs (#21920) · 88edf599
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  88edf599
29 Jul, 2025 1 commit
- Add `flashinfer_python` to CUDA wheel requirements (#21389) · a33ea28b
  Michael Goin authored Jul 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a33ea28b
28 Jul, 2025 2 commits
- [Bugfix][CI/Build] Update peft version in test requirement (#21729) · 31084b3b
  Isotr0py authored Jul 28, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  31084b3b
- [Docs] Add revision date to rendered docs (#21752) · 1395dd9c
  Harry Mellor authored Jul 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1395dd9c
26 Jul, 2025 1 commit
- [TPU] Update ptxla nightly version to 20250724 (#21555) · f1b286b2
  Chengji Yao authored Jul 25, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  f1b286b2
25 Jul, 2025 1 commit
- [CI] Unifying Dockerfiles for ARM and X86 Builds (#21343) · 396ee941
  Kebe authored Jul 25, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  396ee941
24 Jul, 2025 4 commits

[P/D] Support CPU Transfer in NixlConnector (#18293) · 60662849

Juncheng Gu authored Jul 24, 2025


Signed-off-by: Juncheng Gu <juncgu@gmail.com>
Signed-off-by: Richard Liu <ricliu@google.com>
Co-authored-by: Richard Liu <39319471+richardsliu@users.noreply.github.com>
Co-authored-by: Richard Liu <ricliu@google.com>

60662849

[Fix] Update mamba_ssm to 2.2.5 (#21421) · 5a19a6c6
elvischenv authored Jul 24, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
5a19a6c6
[Feat] Allow custom naming of vLLM processes (#21445) · 6da00785
Chauncey authored Jul 24, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
6da00785
Add think chunk (#21333) · 6d8d0a24
Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
6d8d0a24

23 Jul, 2025 1 commit
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
19 Jul, 2025 1 commit
- [bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) · e3a0e43d
  Li, Jiang authored Jul 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3a0e43d
17 Jul, 2025 4 commits
- [V0 deprecation] Remove V0 HPU backend (#21131) · 4de71463
  Woosuk Kwon authored Jul 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4de71463
- [VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) · 4ef00b5c
  kYLe authored Jul 17, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4ef00b5c
- [TPU] Start using python 3.12 (#21000) · 58760e12
  XiongfeiWei authored Jul 16, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  58760e12
- Update PyTorch to `torch==2.7.1` for CUDA (#21011) · 4e7dfbe7
  Michael Goin authored Jul 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4e7dfbe7
16 Jul, 2025 1 commit
- [Misc] bump xgrammar version to v0.1.21 (#20992) · b5c3b683
  Chauncey authored Jul 16, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  b5c3b683
15 Jul, 2025 4 commits
- Add full serve CLI reference back to docs (#20978) · b637e9dc
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b637e9dc
- Voxtral (#20970) · e7e3e6d2
  Patrick von Platen authored Jul 15, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e7e3e6d2
- feat: add image zoom to improve image viewing experience (#20763) · 37e2ecac
  Reid authored Jul 15, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  37e2ecac
- Use w8a8 quantized matmul Pallas kernel (#19170) · d4170fad
  XiongfeiWei authored Jul 14, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  d4170fad
14 Jul, 2025 2 commits
- [Bugfix] Bump up mistral_common to support v13 tokenizer (#20905) · f326ab9c
  22quinn authored Jul 14, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  f326ab9c
- [Prefix Cache] Add reproducible prefix-cache block hashing using SHA-256 + CBOR (64bit) (#20511) · 66f6fbd3
  Maroon Ayoub authored Jul 14, 2025
```
Signed-off-by: Maroon Ayoub <maroon.ayoub@ibm.com>
```
  66f6fbd3
12 Jul, 2025 2 commits
- [Sched] Enhance the logic to remove stopped requests from queues (#20739) · f45a3328
  Woosuk Kwon authored Jul 12, 2025
  
  f45a3328
- [CI/Build] Ensure compatability with Transformers v4.53 (#20541) · 01cae377
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  01cae377
11 Jul, 2025 1 commit
- [Bugfix] Upgrade depyf to 0.19 and streamline custom pass logging (#20777) · 762be26a
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
```
  762be26a
10 Jul, 2025 2 commits
- [V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) · d6902ce7
  Nathan Hoos authored Jul 10, 2025
```
Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>
```
  d6902ce7
- [Doc] Add engine args back in to the docs (#20674) · 3482fd7e
  Harry Mellor authored Jul 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3482fd7e
09 Jul, 2025 1 commit
- [Kernel] Add Conch backend for mixed-precision linear layer (#19818) · bf03ff35
  Jacob Manning authored Jul 09, 2025
```
Signed-off-by: Jacob Manning <jmanning+oss@stackav.com>
```
  bf03ff35
08 Jul, 2025 2 commits

Update torch/xla pin to 20250703 (#20589) · 849590a2
XiongfeiWei authored Jul 08, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
849590a2

[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e

Sanger Steel authored Jul 08, 2025


[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>

72d14d0e

07 Jul, 2025 1 commit
- [Misc] Set the minimum openai version (#20539) · 4ff79a13
  Jee Jee Li authored Jul 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4ff79a13
04 Jul, 2025 1 commit
- [CI] add kvcache-connector dependency definition and add into CI build (#18193) · 5561681d
  Peter Pan authored Jul 04, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  5561681d
03 Jul, 2025 2 commits
- [Bugfix] Fix flaky `test_streaming_response` test (#20363) · d1b689c4
  Nicolò Lucchesi authored Jul 03, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d1b689c4
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
01 Jul, 2025 1 commit
- [Misc] add xgrammar for arm64 (#18359) · 22e9d420
  Prashant Gupta authored Jul 01, 2025
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  22e9d420
27 Jun, 2025 2 commits

[CI] Sync test dependency with test.in for torch nightly (#19632) · 8b64c895

Yang Wang authored Jun 26, 2025


Signed-off-by: Yang Wang <elainewy@meta.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

8b64c895

[Quantization] Bump to use latest `compressed-tensors` (#20033) · a57d57fa
Dipika Sikka authored Jun 26, 2025
```
Signed-off-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
```
a57d57fa

26 Jun, 2025 1 commit
- [Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) · b69781f1
  Kunshang Ji authored Jun 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b69781f1