Commits · b2d6c81513e1ce9f2a993449b95ff1fd4e8091d7 · OpenDAS / vllm_cscc

31 Jul, 2025 1 commit
- skip conch-triton-kernels · b2d6c815
  zhuwenwen authored Jul 31, 2025
  
  b2d6c815
24 Jul, 2025 1 commit
- Add think chunk (#21333) · 6d8d0a24
  Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  6d8d0a24
23 Jul, 2025 1 commit
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
19 Jul, 2025 1 commit
- [bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) · e3a0e43d
  Li, Jiang authored Jul 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3a0e43d
17 Jul, 2025 4 commits
- [V0 deprecation] Remove V0 HPU backend (#21131) · 4de71463
  Woosuk Kwon authored Jul 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4de71463
- [VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) · 4ef00b5c
  kYLe authored Jul 17, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4ef00b5c
- [TPU] Start using python 3.12 (#21000) · 58760e12
  XiongfeiWei authored Jul 16, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  58760e12
- Update PyTorch to `torch==2.7.1` for CUDA (#21011) · 4e7dfbe7
  Michael Goin authored Jul 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4e7dfbe7
16 Jul, 2025 1 commit
- [Misc] bump xgrammar version to v0.1.21 (#20992) · b5c3b683
  Chauncey authored Jul 16, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  b5c3b683
15 Jul, 2025 4 commits
- Add full serve CLI reference back to docs (#20978) · b637e9dc
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b637e9dc
- Voxtral (#20970) · e7e3e6d2
  Patrick von Platen authored Jul 15, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e7e3e6d2
- feat: add image zoom to improve image viewing experience (#20763) · 37e2ecac
  Reid authored Jul 15, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  37e2ecac
- Use w8a8 quantized matmul Pallas kernel (#19170) · d4170fad
  XiongfeiWei authored Jul 14, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  d4170fad
14 Jul, 2025 2 commits
- [Bugfix] Bump up mistral_common to support v13 tokenizer (#20905) · f326ab9c
  22quinn authored Jul 14, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  f326ab9c
- [Prefix Cache] Add reproducible prefix-cache block hashing using SHA-256 + CBOR (64bit) (#20511) · 66f6fbd3
  Maroon Ayoub authored Jul 14, 2025
```
Signed-off-by: Maroon Ayoub <maroon.ayoub@ibm.com>
```
  66f6fbd3
12 Jul, 2025 2 commits
- [Sched] Enhance the logic to remove stopped requests from queues (#20739) · f45a3328
  Woosuk Kwon authored Jul 12, 2025
  
  f45a3328
- [CI/Build] Ensure compatability with Transformers v4.53 (#20541) · 01cae377
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  01cae377
11 Jul, 2025 1 commit
- [Bugfix] Upgrade depyf to 0.19 and streamline custom pass logging (#20777) · 762be26a
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
```
  762be26a
10 Jul, 2025 2 commits
- [V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) · d6902ce7
  Nathan Hoos authored Jul 10, 2025
```
Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>
```
  d6902ce7
- [Doc] Add engine args back in to the docs (#20674) · 3482fd7e
  Harry Mellor authored Jul 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3482fd7e
09 Jul, 2025 1 commit
- [Kernel] Add Conch backend for mixed-precision linear layer (#19818) · bf03ff35
  Jacob Manning authored Jul 09, 2025
```
Signed-off-by: Jacob Manning <jmanning+oss@stackav.com>
```
  bf03ff35
08 Jul, 2025 2 commits

Update torch/xla pin to 20250703 (#20589) · 849590a2
XiongfeiWei authored Jul 08, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
849590a2

[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e

Sanger Steel authored Jul 08, 2025


[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>

72d14d0e

07 Jul, 2025 1 commit
- [Misc] Set the minimum openai version (#20539) · 4ff79a13
  Jee Jee Li authored Jul 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4ff79a13
04 Jul, 2025 1 commit
- [CI] add kvcache-connector dependency definition and add into CI build (#18193) · 5561681d
  Peter Pan authored Jul 04, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  5561681d
03 Jul, 2025 2 commits
- [Bugfix] Fix flaky `test_streaming_response` test (#20363) · d1b689c4
  Nicolò Lucchesi authored Jul 03, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d1b689c4
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
01 Jul, 2025 1 commit
- [Misc] add xgrammar for arm64 (#18359) · 22e9d420
  Prashant Gupta authored Jul 01, 2025
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  22e9d420
27 Jun, 2025 2 commits

[CI] Sync test dependency with test.in for torch nightly (#19632) · 8b64c895

Yang Wang authored Jun 26, 2025


Signed-off-by: Yang Wang <elainewy@meta.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

8b64c895

[Quantization] Bump to use latest `compressed-tensors` (#20033) · a57d57fa
Dipika Sikka authored Jun 26, 2025
```
Signed-off-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
```
a57d57fa

26 Jun, 2025 2 commits
- [Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) · b69781f1
  Kunshang Ji authored Jun 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b69781f1
- [CPU] Fix torch version in x86 CPU backend (#19258) · 0567c824
  Li, Jiang authored Jun 26, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0567c824
25 Jun, 2025 1 commit
- Move to a faster base64 implementation (#19984) · 3443aaf8
  h-avsha authored Jun 25, 2025
```
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
```
  3443aaf8
21 Jun, 2025 1 commit
- update torch2.5 · 675d3e87
  zhuwenwen authored Jun 21, 2025
  
  675d3e87
19 Jun, 2025 1 commit
- [CI][CPU] Improve dummy Triton interfaces and fix the CPU CI (#19838) · 01220ce8
  Li, Jiang authored Jun 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  01220ce8
18 Jun, 2025 2 commits
- [TPU] Update torch-xla version to include paged attention tuned block change (#19813) · 04fefe7c
  QiliangCui authored Jun 18, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  04fefe7c
- release opt1 · 1a280da1
  zhuwenwen authored Jun 18, 2025
  
  1a280da1
17 Jun, 2025 1 commit
- [TPU] Update torch version to include paged attention kernel change (#19706) · dac8cc49
  Chenyaaang authored Jun 17, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  dac8cc49
16 Jun, 2025 2 commits
- [MISC] bump huggingface_hub pkg to 0.33.0 (#19547) · c3fec47b
  Ning Xie authored Jun 16, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c3fec47b
- [CI] Add mteb testing for rerank models (#19344) · f40f763f
  wang.yuqi authored Jun 16, 2025
  
  f40f763f