Commits · f59ec35b7f9ff5b1da8aae12e10b83154685c958 · OpenDAS / vllm_cscc

"lib/llm/src/discovery/watcher.rs" did not exist on "b82e7327a0c96bb9174c9564db02e969860f6afe"

23 Jul, 2025 2 commits
- [V1] Check all pooling tasks during profiling (#21299) · f59ec35b
  Cyrus Leung authored Jul 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f59ec35b
- [Sampler] Introduce logprobs mode for logging (#21398) · accac829
  Lu Fang authored Jul 23, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  accac829
22 Jul, 2025 7 commits
- Add tokenization_kwargs to encode for embedding model truncation (#21033) · 44554a00
  Wang Yijun authored Jul 22, 2025
  
  44554a00
- [feat] Enable mm caching for transformers backend (#21358) · f38ee34a
  Raushan Turganbay authored Jul 22, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  f38ee34a
- [Core] Introduce popleft_n and append_n in FreeKVCacheBlockQueue to further... · ed250545
  Jialin Ouyang authored Jul 22, 2025
```
[Core] Introduce popleft_n and append_n in FreeKVCacheBlockQueue to further optimize block_pool (#21222)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  ed250545
- [Core] Optimize update checks in LogitsProcessor (#21245) · a3223766
  Jialin Ouyang authored Jul 22, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  a3223766
- [Bugfix] Fix eviction cached blocked logic (#21357) · 32142b3c
  Simon Mo authored Jul 22, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  32142b3c
- [Core] Minimize number of dict lookup in _maybe_evict_cached_block (#21281) · af376ca1
  Jialin Ouyang authored Jul 21, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  af376ca1
- [XPU] Enable external_launcher to serve as an executor via torchrun (#21021) · 25d585ab
  Chaojun Zhang authored Jul 22, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  25d585ab
21 Jul, 2025 4 commits
- [v1][sampler] Inplace logprobs comparison to get the token rank (#21283) · 8d0a01a5
  Lu Fang authored Jul 21, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8d0a01a5
- [DP] Fix Prometheus Logging (#21257) · 29d1ffc5
  Robert Shaw authored Jul 21, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  29d1ffc5
- [Attention] Clean up iRoPE in V1 (#21188) · 304dce7e
  Lucas Wilkinson authored Jul 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  304dce7e
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
20 Jul, 2025 2 commits
- Enable v1 metrics tests (#20953) · d1fb65bd
  Seiji Eicher authored Jul 19, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  d1fb65bd
- [TPU] support fp8 kv cache quantization (#19292) · 3a1d8940
  Chengji Yao authored Jul 19, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  3a1d8940
19 Jul, 2025 9 commits
- [BugFix] Fix full cuda graph slot_mapping (#21228) · 2e8cbb58
  fhl2000 authored Jul 20, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
```
  2e8cbb58
- [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) · 752c6ade
  Woosuk Kwon authored Jul 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  752c6ade
- [V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) · 881e3cbe
  Thomas Parnell authored Jul 19, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  881e3cbe
- [BugFix] Make PD work with Ray (#21072) · 9f414a12
  kourosh hakhamaneshi authored Jul 19, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  9f414a12
- [bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) · e3a0e43d
  Li, Jiang authored Jul 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3a0e43d
- [BugFix] Fix potential cuda-graph IMA (#21196) · 59f93530
  Lucas Wilkinson authored Jul 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  59f93530
- [BugFix][CPU] Fix `TorchSDPABackendImpl` doesn't have `use_irope` (#21200) · 468e2400
  Lucas Wilkinson authored Jul 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  468e2400
- [Core] Support Local Chunked Attention for Hybrid KV Cache (#19351) · 9a9fda14
  Lucia Fang authored Jul 19, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <fanglu@meta.com>
```
  9a9fda14
- Elastic Expert Parallel Initial Support (#20775) · 21793722
  Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  21793722
18 Jul, 2025 5 commits
- [Core] Avoid KVCacheBlock.__eq__ invocations in FreeKVCacheBlockQueue (#21005) · 0f199f19
  JialinOuyang-Meta authored Jul 18, 2025
```
Signed-off-by: Jialin Ouyang <jialino@meta.com>
```
  0f199f19
- [Core] Set pooling params based on task and model (#21128) · 45badd05
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  45badd05
- [Misc] Make MM embedding merge interface explicit in model runner (#21147) · ba2dfbb0
  Roger Wang authored Jul 18, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  ba2dfbb0
- [Attention] Make local attention backend agnostic (#21093) · 89cab4d0
  Lucas Wilkinson authored Jul 18, 2025
  
  89cab4d0
- [Bugfix] Fix the tensor non-contiguous issue for Flashinfer TRT-LLM backend... · 8dfb45ca
  elvischenv authored Jul 18, 2025
```
[Bugfix] Fix the tensor non-contiguous issue for Flashinfer TRT-LLM backend attention kernel (#21133)
```
  8dfb45ca
17 Jul, 2025 4 commits
- On environments where numa cannot be detected we get 0 (#21115) · ac9fb732
  Eric Curtin authored Jul 17, 2025
```
Signed-off-by: Eric Curtin <ecurtin@redhat.com>
```
  ac9fb732
- [V1] [KVConnector] Fix MultiprocExecutor worker output aggregation (#21048) · 4fcef49e
  David Ben-David authored Jul 17, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  4fcef49e
- [Attention] Refactor attention metadata builder interface (#20466) · 76b49444
  Lucas Wilkinson authored Jul 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  76b49444
- Remove torch_xla.tpu.version() from pallas.py. (#21065) · 72ad2735
  QiliangCui authored Jul 16, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  72ad2735
16 Jul, 2025 3 commits
- [TPU] fix kv_cache_update kernel block size choosing logic (#21007) · 85431bd9
  Chengji Yao authored Jul 15, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  85431bd9
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
- [Nvidia] Integrate SM100 cudnn prefill API to MLA prefill (#20411) · 30800b01
  Elfie Guo authored Jul 15, 2025
```
Signed-off-by: Elfie Guo <elfieg@nvidia.com>
Co-authored-by: Elfie Guo <eflieg@nvidia.com>
```
  30800b01
15 Jul, 2025 4 commits
- [Bug Fix] get_distributed_init_method should get the ip from get_ip i… (#20889) · 10be2094
  Chen LI authored Jul 15, 2025
```
Signed-off-by: Chen Li <lcpingping@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  10be2094
- [v1][core] Support for attention free models (#20811) · 4ffd963f
  Christian Pinto authored Jul 15, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  4ffd963f
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
- [TPU] Optimize kv cache update kernel (#20415) · c586b556
  Yifei Teng authored Jul 15, 2025
```
Signed-off-by: Yifei Teng <tengyifei88@gmail.com>
```
  c586b556