Commits · d637b960994119907b41c82d79f5a71c96dd419b · OpenDAS / vllm_cscc

"tests/models/language/pooling/test_classification.py" did not exist on "07e981fdf43bb7a7186c782a5ad6b99b36c2fc19"

19 May, 2025 6 commits

[BugFix] [Vul] Add missing `usedforsecurity=False` in MD5 hashing to enable FIPS (#18319) · d637b960

Shaoyu Yang authored May 19, 2025


Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: shaoyuyoung <shaoyuyoung@gmail.com>
Co-authored-by: cascade <cascade812@outlook.com>

d637b960

fix: Add type specifications for CLI arguments in tensorizer options (#18314) · 275c5dae
CYJiang authored May 19, 2025

275c5dae
[Build] Supports CUDA 12.6 and 11.8 after Blackwell Update (#18316) · 47fda6d0
Simon Mo authored May 18, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
47fda6d0

[Misc] extract parser.parse_args() (#18323) · 27d09526

Reid authored May 19, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

27d09526

Feature/vllm/input embedding completion api (#17590) · 221cfc2f

Nan Qin authored May 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

221cfc2f

[Spec Decode][V0] Fix spec decode correctness test in V0 eagle/medusa (#18175) · 9da1095d
wwl2755 authored May 18, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
9da1095d

18 May, 2025 5 commits
- [Doc] Add doc to explain the usage of Qwen3 thinking (#18291) · d1211f87
  Robin authored May 19, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  d1211f87
- [Misc] add litellm integration (#18320) · b6a6e7a5
  Reid authored May 18, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  b6a6e7a5
- Fix copy-paste error in phi4mm image processing (#18315) · 4fb349f6
  Lifu Huang authored May 18, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  4fb349f6
- [Model] Use sigmoid for single-label classification (#18313) · 908733ac
  22quinn authored May 18, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  908733ac
- [doc] update reasoning doc (#18306) · 1a8f68bb
  Reid authored May 18, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1a8f68bb
17 May, 2025 11 commits
- Support sequence parallelism combined with pipeline parallelism (#18243) · 9ab2c02f
  cascade authored May 17, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  9ab2c02f
- [MISC] fix typo (#18305) · 66e63e86
  Ning Xie authored May 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  66e63e86
- [Model] use AutoWeightsLoader for solar (#18113) · 9214e606
  rongfu.leng authored May 17, 2025
  
  9214e606
- Fixed build on ppc64le due to openssl conflicts (#18262) · f880d425
  Nishidha authored May 17, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
```
  f880d425
- Update Dockerfile to build for Blackwell (#18095) · dcfe9523
  Michael Goin authored May 17, 2025
  
  dcfe9523
- [Hardware][TPU] Optionally import for TPU backend (#18269) · 48ac2bed
  Siyuan Liu authored May 17, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
Co-authored-by: Carol Zheng <cazheng@google.com>
Co-authored-by: Jade Zheng <zheng.shoujian@outlook.com>
Co-authored-by: Hongmin Fan <fanhongmin@google.com>
```
  48ac2bed
- [P/D][V1] Support dynamic loading of external KV connector implementations (#18142) · 3e0d4350
  David Ben-David authored May 17, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  3e0d4350
- [BugFix] Correct max_model_len derivation from config.json for Mistral format (#17937) · 4ee4826e
  汪志鹏 authored May 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: tracelogfb <48808670+tracelogfb@users.noreply.github.com>
Co-authored-by: Stephen Chen <tracelog@meta.com>
```
  4ee4826e
- [Misc] reformat the collect-env output (#18285) · 60017dc8
  Reid authored May 17, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  60017dc8
- Move cli args docs to its own page (#18228) (#18264) · 55f1a468
  Trevor Royer authored May 16, 2025
```
Signed-off-by: Trevor Royer <troyer@redhat.com>
```
  55f1a468
- [V1][P/D] Local attention optimization for NIXL (#18170) · fd195b19
  Michael Goin authored May 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  fd195b19
16 May, 2025 18 commits
- [Spec Decode] Don't fall back to V0 when spec decoding is enabled (#18265) · fabe89bb
  Woosuk Kwon authored May 16, 2025
  
  fabe89bb
- [Bugfix] fix `an illegal memory access was encountered` of marlin kernel + act_order (#18245) · e73b7dfd
  Jinzhen Lin authored May 17, 2025
  
  e73b7dfd
- [Sampler] Adapt to FlashInfer 0.2.3 sampler API (#15777) · 7fdfa015
  Bowen Wang authored May 16, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7fdfa015
- [CI] Assign reviewer to mergify with changes to Tensorizer files (#18278) · aef94c6d
  Sanger Steel authored May 16, 2025
  
  aef94c6d
- [BugFix] Fix ordering of KVConnector finished send/rcv sets (#18211) · 0ceaebf8
  Nick Hill authored May 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0ceaebf8
- [BugFix] Fix multi async save in MultiConnector (#18246) · 1db4f47f
  Nick Hill authored May 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  1db4f47f
- [Misc][MacOS] fix bfloat16 error (#18249) · d3d91b6f
  Reid authored May 16, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  d3d91b6f
- [Model] Use autoweightloader for dbrx (#18251) · 87d87147
  learner0810 authored May 16, 2025
```
Signed-off-by: learner0810 <zhongjun.li@daocloud.io>
```
  87d87147
- [Fix] Fix typo in `resolve_hf_chat_template` (#18259) · a5f8c111
  fxmarty-amd authored May 16, 2025
```
Signed-off-by: Felix Marty <felmarty@amd.com>
```
  a5f8c111
- use ceil_div in cutlass block scaling shape check (#17918) · e23564cb
  Lain authored May 16, 2025
  
  e23564cb
- [Misc] Consolidate Audio tests into multimodal common generation tests (#18214) · 390ec889
  Isotr0py authored May 16, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  390ec889
- [Misc] Add Ray Prometheus logger to V1 (#17925) · 54181767
  Seiji Eicher authored May 16, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  54181767
- [PERF] Speed up Qwen2.5-VL model by speed up rotary position embedding (#17973) · 67da5720
  Vadim Gimpelson authored May 16, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  67da5720
- [doc] fix multimodal example script (#18089) · 5c04bb8b
  David Xia authored May 16, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  5c04bb8b
- [Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1 (#17827) · 3d2779c2
  Lucia Fang authored May 15, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  3d2779c2
- Throw better error for when running into k8s service discovery issue (#18209) · 6b31c84a
  Will Eaton authored May 16, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  6b31c84a
- Allow users to pass arbitrary JSON keys from CLI (#18208) · b18201fe
  Harry Mellor authored May 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b18201fe
- [Model] vLLM v1 supports Medusa (#17956) · f4937a51
  Sky Lee authored May 16, 2025
```
Signed-off-by: lisiqi23 <lisiqi23@xiaomi.com>
Signed-off-by: skylee-01 <497627264@qq.com>
Co-authored-by: lisiqi23 <lisiqi23@xiaomi.com>
```
  f4937a51