Commits · fbbe1fbac669a17f81c74c696f11a51167ed6a3c · OpenDAS / vllm_cscc · GitLab

19 Feb, 2025 19 commits
- [MISC] Logging the message about Ray teardown (#13502) · fbbe1fba
  Cody Yu authored Feb 19, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Rui Qiao <161574667+ruisearch42@users.noreply.github.com>
```
  fbbe1fba
- Fix copyright year to auto get current year (#13561) · 01c184b8
  Wilson Wu authored Feb 20, 2025
  
  01c184b8
- [doc] clarify multi-node serving doc (#13558) · ad5a35c2
  youkaichao authored Feb 19, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ad5a35c2
- [Bugfix] Fix device ordinal for multi-node spec decode (#13269) · 5ae9f26a
  shangmingc authored Feb 19, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  5ae9f26a
- [VLM][Bugfix] Pass processor kwargs properly on init (#13516) · 377d10bd
  Cyrus Leung authored Feb 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  377d10bd
- [doc] clarify profiling is only for developers (#13554) · 52ce14d3
  youkaichao authored Feb 19, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  52ce14d3
- [CI/Build] force writing version file (#13544) · 81dabf24
  Daniele authored Feb 19, 2025
```
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
```
  81dabf24
- [Feature] Pluggable platform-specific scheduler (#13161) · 42333026
  Yannick Schnider authored Feb 19, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
```
  42333026
- [V1][Core] Generic mechanism for handling engine utility (#13060) · caf7ff44
  Nick Hill authored Feb 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  caf7ff44
- [Model][Speculative Decoding] DeepSeek MTP spec decode (#12755) · f525c0be
  Lucia Fang authored Feb 19, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  f525c0be
- [Bugfix] Fix Positive Feature Layers in Llava Models (#13514) · 983a40a8
  Alex Brooks authored Feb 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
```
  983a40a8
- use device param in load_model method (#13037) · fdc5df6f
  Zhe Zhang authored Feb 19, 2025
  
  fdc5df6f
- [perf-benchmark] Fix ECR path for premerge benchmark (#13512) · 3b05cd45
  Kevin H. Luu authored Feb 18, 2025
```
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
```
  3b05cd45
- [1/n][CI] Load models in CI from S3 instead of HF (#13205) · d5d214ac
  Kevin H. Luu authored Feb 18, 2025
```
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
```
  d5d214ac
- [Doc] Add clarification note regarding paligemma (#13511) · fd84857f
  Roger Wang authored Feb 18, 2025
  
  fd84857f
- [ROCm][MoE configs] mi325 mixtral & mi300 qwen_moe (#13503) · 8aada19d
  Divakar Verma authored Feb 19, 2025
  
  8aada19d
- [perf-benchmark] Allow premerge ECR (#13509) · 9aa95b0e
  Kevin H. Luu authored Feb 18, 2025
```
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
```
  9aa95b0e
- [Hardware][Gaudi][Feature] Support Contiguous Cache Fetch (#12139) · d0a7a276
  Yu-Zhou authored Feb 19, 2025
```
Signed-off-by: yuzhou <yuzhou@habana.ai>
Signed-off-by: zhouyu5 <yu.zhou@intel.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  d0a7a276
- [Misc] Remove dangling references to `--use-v2-block-manager` (#13492) · 00b69c2d
  Harry Mellor authored Feb 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  00b69c2d
18 Feb, 2025 21 commits
- [V1][Spec Decode] Optimize N-gram matching with Numba (#13365) · 4c822298
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4c822298
- Pin Ray version to 2.40.0 (#13490) · c8d70e24
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c8d70e24
- [V1] Optimize handling of sampling metadata and req_ids list (#13244) · 30172b49
  Nick Hill authored Feb 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  30172b49
- [V1][Tests] Adding additional testing for multimodal models to V1 (#13308) · a4d577b3
  Murali Andoorveedu authored Feb 18, 2025
```
Signed-off-by: andoorve <37849411+andoorve@users.noreply.github.com>
```
  a4d577b3
- [misc] fix debugging code (#13487) · 7b203b76
  youkaichao authored Feb 19, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  7b203b76
- [V1][PP] Enable true PP with Ray executor (#13472) · 4fb8142a
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4fb8142a
- [CI/Build] migrate static project metadata from setup.py to pyproject.toml (#8772) · a02c86b4
  Daniele authored Feb 18, 2025
  
  a02c86b4
- [Bugfix] Fix invalid rotary embedding unit test (#13431) · 38094584
  Liangfu Chen authored Feb 18, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  38094584
- [Bugfix] Handle content type with optional parameters (#13383) · d3231cb4
  zifeitong authored Feb 18, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
```
  d3231cb4
- [ROCm] Make amdsmi import optional for other platforms (#13460) · 435b502a
  Cyrus Leung authored Feb 18, 2025
  
  435b502a
- [Bugfix] Remove noisy error logging during local model loading (#13458) · 29fc5772
  Isotr0py authored Feb 18, 2025
  
  29fc5772
- [Doc]: Improve feature tables (#13224) · 2358ca52
  Harry Mellor authored Feb 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2358ca52
- [Bugfix] Fix failing transformers dynamic module resolving with spawn multiproc method (#13403) · 8cf97f86
  Isotr0py authored Feb 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  8cf97f86
- [Bugfix] Ensure LoRA path from the request can be included in err msg (#13450) · e2603fef
  Yuan Tang authored Feb 18, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  e2603fef
- Add outlines fallback when JSON schema has enum (#13449) · b53d7998
  Michael Goin authored Feb 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b53d7998
- [V1][PP] Fix & Pin Ray version in requirements-cuda.txt (#13436) · 9915912f
  Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9915912f
- [Quant] Aria SupportsQuant (#13416) · d1b649f1
  Kyle Sayers authored Feb 18, 2025
  
  d1b649f1
- [core] fix sleep mode in pytorch 2.6 (#13456) · ac19b519
  youkaichao authored Feb 18, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ac19b519
- [Bugfix] Only print out chat template when supplied (#13444) · a1074b3e
  Yuan Tang authored Feb 18, 2025
  
  a1074b3e
- [Quant] Arctic SupportsQuant (#13366) · 00294e1b
  Kyle Sayers authored Feb 18, 2025
  
  00294e1b
- [Quant] Molmo SupportsQuant (#13336) · 88787bce
  Kyle Sayers authored Feb 18, 2025
  
  88787bce