Commits · 983a40a8bb2ef2a0ed9c5134d49358c38d6b03ae · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "dec197e3e5d14e1d4fbad61b565e151f52976c0f"

19 Feb, 2025 5 commits
- [Bugfix] Fix Positive Feature Layers in Llava Models (#13514) · 983a40a8
  Alex Brooks authored Feb 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
```
  983a40a8
- use device param in load_model method (#13037) · fdc5df6f
  Zhe Zhang authored Feb 19, 2025
  
  fdc5df6f
- [1/n][CI] Load models in CI from S3 instead of HF (#13205) · d5d214ac
  Kevin H. Luu authored Feb 18, 2025
```
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
```
  d5d214ac
- [ROCm][MoE configs] mi325 mixtral & mi300 qwen_moe (#13503) · 8aada19d
  Divakar Verma authored Feb 19, 2025
  
  8aada19d
- [Hardware][Gaudi][Feature] Support Contiguous Cache Fetch (#12139) · d0a7a276
  Yu-Zhou authored Feb 19, 2025
```
Signed-off-by: yuzhou <yuzhou@habana.ai>
Signed-off-by: zhouyu5 <yu.zhou@intel.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  d0a7a276
18 Feb, 2025 19 commits
- [V1][Spec Decode] Optimize N-gram matching with Numba (#13365) · 4c822298
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4c822298
- [V1] Optimize handling of sampling metadata and req_ids list (#13244) · 30172b49
  Nick Hill authored Feb 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  30172b49
- [V1][PP] Enable true PP with Ray executor (#13472) · 4fb8142a
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4fb8142a
- [Bugfix] Handle content type with optional parameters (#13383) · d3231cb4
  zifeitong authored Feb 18, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
```
  d3231cb4
- [ROCm] Make amdsmi import optional for other platforms (#13460) · 435b502a
  Cyrus Leung authored Feb 18, 2025
  
  435b502a
- [Bugfix] Remove noisy error logging during local model loading (#13458) · 29fc5772
  Isotr0py authored Feb 18, 2025
  
  29fc5772
- [Bugfix] Fix failing transformers dynamic module resolving with spawn multiproc method (#13403) · 8cf97f86
  Isotr0py authored Feb 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  8cf97f86
- [Bugfix] Ensure LoRA path from the request can be included in err msg (#13450) · e2603fef
  Yuan Tang authored Feb 18, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  e2603fef
- Add outlines fallback when JSON schema has enum (#13449) · b53d7998
  Michael Goin authored Feb 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b53d7998
- [Quant] Aria SupportsQuant (#13416) · d1b649f1
  Kyle Sayers authored Feb 18, 2025
  
  d1b649f1
- [core] fix sleep mode in pytorch 2.6 (#13456) · ac19b519
  youkaichao authored Feb 18, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ac19b519
- [Bugfix] Only print out chat template when supplied (#13444) · a1074b3e
  Yuan Tang authored Feb 18, 2025
  
  a1074b3e
- [Quant] Arctic SupportsQuant (#13366) · 00294e1b
  Kyle Sayers authored Feb 18, 2025
  
  00294e1b
- [Quant] Molmo SupportsQuant (#13336) · 88787bce
  Kyle Sayers authored Feb 18, 2025
  
  88787bce
- [v1] fix parallel config rank (#13445) · 932b51ce
  youkaichao authored Feb 18, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  932b51ce
- [ROCm] fix get_device_name for rocm (#13438) · 7c7adf81
  Divakar Verma authored Feb 17, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  7c7adf81
- [Model] Enable quantization support for `transformers` backend (#12960) · 67ef8f66
  Isotr0py authored Feb 18, 2025
  
  67ef8f66
- [Misc] Remove dangling references to `SamplingType.BEAM` (#13402) · efbe8544
  Harry Mellor authored Feb 18, 2025
  
  efbe8544
- [Bugfix][CI][V1] Work around V1 + CUDA Graph + torch._scaled_mm fallback issue (#13425) · b3942e15
  Tyler Michael Smith authored Feb 17, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  b3942e15
17 Feb, 2025 10 commits
- [V1][Spec decode] Move drafter to model runner (#13363) · cd4a72a2
  Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cd4a72a2
- [V1][PP] Fix intermediate tensor values (#13417) · 6ac485a9
  Cody Yu authored Feb 17, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  6ac485a9
- [V1] Get input tokens from scheduler (#13339) · 4c21ce9e
  Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4c21ce9e
- [Bugfix] Fix VLLM_USE_MODELSCOPE issue (#13384) · ce77eb94
  r.4ntix authored Feb 17, 2025
  
  ce77eb94
- [Bugfix] fix xpu communicator (#13368) · 30513d1c
  Yan Ma authored Feb 17, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  30513d1c
- [Model] Support Mamba2 (Codestral Mamba) (#9292) · 1f69c4a8
  Tyler Michael Smith authored Feb 17, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
```
  1f69c4a8
- [VLM] Check required fields before initializing field config in `DictEmbeddingItems` (#13380) · 7b623fca
  Cyrus Leung authored Feb 17, 2025
  
  7b623fca
- [MISC] tiny fixes (#13378) · 238dfc8a
  Mengqing Cao authored Feb 17, 2025
  
  238dfc8a
- [Feature][Spec Decode] Simplify the use of Eagle Spec Decode (#12304) · 46cdd595
  shangmingc authored Feb 17, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  46cdd595
- [V1][Misc] Avoid unnecessary log output (#13289) · 2010f04c
  Jee Jee Li authored Feb 17, 2025
  
  2010f04c
16 Feb, 2025 6 commits
- [V1][BugFix] Clean up rejection sampler & Fix warning msg (#13362) · 69e1d23e
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  69e1d23e
- [Bugfix][Platform][CPU] Fix cuda platform detection on CPU backend edge case (#13358) · d67cc21b
  Isotr0py authored Feb 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  d67cc21b
- [V1][PP] Cache Intermediate Tensors (#13353) · e18227b0
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e18227b0
- [V1][BugFix] Add __init__.py to v1/spec_decode/ (#13359) · 7b893865
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7b893865
- [Bugfix] Fix 2 Node and Spec Decode tests (#13341) · 5d2965b7
  Cyrus Leung authored Feb 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5d2965b7
- [platform] add base class for communicators (#13208) · a0231b7c
  youkaichao authored Feb 16, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  a0231b7c