Commits · d6c86d09aecb910fd336ba83ede70265ee81149a · OpenDAS / vllm_cscc · GitLab

20 May, 2025 7 commits
- Update cpu.txt (#18398) · d6c86d09
  汪志鹏 authored May 20, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  d6c86d09
- [Misc] Add LoRA code owner (#18387) · 6b35cb10
  Jee Jee Li authored May 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6b35cb10
- [doc] update env variable export (#18391) · 1b1e8e05
  Reid authored May 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1b1e8e05
- [Bugfix] fix adding bias twice in ipex GPTQ quantization (#18363) · bca55b55
  Random Fly authored May 20, 2025
```
Signed-off-by: rand-fly <randfly@outlook.com>
```
  bca55b55
- [release] Change dockerhub username for TPU release (#18389) · d9813967
  Kevin H. Luu authored May 19, 2025
  
  d9813967
- [Core] [Bugfix]: tensor parallel with prompt embeds (#18171) · 9609327f
  Nan Qin authored May 19, 2025
```
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
```
  9609327f
- [Misc] Allow `AutoWeightsLoader` to skip loading weights with specific substr in name (#18358) · f07a673e
  Isotr0py authored May 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f07a673e
19 May, 2025 18 commits
- [neuron] fix authorization issue (#18364) · d565e097
  Liangfu Chen authored May 19, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  d565e097
- fix CUDA_check redefinition in #17918 (#18287) · 258bf621
  Lucia Fang authored May 19, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  258bf621
- Neuron up mistral (#18222) · dc1440cf
  Satyajith Chilappagari authored May 19, 2025
```
Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
```
  dc1440cf
- [Misc] Fix typo (#18330) · 81712218
  Gong Shufan authored May 20, 2025
  
  81712218
- Add files via uploadAdd fused MoE kernel tuning configs (fp8_w8a8) for... · 7937c2fd
  sunyicode0012 authored May 20, 2025
```
Add files via uploadAdd fused MoE kernel tuning configs (fp8_w8a8) for DeepSeek V3/R1 on a single-node 8x NVIDIA H20 96GB setup (#18337)
```
  7937c2fd
- [Feature]Add support for models quantized with AutoRound (#17850) · e2ee1e8e
  Wenhua Cheng authored May 20, 2025
```
Signed-off-by: wenhuach21 <wenhua.cheng@intel.com>
```
  e2ee1e8e
- [Frontend] add --quick option for vllm chat/complete (#18297) · 20d8ce81
  Reid authored May 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  20d8ce81
- [Doc] Fix typo (#18355) · 84ab4feb
  Elad Segal authored May 19, 2025
  
  84ab4feb
- [Quantization] Pool model support bitsandbytes (#18087) · 6781af56
  Jee Jee Li authored May 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6781af56
- [BugFix] Fix handling of num_computed_tokens with connector (#18232) · 1b15df25
  Nick Hill authored May 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  1b15df25
- [Doc] Move input-related docs to Features (#18353) · 43b5f61d
  Cyrus Leung authored May 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  43b5f61d
- [Doc] Fix prompt embedding examples (#18350) · c5bb0ebd
  Li Wang authored May 19, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  c5bb0ebd
- [BugFix] [Vul] Add missing `usedforsecurity=False` in MD5 hashing to enable FIPS (#18319) · d637b960
  Shaoyu Yang authored May 19, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: shaoyuyoung <shaoyuyoung@gmail.com>
Co-authored-by: cascade <cascade812@outlook.com>
```
  d637b960
- fix: Add type specifications for CLI arguments in tensorizer options (#18314) · 275c5dae
  CYJiang authored May 19, 2025
  
  275c5dae
- [Build] Supports CUDA 12.6 and 11.8 after Blackwell Update (#18316) · 47fda6d0
  Simon Mo authored May 18, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  47fda6d0
- [Misc] extract parser.parse_args() (#18323) · 27d09526
  Reid authored May 19, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  27d09526
- Feature/vllm/input embedding completion api (#17590) · 221cfc2f
  Nan Qin authored May 18, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  221cfc2f
- [Spec Decode][V0] Fix spec decode correctness test in V0 eagle/medusa (#18175) · 9da1095d
  wwl2755 authored May 18, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  9da1095d
18 May, 2025 5 commits
- [Doc] Add doc to explain the usage of Qwen3 thinking (#18291) · d1211f87
  Robin authored May 19, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  d1211f87
- [Misc] add litellm integration (#18320) · b6a6e7a5
  Reid authored May 18, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  b6a6e7a5
- Fix copy-paste error in phi4mm image processing (#18315) · 4fb349f6
  Lifu Huang authored May 18, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  4fb349f6
- [Model] Use sigmoid for single-label classification (#18313) · 908733ac
  22quinn authored May 18, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  908733ac
- [doc] update reasoning doc (#18306) · 1a8f68bb
  Reid authored May 18, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1a8f68bb
17 May, 2025 10 commits
- Support sequence parallelism combined with pipeline parallelism (#18243) · 9ab2c02f
  cascade authored May 17, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  9ab2c02f
- [MISC] fix typo (#18305) · 66e63e86
  Ning Xie authored May 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  66e63e86
- [Model] use AutoWeightsLoader for solar (#18113) · 9214e606
  rongfu.leng authored May 17, 2025
  
  9214e606
- Fixed build on ppc64le due to openssl conflicts (#18262) · f880d425
  Nishidha authored May 17, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
```
  f880d425
- Update Dockerfile to build for Blackwell (#18095) · dcfe9523
  Michael Goin authored May 17, 2025
  
  dcfe9523
- [Hardware][TPU] Optionally import for TPU backend (#18269) · 48ac2bed
  Siyuan Liu authored May 17, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
Co-authored-by: Carol Zheng <cazheng@google.com>
Co-authored-by: Jade Zheng <zheng.shoujian@outlook.com>
Co-authored-by: Hongmin Fan <fanhongmin@google.com>
```
  48ac2bed
- [P/D][V1] Support dynamic loading of external KV connector implementations (#18142) · 3e0d4350
  David Ben-David authored May 17, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  3e0d4350
- [BugFix] Correct max_model_len derivation from config.json for Mistral format (#17937) · 4ee4826e
  汪志鹏 authored May 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: tracelogfb <48808670+tracelogfb@users.noreply.github.com>
Co-authored-by: Stephen Chen <tracelog@meta.com>
```
  4ee4826e
- [Misc] reformat the collect-env output (#18285) · 60017dc8
  Reid authored May 17, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  60017dc8
- Move cli args docs to its own page (#18228) (#18264) · 55f1a468
  Trevor Royer authored May 16, 2025
```
Signed-off-by: Trevor Royer <troyer@redhat.com>
```
  55f1a468