Commits · 107f5fc4cb2f1adf3679b4305d9953cb90840e7b · OpenDAS / vllm_cscc · GitLab

21 May, 2025 9 commits
- [Misc] refactor disaggregated-prefill-v1 example (#18474) · 107f5fc4
  Reid authored May 21, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  107f5fc4
- [V1] Fix general plugins not loaded in engine for multiproc (#18326) · 907f935d
  Yong Hoon Shin authored May 21, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  907f935d
- [Frontend] deprecate `--device` arg (#18399) · 5d7f5452
  Kebe authored May 21, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  5d7f5452
- [Misc] MultiConnector._connectors type (#18423) · cd8dfc6d
  Nicolò Lucchesi authored May 21, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  cd8dfc6d
- [Bugfix][Failing Test] Fix nixl connector test when promt size < block size (#18429) · d06dd72b
  wwl2755 authored May 21, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  d06dd72b
- Revert "[Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18407)" (#18456) · ad0012a0
  Cyrus Leung authored May 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad0012a0
- [Bug] Fix moe_sum signature (#18440) · 92247c52
  bnellnm authored May 21, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  92247c52
- [Bugfix] config.head_dim is now explicitly set to None (#18432) · 0c15c2e4
  Gregory Shtrasberg authored May 21, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  0c15c2e4
- [TPU] Re-enable the Pallas MoE kernel (#18025) · 3b17ea26
  Michael Goin authored May 20, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  3b17ea26
20 May, 2025 14 commits
- fix:Build torch wheel inline rather than picking from nightly (#18351) · 23baa218
  Dilip Gowda Bhagavan authored May 21, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
```
  23baa218
- [Kernel] update comment for KV shape in unified triton attn (#18099) · 980a1724
  Percy authored May 20, 2025
```
Signed-off-by: haochengxia <xhc_1007@163.com>
```
  980a1724
- [Model] use AutoWeightsLoader for bloom (#18300) · e1f5a71e
  Calvin Chen authored May 21, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  e1f5a71e
- [Minor] Rename quantization nvfp4 to modelopt_fp4 (#18356) · f4a8a374
  Michael Goin authored May 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f4a8a374
- [Misc] refactor prompt embedding examples (#18405) · 8f55962a
  Reid authored May 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  8f55962a
- [Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18407) · be48360c
  燃 authored May 20, 2025
```
Co-authored-by: 松灵 <wpf272043@alibaba-inc.com>
```
  be48360c
- [CI] Add mteb testing to test the accuracy of the embedding model (#17175) · 86847700
  wang.yuqi authored May 20, 2025
  
  86847700
- Update cpu.txt (#18398) · d6c86d09
  汪志鹏 authored May 20, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  d6c86d09
- [Misc] Add LoRA code owner (#18387) · 6b35cb10
  Jee Jee Li authored May 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6b35cb10
- [doc] update env variable export (#18391) · 1b1e8e05
  Reid authored May 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1b1e8e05
- [Bugfix] fix adding bias twice in ipex GPTQ quantization (#18363) · bca55b55
  Random Fly authored May 20, 2025
```
Signed-off-by: rand-fly <randfly@outlook.com>
```
  bca55b55
- [release] Change dockerhub username for TPU release (#18389) · d9813967
  Kevin H. Luu authored May 19, 2025
  
  d9813967
- [Core] [Bugfix]: tensor parallel with prompt embeds (#18171) · 9609327f
  Nan Qin authored May 19, 2025
```
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
```
  9609327f
- [Misc] Allow `AutoWeightsLoader` to skip loading weights with specific substr in name (#18358) · f07a673e
  Isotr0py authored May 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f07a673e
19 May, 2025 17 commits
- [neuron] fix authorization issue (#18364) · d565e097
  Liangfu Chen authored May 19, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  d565e097
- fix CUDA_check redefinition in #17918 (#18287) · 258bf621
  Lucia Fang authored May 19, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  258bf621
- Neuron up mistral (#18222) · dc1440cf
  Satyajith Chilappagari authored May 19, 2025
```
Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
```
  dc1440cf
- [Misc] Fix typo (#18330) · 81712218
  Gong Shufan authored May 20, 2025
  
  81712218
- Add files via uploadAdd fused MoE kernel tuning configs (fp8_w8a8) for... · 7937c2fd
  sunyicode0012 authored May 20, 2025
```
Add files via uploadAdd fused MoE kernel tuning configs (fp8_w8a8) for DeepSeek V3/R1 on a single-node 8x NVIDIA H20 96GB setup (#18337)
```
  7937c2fd
- [Feature]Add support for models quantized with AutoRound (#17850) · e2ee1e8e
  Wenhua Cheng authored May 20, 2025
```
Signed-off-by: wenhuach21 <wenhua.cheng@intel.com>
```
  e2ee1e8e
- [Frontend] add --quick option for vllm chat/complete (#18297) · 20d8ce81
  Reid authored May 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  20d8ce81
- [Doc] Fix typo (#18355) · 84ab4feb
  Elad Segal authored May 19, 2025
  
  84ab4feb
- [Quantization] Pool model support bitsandbytes (#18087) · 6781af56
  Jee Jee Li authored May 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6781af56
- [BugFix] Fix handling of num_computed_tokens with connector (#18232) · 1b15df25
  Nick Hill authored May 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  1b15df25
- [Doc] Move input-related docs to Features (#18353) · 43b5f61d
  Cyrus Leung authored May 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  43b5f61d
- [Doc] Fix prompt embedding examples (#18350) · c5bb0ebd
  Li Wang authored May 19, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  c5bb0ebd
- [BugFix] [Vul] Add missing `usedforsecurity=False` in MD5 hashing to enable FIPS (#18319) · d637b960
  Shaoyu Yang authored May 19, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: shaoyuyoung <shaoyuyoung@gmail.com>
Co-authored-by: cascade <cascade812@outlook.com>
```
  d637b960
- fix: Add type specifications for CLI arguments in tensorizer options (#18314) · 275c5dae
  CYJiang authored May 19, 2025
  
  275c5dae
- [Build] Supports CUDA 12.6 and 11.8 after Blackwell Update (#18316) · 47fda6d0
  Simon Mo authored May 18, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  47fda6d0
- [Misc] extract parser.parse_args() (#18323) · 27d09526
  Reid authored May 19, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  27d09526
- Feature/vllm/input embedding completion api (#17590) · 221cfc2f
  Nan Qin authored May 18, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  221cfc2f