Commits · c154d89306bf9978ff013659c5b1244af78386cc · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "948ab03e7ed72d3715f8b7b6398d1d5bb0f9a296"

21 May, 2025 9 commits
- [Doc] fix arg docstring in linear layers (#18410) · c154d893
  GiantCroc authored May 21, 2025
```
Signed-off-by: giantcroc <1204449533@qq.com>
```
  c154d893
- [MODEL] FalconH1 (#18406) · eca18691
  Dhia Eddine Rhaiem authored May 21, 2025
```
Signed-off-by: dhia.rhaiem <dhia.rhaiem@tii.ae>
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Ilyas Chahed <ilyas.chahed@tii.ae>
Co-authored-by: Jingwei Zuo <jingwei.zuo@tii.ae>
```
  eca18691
- [V1] Fix general plugins not loaded in engine for multiproc (#18326) · 907f935d
  Yong Hoon Shin authored May 21, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  907f935d
- [Frontend] deprecate `--device` arg (#18399) · 5d7f5452
  Kebe authored May 21, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  5d7f5452
- [Misc] MultiConnector._connectors type (#18423) · cd8dfc6d
  Nicolò Lucchesi authored May 21, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  cd8dfc6d
- [Bugfix][Failing Test] Fix nixl connector test when promt size < block size (#18429) · d06dd72b
  wwl2755 authored May 21, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  d06dd72b
- Revert "[Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18407)" (#18456) · ad0012a0
  Cyrus Leung authored May 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad0012a0
- [Bugfix] config.head_dim is now explicitly set to None (#18432) · 0c15c2e4
  Gregory Shtrasberg authored May 21, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  0c15c2e4
- [TPU] Re-enable the Pallas MoE kernel (#18025) · 3b17ea26
  Michael Goin authored May 20, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  3b17ea26
20 May, 2025 7 commits
- [Kernel] update comment for KV shape in unified triton attn (#18099) · 980a1724
  Percy authored May 20, 2025
```
Signed-off-by: haochengxia <xhc_1007@163.com>
```
  980a1724
- [Model] use AutoWeightsLoader for bloom (#18300) · e1f5a71e
  Calvin Chen authored May 21, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  e1f5a71e
- [Minor] Rename quantization nvfp4 to modelopt_fp4 (#18356) · f4a8a374
  Michael Goin authored May 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f4a8a374
- [Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18407) · be48360c
  燃 authored May 20, 2025
```
Co-authored-by: 松灵 <wpf272043@alibaba-inc.com>
```
  be48360c
- [Bugfix] fix adding bias twice in ipex GPTQ quantization (#18363) · bca55b55
  Random Fly authored May 20, 2025
```
Signed-off-by: rand-fly <randfly@outlook.com>
```
  bca55b55
- [Core] [Bugfix]: tensor parallel with prompt embeds (#18171) · 9609327f
  Nan Qin authored May 19, 2025
```
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
```
  9609327f
- [Misc] Allow `AutoWeightsLoader` to skip loading weights with specific substr in name (#18358) · f07a673e
  Isotr0py authored May 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f07a673e
19 May, 2025 10 commits
- Neuron up mistral (#18222) · dc1440cf
  Satyajith Chilappagari authored May 19, 2025
```
Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
```
  dc1440cf
- Add files via uploadAdd fused MoE kernel tuning configs (fp8_w8a8) for... · 7937c2fd
  sunyicode0012 authored May 20, 2025
```
Add files via uploadAdd fused MoE kernel tuning configs (fp8_w8a8) for DeepSeek V3/R1 on a single-node 8x NVIDIA H20 96GB setup (#18337)
```
  7937c2fd
- [Feature]Add support for models quantized with AutoRound (#17850) · e2ee1e8e
  Wenhua Cheng authored May 20, 2025
```
Signed-off-by: wenhuach21 <wenhua.cheng@intel.com>
```
  e2ee1e8e
- [Frontend] add --quick option for vllm chat/complete (#18297) · 20d8ce81
  Reid authored May 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  20d8ce81
- [Quantization] Pool model support bitsandbytes (#18087) · 6781af56
  Jee Jee Li authored May 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6781af56
- [BugFix] Fix handling of num_computed_tokens with connector (#18232) · 1b15df25
  Nick Hill authored May 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  1b15df25
- [BugFix] [Vul] Add missing `usedforsecurity=False` in MD5 hashing to enable FIPS (#18319) · d637b960
  Shaoyu Yang authored May 19, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: shaoyuyoung <shaoyuyoung@gmail.com>
Co-authored-by: cascade <cascade812@outlook.com>
```
  d637b960
- fix: Add type specifications for CLI arguments in tensorizer options (#18314) · 275c5dae
  CYJiang authored May 19, 2025
  
  275c5dae
- Feature/vllm/input embedding completion api (#17590) · 221cfc2f
  Nan Qin authored May 18, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  221cfc2f
- [Spec Decode][V0] Fix spec decode correctness test in V0 eagle/medusa (#18175) · 9da1095d
  wwl2755 authored May 18, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  9da1095d
18 May, 2025 2 commits
- Fix copy-paste error in phi4mm image processing (#18315) · 4fb349f6
  Lifu Huang authored May 18, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  4fb349f6
- [Model] Use sigmoid for single-label classification (#18313) · 908733ac
  22quinn authored May 18, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  908733ac
17 May, 2025 8 commits
- Support sequence parallelism combined with pipeline parallelism (#18243) · 9ab2c02f
  cascade authored May 17, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  9ab2c02f
- [MISC] fix typo (#18305) · 66e63e86
  Ning Xie authored May 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  66e63e86
- [Model] use AutoWeightsLoader for solar (#18113) · 9214e606
  rongfu.leng authored May 17, 2025
  
  9214e606
- [Hardware][TPU] Optionally import for TPU backend (#18269) · 48ac2bed
  Siyuan Liu authored May 17, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
Co-authored-by: Carol Zheng <cazheng@google.com>
Co-authored-by: Jade Zheng <zheng.shoujian@outlook.com>
Co-authored-by: Hongmin Fan <fanhongmin@google.com>
```
  48ac2bed
- [P/D][V1] Support dynamic loading of external KV connector implementations (#18142) · 3e0d4350
  David Ben-David authored May 17, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  3e0d4350
- [BugFix] Correct max_model_len derivation from config.json for Mistral format (#17937) · 4ee4826e
  汪志鹏 authored May 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: tracelogfb <48808670+tracelogfb@users.noreply.github.com>
Co-authored-by: Stephen Chen <tracelog@meta.com>
```
  4ee4826e
- [Misc] reformat the collect-env output (#18285) · 60017dc8
  Reid authored May 17, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  60017dc8
- [V1][P/D] Local attention optimization for NIXL (#18170) · fd195b19
  Michael Goin authored May 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  fd195b19
16 May, 2025 4 commits
- [Spec Decode] Don't fall back to V0 when spec decoding is enabled (#18265) · fabe89bb
  Woosuk Kwon authored May 16, 2025
  
  fabe89bb
- [Sampler] Adapt to FlashInfer 0.2.3 sampler API (#15777) · 7fdfa015
  Bowen Wang authored May 16, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7fdfa015
- [BugFix] Fix ordering of KVConnector finished send/rcv sets (#18211) · 0ceaebf8
  Nick Hill authored May 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0ceaebf8
- [BugFix] Fix multi async save in MultiConnector (#18246) · 1db4f47f
  Nick Hill authored May 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  1db4f47f