Commits · 3b17ea26e41b16a72935cdab7b7a771bfa1c25ef · OpenDAS / vllm_cscc

"examples/vscode:/vscode.git/clone" did not exist on "d2a7938582011cb0dd117fec468221dc5e3d22a2"

21 May, 2025 1 commit
- [TPU] Re-enable the Pallas MoE kernel (#18025) · 3b17ea26
  Michael Goin authored May 20, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  3b17ea26
20 May, 2025 7 commits
- [Kernel] update comment for KV shape in unified triton attn (#18099) · 980a1724
  Percy authored May 20, 2025
```
Signed-off-by: haochengxia <xhc_1007@163.com>
```
  980a1724
- [Model] use AutoWeightsLoader for bloom (#18300) · e1f5a71e
  Calvin Chen authored May 21, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  e1f5a71e
- [Minor] Rename quantization nvfp4 to modelopt_fp4 (#18356) · f4a8a374
  Michael Goin authored May 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f4a8a374
- [Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18407) · be48360c
  燃 authored May 20, 2025
```
Co-authored-by: 松灵 <wpf272043@alibaba-inc.com>
```
  be48360c
- [Bugfix] fix adding bias twice in ipex GPTQ quantization (#18363) · bca55b55
  Random Fly authored May 20, 2025
```
Signed-off-by: rand-fly <randfly@outlook.com>
```
  bca55b55
- [Core] [Bugfix]: tensor parallel with prompt embeds (#18171) · 9609327f
  Nan Qin authored May 19, 2025
```
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
```
  9609327f
- [Misc] Allow `AutoWeightsLoader` to skip loading weights with specific substr in name (#18358) · f07a673e
  Isotr0py authored May 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f07a673e
19 May, 2025 10 commits
- Neuron up mistral (#18222) · dc1440cf
  Satyajith Chilappagari authored May 19, 2025
```
Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
```
  dc1440cf
- Add files via uploadAdd fused MoE kernel tuning configs (fp8_w8a8) for... · 7937c2fd
  sunyicode0012 authored May 20, 2025
```
Add files via uploadAdd fused MoE kernel tuning configs (fp8_w8a8) for DeepSeek V3/R1 on a single-node 8x NVIDIA H20 96GB setup (#18337)
```
  7937c2fd
- [Feature]Add support for models quantized with AutoRound (#17850) · e2ee1e8e
  Wenhua Cheng authored May 20, 2025
```
Signed-off-by: wenhuach21 <wenhua.cheng@intel.com>
```
  e2ee1e8e
- [Frontend] add --quick option for vllm chat/complete (#18297) · 20d8ce81
  Reid authored May 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  20d8ce81
- [Quantization] Pool model support bitsandbytes (#18087) · 6781af56
  Jee Jee Li authored May 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6781af56
- [BugFix] Fix handling of num_computed_tokens with connector (#18232) · 1b15df25
  Nick Hill authored May 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  1b15df25
- [BugFix] [Vul] Add missing `usedforsecurity=False` in MD5 hashing to enable FIPS (#18319) · d637b960
  Shaoyu Yang authored May 19, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: shaoyuyoung <shaoyuyoung@gmail.com>
Co-authored-by: cascade <cascade812@outlook.com>
```
  d637b960
- fix: Add type specifications for CLI arguments in tensorizer options (#18314) · 275c5dae
  CYJiang authored May 19, 2025
  
  275c5dae
- Feature/vllm/input embedding completion api (#17590) · 221cfc2f
  Nan Qin authored May 18, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  221cfc2f
- [Spec Decode][V0] Fix spec decode correctness test in V0 eagle/medusa (#18175) · 9da1095d
  wwl2755 authored May 18, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  9da1095d
18 May, 2025 2 commits
- Fix copy-paste error in phi4mm image processing (#18315) · 4fb349f6
  Lifu Huang authored May 18, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  4fb349f6
- [Model] Use sigmoid for single-label classification (#18313) · 908733ac
  22quinn authored May 18, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  908733ac
17 May, 2025 8 commits
- Support sequence parallelism combined with pipeline parallelism (#18243) · 9ab2c02f
  cascade authored May 17, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  9ab2c02f
- [MISC] fix typo (#18305) · 66e63e86
  Ning Xie authored May 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  66e63e86
- [Model] use AutoWeightsLoader for solar (#18113) · 9214e606
  rongfu.leng authored May 17, 2025
  
  9214e606
- [Hardware][TPU] Optionally import for TPU backend (#18269) · 48ac2bed
  Siyuan Liu authored May 17, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
Co-authored-by: Carol Zheng <cazheng@google.com>
Co-authored-by: Jade Zheng <zheng.shoujian@outlook.com>
Co-authored-by: Hongmin Fan <fanhongmin@google.com>
```
  48ac2bed
- [P/D][V1] Support dynamic loading of external KV connector implementations (#18142) · 3e0d4350
  David Ben-David authored May 17, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  3e0d4350
- [BugFix] Correct max_model_len derivation from config.json for Mistral format (#17937) · 4ee4826e
  汪志鹏 authored May 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: tracelogfb <48808670+tracelogfb@users.noreply.github.com>
Co-authored-by: Stephen Chen <tracelog@meta.com>
```
  4ee4826e
- [Misc] reformat the collect-env output (#18285) · 60017dc8
  Reid authored May 17, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  60017dc8
- [V1][P/D] Local attention optimization for NIXL (#18170) · fd195b19
  Michael Goin authored May 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  fd195b19
16 May, 2025 12 commits
- [Spec Decode] Don't fall back to V0 when spec decoding is enabled (#18265) · fabe89bb
  Woosuk Kwon authored May 16, 2025
  
  fabe89bb
- [Sampler] Adapt to FlashInfer 0.2.3 sampler API (#15777) · 7fdfa015
  Bowen Wang authored May 16, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7fdfa015
- [BugFix] Fix ordering of KVConnector finished send/rcv sets (#18211) · 0ceaebf8
  Nick Hill authored May 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0ceaebf8
- [BugFix] Fix multi async save in MultiConnector (#18246) · 1db4f47f
  Nick Hill authored May 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  1db4f47f
- [Misc][MacOS] fix bfloat16 error (#18249) · d3d91b6f
  Reid authored May 16, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  d3d91b6f
- [Model] Use autoweightloader for dbrx (#18251) · 87d87147
  learner0810 authored May 16, 2025
```
Signed-off-by: learner0810 <zhongjun.li@daocloud.io>
```
  87d87147
- [Fix] Fix typo in `resolve_hf_chat_template` (#18259) · a5f8c111
  fxmarty-amd authored May 16, 2025
```
Signed-off-by: Felix Marty <felmarty@amd.com>
```
  a5f8c111
- use ceil_div in cutlass block scaling shape check (#17918) · e23564cb
  Lain authored May 16, 2025
  
  e23564cb
- [Misc] Add Ray Prometheus logger to V1 (#17925) · 54181767
  Seiji Eicher authored May 16, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  54181767
- [PERF] Speed up Qwen2.5-VL model by speed up rotary position embedding (#17973) · 67da5720
  Vadim Gimpelson authored May 16, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  67da5720
- [Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1 (#17827) · 3d2779c2
  Lucia Fang authored May 15, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  3d2779c2
- Throw better error for when running into k8s service discovery issue (#18209) · 6b31c84a
  Will Eaton authored May 16, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  6b31c84a