Commits · 371376f99689fc058141980fde9220dd4980aa3f · OpenDAS / vllm_cscc

"vllm/model_executor/layers/quantization/bitsandbytes.py" did not exist on "37464a0f745a0204da7443d2a6ef4b8f65e5af12"

21 May, 2025 14 commits
- [Build] fix Dockerfile shell (#18402) · 371376f9
  Kebe authored May 21, 2025
  
  371376f9
- [Bugfix] Reduce moe_sum test size to avoid OOM (#18484) · c6c10ca9
  bnellnm authored May 21, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  c6c10ca9
- [Doc] fix arg docstring in linear layers (#18410) · c154d893
  GiantCroc authored May 21, 2025
```
Signed-off-by: giantcroc <1204449533@qq.com>
```
  c154d893
- [MODEL] FalconH1 (#18406) · eca18691
  Dhia Eddine Rhaiem authored May 21, 2025
```
Signed-off-by: dhia.rhaiem <dhia.rhaiem@tii.ae>
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Ilyas Chahed <ilyas.chahed@tii.ae>
Co-authored-by: Jingwei Zuo <jingwei.zuo@tii.ae>
```
  eca18691
- [Bugfix][Failing Test] Fix test_events.py (#18460) · 61acfc45
  Rabi Mishra authored May 21, 2025
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  61acfc45
- [Misc] refactor disaggregated-prefill-v1 example (#18474) · 107f5fc4
  Reid authored May 21, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  107f5fc4
- [V1] Fix general plugins not loaded in engine for multiproc (#18326) · 907f935d
  Yong Hoon Shin authored May 21, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  907f935d
- [Frontend] deprecate `--device` arg (#18399) · 5d7f5452
  Kebe authored May 21, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  5d7f5452
- [Misc] MultiConnector._connectors type (#18423) · cd8dfc6d
  Nicolò Lucchesi authored May 21, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  cd8dfc6d
- [Bugfix][Failing Test] Fix nixl connector test when promt size < block size (#18429) · d06dd72b
  wwl2755 authored May 21, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  d06dd72b
- Revert "[Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18407)" (#18456) · ad0012a0
  Cyrus Leung authored May 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad0012a0
- [Bug] Fix moe_sum signature (#18440) · 92247c52
  bnellnm authored May 21, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  92247c52
- [Bugfix] config.head_dim is now explicitly set to None (#18432) · 0c15c2e4
  Gregory Shtrasberg authored May 21, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  0c15c2e4
- [TPU] Re-enable the Pallas MoE kernel (#18025) · 3b17ea26
  Michael Goin authored May 20, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  3b17ea26
20 May, 2025 14 commits
- fix:Build torch wheel inline rather than picking from nightly (#18351) · 23baa218
  Dilip Gowda Bhagavan authored May 21, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
```
  23baa218
- [Kernel] update comment for KV shape in unified triton attn (#18099) · 980a1724
  Percy authored May 20, 2025
```
Signed-off-by: haochengxia <xhc_1007@163.com>
```
  980a1724
- [Model] use AutoWeightsLoader for bloom (#18300) · e1f5a71e
  Calvin Chen authored May 21, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  e1f5a71e
- [Minor] Rename quantization nvfp4 to modelopt_fp4 (#18356) · f4a8a374
  Michael Goin authored May 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f4a8a374
- [Misc] refactor prompt embedding examples (#18405) · 8f55962a
  Reid authored May 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  8f55962a
- [Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18407) · be48360c
  燃 authored May 20, 2025
```
Co-authored-by: 松灵 <wpf272043@alibaba-inc.com>
```
  be48360c
- [CI] Add mteb testing to test the accuracy of the embedding model (#17175) · 86847700
  wang.yuqi authored May 20, 2025
  
  86847700
- Update cpu.txt (#18398) · d6c86d09
  汪志鹏 authored May 20, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  d6c86d09
- [Misc] Add LoRA code owner (#18387) · 6b35cb10
  Jee Jee Li authored May 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6b35cb10
- [doc] update env variable export (#18391) · 1b1e8e05
  Reid authored May 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1b1e8e05
- [Bugfix] fix adding bias twice in ipex GPTQ quantization (#18363) · bca55b55
  Random Fly authored May 20, 2025
```
Signed-off-by: rand-fly <randfly@outlook.com>
```
  bca55b55
- [release] Change dockerhub username for TPU release (#18389) · d9813967
  Kevin H. Luu authored May 19, 2025
  
  d9813967
- [Core] [Bugfix]: tensor parallel with prompt embeds (#18171) · 9609327f
  Nan Qin authored May 19, 2025
```
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
```
  9609327f
- [Misc] Allow `AutoWeightsLoader` to skip loading weights with specific substr in name (#18358) · f07a673e
  Isotr0py authored May 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f07a673e
19 May, 2025 12 commits
- [neuron] fix authorization issue (#18364) · d565e097
  Liangfu Chen authored May 19, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  d565e097
- fix CUDA_check redefinition in #17918 (#18287) · 258bf621
  Lucia Fang authored May 19, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  258bf621
- Neuron up mistral (#18222) · dc1440cf
  Satyajith Chilappagari authored May 19, 2025
```
Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
```
  dc1440cf
- [Misc] Fix typo (#18330) · 81712218
  Gong Shufan authored May 20, 2025
  
  81712218
- Add files via uploadAdd fused MoE kernel tuning configs (fp8_w8a8) for... · 7937c2fd
  sunyicode0012 authored May 20, 2025
```
Add files via uploadAdd fused MoE kernel tuning configs (fp8_w8a8) for DeepSeek V3/R1 on a single-node 8x NVIDIA H20 96GB setup (#18337)
```
  7937c2fd
- [Feature]Add support for models quantized with AutoRound (#17850) · e2ee1e8e
  Wenhua Cheng authored May 20, 2025
```
Signed-off-by: wenhuach21 <wenhua.cheng@intel.com>
```
  e2ee1e8e
- [Frontend] add --quick option for vllm chat/complete (#18297) · 20d8ce81
  Reid authored May 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  20d8ce81
- [Doc] Fix typo (#18355) · 84ab4feb
  Elad Segal authored May 19, 2025
  
  84ab4feb
- [Quantization] Pool model support bitsandbytes (#18087) · 6781af56
  Jee Jee Li authored May 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6781af56
- [BugFix] Fix handling of num_computed_tokens with connector (#18232) · 1b15df25
  Nick Hill authored May 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  1b15df25
- [Doc] Move input-related docs to Features (#18353) · 43b5f61d
  Cyrus Leung authored May 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  43b5f61d
- [Doc] Fix prompt embedding examples (#18350) · c5bb0ebd
  Li Wang authored May 19, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  c5bb0ebd