Commits · 1a11f127528e49343706b675bfb56d96319a4cbc · OpenDAS / vllm_cscc · GitLab

23 Jan, 2025 1 commit
- support qwen2-vl video · 1a11f127
  zhuwenwen authored Jan 23, 2025
  
  1a11f127
16 Jan, 2025 1 commit
- 增加w8a8相关修改 · 083b80ea
  zhuwenwen authored Jan 16, 2025
  
  083b80ea
14 Jan, 2025 1 commit
- [feat]上传deepseek_v2_lite、qwen2_moe、mixtral 8*7B、8x822B 4个模型的fused_moe_kernel config · 09428eec
  zhuwenwen authored Jan 14, 2025
  
  09428eec
06 Jan, 2025 2 commits
- for qwen2, mixtral and mistral models, remove the warning from _ROCM_SWA_REASON · a9c53382
  zhuwenwen authored Jan 06, 2025
  
  a9c53382
- update qwen2-moe layout and benchmark_throughput.py · 220e6456
  zhuwenwen authored Jan 06, 2025
  
  220e6456
04 Jan, 2025 1 commit
- update qwen&qwen2-moe and baichuan layout · f9f4a735
  zhuwenwen authored Jan 04, 2025
  
  f9f4a735
03 Jan, 2025 4 commits
- remove gemm and fa pad · ca7f98e5
  zhuwenwen authored Jan 03, 2025
  
  ca7f98e5
- update qwen2 and mixtral layout · 57adffa2
  zhuwenwen authored Jan 03, 2025
  
  57adffa2
- fix run error · 184b50f7
  zhuwenwen authored Jan 03, 2025
  
  184b50f7
- skip ggml_dequantize · 28a8a733
  zhuwenwen authored Jan 03, 2025
  
  28a8a733
02 Jan, 2025 1 commit
- add softcap interface for gemma-2 · f9b567df
  zhuwenwen authored Jan 02, 2025
  
  f9b567df
30 Dec, 2024 1 commit
- fix interface error · 02c3e313
  zhuwenwen authored Dec 30, 2024
  
  02c3e313
27 Dec, 2024 6 commits
- [BugFix] Fix quantization for all other methods (#11547) · 2339d59f
  Robert Shaw authored Dec 27, 2024
  
  2339d59f
- [V1][3/N] API Server: Reduce Task Switching + Handle Abort Properly (#11534) · 1b875a0e
  Robert Shaw authored Dec 27, 2024
  
  1b875a0e
- [misc] fix typing (#11540) · eb881ed0
  youkaichao authored Dec 27, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eb881ed0
- [V1] Fix yapf (#11538) · 81b979f2
  Woosuk Kwon authored Dec 27, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  81b979f2
- [V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling (#11394) · 371d04d3
  Woosuk Kwon authored Dec 27, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  371d04d3
- Deepseek v3 (#11502) · f49777ba
  Simon Mo authored Dec 26, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: robertgshaw2-neuralmagic <rshaw@neuralmagic.com>
```
  f49777ba
26 Dec, 2024 9 commits
- [2/N] API Server: Avoid ulimit footgun (#11530) · 55fb97f7
  Robert Shaw authored Dec 26, 2024
  
  55fb97f7
- [Model] [Quantization] Support deepseek_v3 w8a8 fp8 block-wise quantization (#11523) · 2072924d
  Michael Goin authored Dec 26, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  2072924d
- [1/N] API Server (Remove Proxy) (#11529) · 720b10fd
  Robert Shaw authored Dec 26, 2024
  
  720b10fd
- [Misc] Add placeholder module (#11501) · eec906d8
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eec906d8
- [Model] Modify MolmoForCausalLM MLP (#11510) · f57ee565
  Jee Jee Li authored Dec 26, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f57ee565
- [V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681) · dcb1a944
  sroy745 authored Dec 26, 2024
```
Signed-off-by: Sourashis Roy <sroy@roblox.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dcb1a944
- [Misc][LoRA] Fix LoRA weight mapper (#11495) · aa25985b
  Jee Jee Li authored Dec 26, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  aa25985b
- Mypy checking for vllm/compilation (#11496) · dbeac95d
  Lucas Tucker authored Dec 25, 2024
```
Signed-off-by: lucast2021 <lucast2021@headroyce.org>
Co-authored-by: lucast2021 <lucast2021@headroyce.org>
```
  dbeac95d
- [Misc] Move some multimodal utils to modality-specific modules (#11494) · 51a624bf
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51a624bf
25 Dec, 2024 4 commits
- [Frontend] Enable decord to load video from base64 (#11492) · b689ada9
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b689ada9
- [Model] Update Qwen2-Audio model support · df81235f
  zhuwenwen authored Dec 25, 2024
  
  df81235f
- [V1] Unify VLLM_ENABLE_V1_MULTIPROCESSING handling in RayExecutor (#11472) · 9832e557
  Rui Qiao authored Dec 24, 2024
  
  9832e557
- [Model] Add Qwen2-Audio model support · 3c23ce2d
  zhuwenwen authored Dec 25, 2024
  
  3c23ce2d
24 Dec, 2024 7 commits
- [Model] Automatic conversion of classification and reward models (#11469) · 3f3e92e1
  Cyrus Leung authored Dec 25, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f3e92e1
- [Misc] Move weights mapper (#11443) · 196c34b0
  Jee Jee Li authored Dec 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  196c34b0
- [attn][tiny fix] fix attn backend in MultiHeadAttention (#11463) · 5c796324
  Mengqing Cao authored Dec 24, 2024
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  5c796324
- [Bugfix][Hardware][CPU] Fix CPU `input_positions` creation for text-only inputs with mrope (#11434) · 7a5286cc
  Isotr0py authored Dec 24, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  7a5286cc
- [Bugfix] Fix Qwen2-VL LoRA weight loading (#11430) · b1b1038f
  Jee Jee Li authored Dec 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b1b1038f
- [Frontend] Online Pooling API (#11457) · 9edca6bf
  Cyrus Leung authored Dec 24, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9edca6bf
- [Misc]Suppress irrelevant exception stack trace information when CUDA… (#11438) · 4f074fbf
  dpxa authored Dec 24, 2024
```
Co-authored-by: shiquan <shiquan>
```
  4f074fbf
23 Dec, 2024 2 commits
- [V1] TP Ray executor (#11107) · a491d6f5
  Rui Qiao authored Dec 23, 2024
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  a491d6f5
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059