Commits · 615e4a54017136649db275b68932af80168781f8 · OpenDAS / vllm_cscc · GitLab

09 Jan, 2025 1 commit
- [CI] Turn on basic correctness tests for V1 (#10864) · 615e4a54
  Tyler Michael Smith authored Jan 08, 2025
  
  615e4a54
08 Jan, 2025 26 commits
- [Docs] Add Google Cloud Meetup (#11864) · 3db0cafd
  Simon Mo authored Jan 08, 2025
  
  3db0cafd
- [Kernel][Triton][AMD] Use block size heuristic for avg 2.8x speedup for int8 models (#11698) · 526de822
  rasmith authored Jan 08, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  526de822
- [TPU][Quantization] TPU `W8A8` (#11785) · 56fe4c29
  Robert Shaw authored Jan 08, 2025
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56fe4c29
- [Misc]add some explanations for BlockHashType (#11847) · 47de8821
  WangErXiao authored Jan 09, 2025
  
  47de8821
- [Doc] Expand Multimodal API Reference (#11852) · 5984499e
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5984499e
- [Misc] Move some model utils into vision file (#11848) · ca47e176
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca47e176
- [Bugfix][XPU] fix silu_and_mul (#11823) · 78f4590b
  Yan Ma authored Jan 09, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  78f4590b
- [CI/Build][Bugfix] Fix CPU CI image clean up (#11836) · 2f702498
  Li, Jiang authored Jan 08, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  2f702498
- [Doc][4/N] Reorganize API Reference (#11843) · 6cd40a5b
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6cd40a5b
- [Doc] Move examples into categories (#11840) · aba8d6ee
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aba8d6ee
- [VLM] Reorganize profiling/processing-related code (#11812) · 2a0596bc
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2a0596bc
- [torch.compile] consider relevant code in compilation cache (#11614) · f1214117
  youkaichao authored Jan 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f1214117
- [Hardware][Apple] Native support for macOS Apple Silicon (#11696) · cfd3219f
  Wallas Henrique authored Jan 08, 2025
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  cfd3219f
- [Docs] Update sponsor name: 'Novita' to 'Novita AI' (#11833) · a1b2b860
  Simon Mo authored Jan 07, 2025
  
  a1b2b860
- [doc] update wheels url (#11830) · ad9f1aa6
  youkaichao authored Jan 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ad9f1aa6
- [misc] improve memory profiling (#11809) · 889e662e
  youkaichao authored Jan 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  889e662e
- [Bug] Fix pickling of `ModelConfig` when RunAI Model Streamer is used (#11825) · ef68eb28
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef68eb28
- [Docs] reorganize sponsorship page (#11639) · 259abd89
  Simon Mo authored Jan 07, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  259abd89
- [Bugfix] Add checks for LoRA and CPU offload (#11810) · f645eb69
  Jee Jee Li authored Jan 08, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f645eb69
- [OpenVINO] Fixed Docker.openvino build (#11732) · f4923cb8
  Ilya Lavrenov authored Jan 08, 2025
```
Signed-off-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
```
  f4923cb8
- Fixed docker build for ppc64le (#11518) · b640b19c
  Nishidha authored Jan 08, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
```
  b640b19c
- Remove the duplicate imports of MultiModalKwargs and PlaceholderRange… (#11824) · dc71af0a
  WangErXiao authored Jan 08, 2025
  
  dc71af0a
- [Misc] sort torch profiler table by kernel timing (#11813) · 4d29e91b
  Divakar Verma authored Jan 07, 2025
  
  4d29e91b
- [Bugfix] Fix image input for Pixtral-HF (#11741) · 91445c7b
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  91445c7b
- [Doc] Group examples into categories (#11782) · 5950f555
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5950f555
- [Bugfix] Significant performance drop on CPUs with --num-scheduler-steps > 1 (#11794) · a4e2b268
  Jie Fu (傅杰) authored Jan 08, 2025
  
  a4e2b268
07 Jan, 2025 13 commits
- [Doc]Add documentation for using EAGLE in vLLM (#11417) · 973f5dc5
  sroy745 authored Jan 07, 2025
```
Signed-off-by: Sourashis Roy <sroy@roblox.com>
```
  973f5dc5
- [Bugfix] update the prefix for qwen2 (#11795) · c994223d
  jiangjiadi authored Jan 08, 2025
```
Co-authored-by: jiadi.jjd <jiadi.jjd@antgroup.com>
```
  c994223d
- [optimization] remove python function call for custom op (#11750) · 869579a7
  youkaichao authored Jan 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  869579a7
- [Doc] Add note to `gte-Qwen2` models (#11808) · c0efe92d
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c0efe92d
- [doc] update how pip can install nightly wheels (#11806) · d9fa1c05
  youkaichao authored Jan 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d9fa1c05
- [V1] Support audio language models on V1 (#11733) · 2de197bd
  Roger Wang authored Jan 07, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  2de197bd
- [doc] add doc to explain how to use uv (#11773) · 869e829b
  youkaichao authored Jan 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  869e829b
- [Bugfix] Comprehensively test and fix LLaVA-NeXT feature size calculation (#11800) · 8f37be38
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8f37be38
- [V1][Doc] Update V1 support for `LLaVa-NeXT-Video` (#11798) · 8082ad79
  Roger Wang authored Jan 07, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  8082ad79
- [CI][CPU] adding build number to docker image name (#11788) · 1e4ce295
  Yuan authored Jan 07, 2025
```
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
```
  1e4ce295
- [Doc] Create a vulnerability management team (#9925) · ce1917fc
  Russell Bryant authored Jan 07, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ce1917fc
- fix init error for MessageQueue when n_local_reader is zero (#11768) · e512f76a
  XiaobingZhang authored Jan 07, 2025
  
  e512f76a
- [CI] Fix neuron CI and run offline tests (#11779) · 898cdf03
  Liangfu Chen authored Jan 06, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  898cdf03