Commits · 7af553ea30031446b4c1c74ad83187f9fd3de4e7 · OpenDAS / vllm_cscc · GitLab

27 Dec, 2024 13 commits
- [Misc] Abstract the logic for reading and writing media content (#11527) · 7af553ea
  Cyrus Leung authored Dec 27, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7af553ea
- [Bugfix] Fix TeleChat2ForCausalLM weights mapper (#11546) · 2c9b8ea2
  Jee Jee Li authored Dec 27, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2c9b8ea2
- Update deploying_with_k8s.md with AMD ROCm GPU example (#11465) · d003f3ea
  AlexHe99 authored Dec 27, 2024
```
Signed-off-by: Alex He <alehe@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d003f3ea
- [Platform] Move model arch check to platform (#11503) · 6c6f7fe8
  Mengqing Cao authored Dec 27, 2024
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  6c6f7fe8
- [BugFix] Fix quantization for all other methods (#11547) · 2339d59f
  Robert Shaw authored Dec 27, 2024
  
  2339d59f
- [V1][3/N] API Server: Reduce Task Switching + Handle Abort Properly (#11534) · 1b875a0e
  Robert Shaw authored Dec 27, 2024
  
  1b875a0e
- [misc] fix typing (#11540) · eb881ed0
  youkaichao authored Dec 27, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eb881ed0
- [CI] Fix broken CI (#11543) · 46d43594
  Robert Shaw authored Dec 26, 2024
  
  46d43594
- [V1] Fix yapf (#11538) · 81b979f2
  Woosuk Kwon authored Dec 27, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  81b979f2
- [V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling (#11394) · 371d04d3
  Woosuk Kwon authored Dec 27, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  371d04d3
- Update openai_compatible_server.md (#11536) · 0c0c2015
  Robert Shaw authored Dec 26, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0c0c2015
- [Docs] Document Deepseek V3 support (#11535) · 82d24f7a
  Simon Mo authored Dec 26, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  82d24f7a
- Deepseek v3 (#11502) · f49777ba
  Simon Mo authored Dec 26, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: robertgshaw2-neuralmagic <rshaw@neuralmagic.com>
```
  f49777ba
26 Dec, 2024 11 commits
- [2/N] API Server: Avoid ulimit footgun (#11530) · 55fb97f7
  Robert Shaw authored Dec 26, 2024
  
  55fb97f7
- [Model] [Quantization] Support deepseek_v3 w8a8 fp8 block-wise quantization (#11523) · 2072924d
  Michael Goin authored Dec 26, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  2072924d
- [1/N] API Server (Remove Proxy) (#11529) · 720b10fd
  Robert Shaw authored Dec 26, 2024
  
  720b10fd
- [Doc] Add video example to openai client for multimodal (#11521) · b85a9778
  Isotr0py authored Dec 27, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b85a9778
- [Misc] Add placeholder module (#11501) · eec906d8
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eec906d8
- [Model] Modify MolmoForCausalLM MLP (#11510) · f57ee565
  Jee Jee Li authored Dec 26, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f57ee565
- [V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681) · dcb1a944
  sroy745 authored Dec 26, 2024
```
Signed-off-by: Sourashis Roy <sroy@roblox.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dcb1a944
- [Doc] Add `QVQ` and `QwQ` to the list of supported models (#11509) · 7492a362
  Roger Wang authored Dec 26, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  7492a362
- [Misc][LoRA] Fix LoRA weight mapper (#11495) · aa25985b
  Jee Jee Li authored Dec 26, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  aa25985b
- Mypy checking for vllm/compilation (#11496) · dbeac95d
  Lucas Tucker authored Dec 25, 2024
```
Signed-off-by: lucast2021 <lucast2021@headroyce.org>
Co-authored-by: lucast2021 <lucast2021@headroyce.org>
```
  dbeac95d
- [Misc] Move some multimodal utils to modality-specific modules (#11494) · 51a624bf
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51a624bf
25 Dec, 2024 4 commits
- [Doc] Improve GitHub links (#11491) · 6ad909fd
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ad909fd
- [Frontend] Enable decord to load video from base64 (#11492) · b689ada9
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b689ada9
- [Misc] Update disaggregation benchmark scripts and test logs (#11456) · fc601665
  Jiaxin Shan authored Dec 24, 2024
```
Signed-off-by: Jiaxin Shan <seedjeffwan@gmail.com>
```
  fc601665
- [V1] Unify VLLM_ENABLE_V1_MULTIPROCESSING handling in RayExecutor (#11472) · 9832e557
  Rui Qiao authored Dec 24, 2024
  
  9832e557
24 Dec, 2024 9 commits
- [Model] Automatic conversion of classification and reward models (#11469) · 3f3e92e1
  Cyrus Leung authored Dec 25, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f3e92e1
- [Bugfix] Fix issues in CPU build Dockerfile. Fixes #9182 (#11435) · 409475a8
  Yuan Tang authored Dec 24, 2024
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  409475a8
- [Misc] Move weights mapper (#11443) · 196c34b0
  Jee Jee Li authored Dec 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  196c34b0
- [attn][tiny fix] fix attn backend in MultiHeadAttention (#11463) · 5c796324
  Mengqing Cao authored Dec 24, 2024
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  5c796324
- [OpenVINO] Fixed installation conflicts (#11458) · 461cde20
  Ilya Lavrenov authored Dec 24, 2024
```
Signed-off-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
```
  461cde20
- [Bugfix][Hardware][CPU] Fix CPU `input_positions` creation for text-only inputs with mrope (#11434) · 7a5286cc
  Isotr0py authored Dec 24, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  7a5286cc
- [Bugfix] Fix Qwen2-VL LoRA weight loading (#11430) · b1b1038f
  Jee Jee Li authored Dec 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b1b1038f
- [Frontend] Online Pooling API (#11457) · 9edca6bf
  Cyrus Leung authored Dec 24, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9edca6bf
- [Misc]Suppress irrelevant exception stack trace information when CUDA… (#11438) · 4f074fbf
  dpxa authored Dec 24, 2024
```
Co-authored-by: shiquan <shiquan>
```
  4f074fbf
23 Dec, 2024 3 commits
- [V1] TP Ray executor (#11107) · a491d6f5
  Rui Qiao authored Dec 23, 2024
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  a491d6f5
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059
- [Doc] Fix typo in the help message of '--guided-decoding-backend' (#11440) · 94d545a1
  yansh97 authored Dec 24, 2024
  
  94d545a1