Commits · 4fd937502827a7e06c54ded1f9d9b70ff640e222 · OpenDAS / vllm_cscc · GitLab

17 Nov, 2024 1 commit
- [2/N][torch.compile] make compilation cfg part of vllm cfg (#10383) · 4fd93750
  youkaichao authored Nov 16, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4fd93750
16 Nov, 2024 8 commits
- [V1] Add code owners for V1 (#10397) · 661a34fd
  Woosuk Kwon authored Nov 16, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  661a34fd
- [Bugfix] Fix M-RoPE position calculation when chunked prefill is enabled (#10388) · 361c29e1
  电脑星人 authored Nov 17, 2024
```
Signed-off-by: imkero <kerorek@outlook.com>
```
  361c29e1
- [Misc] Medusa supports custom bias (#10361) · b98d89ef
  Sky Lee authored Nov 17, 2024
  
  b98d89ef
- [Misc] Update benchmark to support image_url file or http (#10287) · 8b6725b0
  Jaehyun An authored Nov 16, 2024
```
Signed-off-by: rbbang <anjaehyun87@gmail.com>
```
  8b6725b0
- [BugFix] [Kernel] Fix GPU SEGV occuring in fused_moe kernel (#10385) · 1d754726
  rasmith authored Nov 16, 2024
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  1d754726
- [misc][plugin] improve log messages (#10386) · 2f427c2d
  youkaichao authored Nov 16, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2f427c2d
- [doc] add doc for the plugin system (#10372) · 755b8535
  youkaichao authored Nov 15, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  755b8535
- [Frontend] Automatic detection of chat content format from AST (#9919) · 32e46e00
  Cyrus Leung authored Nov 16, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32e46e00
15 Nov, 2024 23 commits
- [Docs] Misc updates to TPU installation instructions (#10165) · 4f168f69
  Michael Green authored Nov 15, 2024
  
  4f168f69
- [Doc] Move PR template content to docs (#10159) · 3e8d14d8
  Russell Bryant authored Nov 15, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3e8d14d8
- [Frontend] Add --version flag to CLI (#10369) · a067f85e
  Russell Bryant authored Nov 15, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  a067f85e
- [Docs] Add Nebius as sponsors (#10371) · c76ac49d
  Simon Mo authored Nov 15, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  c76ac49d
- [Misc] bump mistral common version (#10367) · a6221a14
  Simon Mo authored Nov 15, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  a6221a14
- [Misc] Bump up test_fused_moe tolerance (#10364) · 79ee45b4
  ElizaWszola authored Nov 15, 2024
```
Signed-off-by: ElizaWszola <eliza@neuralmagic.com>
```
  79ee45b4
- [Bugfix] Ensure special tokens are properly filtered out for guided structured... · 691a3ec0
  Guillaume Calmettes authored Nov 15, 2024
```
[Bugfix] Ensure special tokens are properly filtered out for guided structured output with MistralTokenizer (#10363)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  691a3ec0
- [core][misc] keep compatibility for old-style classes (#10356) · 3a763ba0
  youkaichao authored Nov 15, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3a763ba0
- [Misc] Fix some help info of arg_utils to improve readability (#10362) · f2056f72
  shangmingc authored Nov 15, 2024
  
  f2056f72
- [Bugfix] Fix fully sharded LoRA bug (#10352) · 1d65ec7e
  Jee Jee Li authored Nov 15, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1d65ec7e
- [Doc] Remove float32 choice from --lora-dtype (#10348) · 26908554
  Xin Yang authored Nov 15, 2024
```
Signed-off-by: Xin Yang <xyang19@gmail.com>
```
  26908554
- [Misc] Fix import error in tensorizer tests and cleanup some code (#10349) · b311efd0
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b311efd0
- Add default value to avoid Falcon crash (#5363) (#10347) · 3d158cdc
  wchen61 authored Nov 15, 2024
```
Signed-off-by: wchen61 <wchen61@foxmail.com>
```
  3d158cdc
- [Build] skip renaming files for release wheels pipeline (#9671) · 02dbf30e
  Simon Mo authored Nov 14, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02dbf30e
- [Misc] Consolidate pooler config overrides (#10351) · 2ac6d0e7
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2ac6d0e7
- [Bugfix] Qwen-vl output is inconsistent in speculative decoding (#10350) · 2ec88272
  Sky Lee authored Nov 15, 2024
  
  2ec88272
- [Model] Support Qwen2 embeddings and use tags to select model tests (#10184) · b40cf640
  Cyrus Leung authored Nov 15, 2024
  
  b40cf640
- [Misc] Change RedundantReshapesPass and FusionPass logging from info to debug (#10308) · 2885ba0e
  Tyler Michael Smith authored Nov 14, 2024
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  2885ba0e
- [bugfix] Fix static asymmetric quantization case (#10334) · bf2ddc66
  Luka Govedič authored Nov 14, 2024
```
Signed-off-by: Daniël de Kok <me@danieldk.eu>
Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: Daniël de Kok <me@danieldk.eu>
```
  bf2ddc66
- [Bugfix] Fix unable to load some models (#10312) · 972112d8
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  972112d8
- [Tool parsing] Improve / correct mistral tool parsing (#10333) · 11cd1ae6
  Patrick von Platen authored Nov 15, 2024
  
  11cd1ae6
- [Bugfix] use AF_INET6 for OpenAI Compatible Server with ipv6 (#9583) · 554af922
  Zijin Xiao authored Nov 15, 2024
```
Signed-off-by: xiaozijin <xiaozijin@bytedance.com>
```
  554af922
- [Perf] Reduce peak memory usage of llama (#10339) · b2e0ad3b
  Murali Andoorveedu authored Nov 14, 2024
```
Signed-off-by: andoorve <37849411+andoorve@users.noreply.github.com>
```
  b2e0ad3b
14 Nov, 2024 8 commits
- Support Roberta embedding models (#9387) · 4a18fd14
  Maximilien de Bayser authored Nov 14, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>
```
  4a18fd14
- [Docs] Publish meetup slides (#10331) · 1dbae032
  Woosuk Kwon authored Nov 14, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1dbae032
- [CI/Build] Make shellcheck happy (#10285) · 675d6034
  Cyrus Leung authored Nov 14, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  675d6034
- [CI/Build] Fix CPU CI online inference timeout (#10314) · 03025c02
  Isotr0py authored Nov 14, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  03025c02
- [ci][distributed] disable hanging tests (#10317) · 29f3ef26
  youkaichao authored Nov 14, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  29f3ef26
- [Model] Add BNB quantization support for Idefics3 (#10310) · 294bf467
  B-201 authored Nov 14, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  294bf467
- [BugFix]: properly deserialize `tool_calls` iterator before processing by... · 52b48c1e
  Guillaume Calmettes authored Nov 14, 2024
```
[BugFix]: properly deserialize `tool_calls` iterator before processing by mistral-common when MistralTokenizer is used (#9951)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  52b48c1e
- [Frontend] Pythonic tool parser (#9859) · f67ce05d
  Mike Depinet authored Nov 13, 2024
```
Signed-off-by: Mike Depinet <mike@fixie.ai>
```
  f67ce05d