Commits · ad9a78bf640cca930de76a066a2f34139b9acb65 · OpenDAS / vllm_cscc

"deploy/snapshot/internal/runtime/process_test.go" did not exist on "23144df513723f919ddc0a13f6f46e1bd6da822a"

11 Nov, 2024 2 commits
- [Doc] Fix typo error in vllm/entrypoints/openai/cli_args.py (#10196) · ad9a78bf
  yansh97 authored Nov 11, 2024
  
  ad9a78bf
- [misc] improve cloudpickle registration and tests (#10202) · 73b9083e
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  73b9083e
10 Nov, 2024 1 commit

[Misc] small fixes to function tracing file path (#9543) · 20cf2f55

Shawn Du authored Nov 11, 2024


Signed-off-by: Shawn Du <shawnd200@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

20cf2f55

09 Nov, 2024 9 commits
- [CI/Build] Split up models tests (#10069) · 51c2e1fc
  Cyrus Leung authored Nov 10, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51c2e1fc
- [Frontend][Core] Override HF `config.json` via CLI (#5836) · b09895a6
  Krishna Mandal authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b09895a6
- [Frontend] add `add_request_id` middleware (#9594) · d88bff1b
  cjackal authored Nov 09, 2024
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  d88bff1b
- bugfix: fix the bug that stream generate not work (#2756) · 9e372664
  Zhao Yingzhuo authored Nov 09, 2024
  
  9e372664
- [bugfix] fix broken tests of mlp speculator (#10177) · bd46357a
  youkaichao authored Nov 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  bd46357a
- [5/N] pass the whole config to model (#9983) · 1a95f10e
  youkaichao authored Nov 08, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1a95f10e
- [Bugfix] Ignore GPTQ quantization of Qwen2-VL visual module (#10169) · f83feccd
  Michael Goin authored Nov 08, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  f83feccd
- [0/N] Rename `MultiModalInputs` to `MultiModalKwargs` (#10040) · e0191a95
  Cyrus Leung authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e0191a95
- [Kernel][Triton] Add Triton implementation for scaled_mm_triton to support fp8... · 127c0748
  rasmith authored Nov 08, 2024
```
[Kernel][Triton] Add Triton implementation for scaled_mm_triton to support fp8 and int8 SmoothQuant, symmetric case (#9857)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  127c0748
08 Nov, 2024 13 commits
- [Bugfix] SymIntArrayRef expected to contain concrete integers (#10170) · 10b67d86
  bnellnm authored Nov 08, 2024
```
Signed-off-by: Bill Nell <bill@neuralmagic.com>
```
  10b67d86
- [torch.compile] Fuse RMSNorm with quant (#9138) · 4f93dfe9
  Luka Govedič authored Nov 08, 2024
```
Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: youkaichao <youkaichao@126.com>
```
  4f93dfe9
- Rename vllm.logging to vllm.logging_utils (#10134) · e1b5a821
  Florian Zimmermeister authored Nov 08, 2024
  
  e1b5a821
- [V1] Fix non-cudagraph op name (#10166) · b5815c84
  Woosuk Kwon authored Nov 08, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b5815c84
- Disable spec-decode + chunked-prefill for draft models with tensor parallelism > 1 (#10136) · f6778620
  sroy745 authored Nov 08, 2024
```
Signed-off-by: Sourashis Roy <sroy@roblox.com>
```
  f6778620
- Fix edge case Mistral tokenizer (#10152) · 0535e5fe
  Patrick von Platen authored Nov 08, 2024
  
  0535e5fe
- [CI/Build] Update CPU tests to include all "standard" tests (#5481) · b489fc3c
  Cyrus Leung authored Nov 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b489fc3c
- [V1]Enable APC by default only for text models (#10148) · 208ce622
  Roger Wang authored Nov 08, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  208ce622
- [Model] Expose size to Idefics3 as mm_processor_kwargs (#10146) · 1ff4aed5
  Isotr0py authored Nov 08, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  1ff4aed5
- [Bugfix][XPU] Fix xpu tp by introducing XpuCommunicator (#10144) · f10797c0
  Yan Ma authored Nov 08, 2024
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  f10797c0
- [Misc] Fix ImportError causing by triton (#9493) · 7371749d
  Mengqing Cao authored Nov 08, 2024
  
  7371749d
- [V1] Prefix caching (take 2) (#9972) · 201fc077
  Cody Yu authored Nov 07, 2024
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  201fc077
- [V1] Add all_token_ids attribute to Request (#10135) · 42b4f46b
  Woosuk Kwon authored Nov 07, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  42b4f46b
07 Nov, 2024 14 commits
- Online video support for VLMs (#10020) · 28b2877d
  litianjian authored Nov 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  28b2877d
- [Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291) · 9d43afcc
  Nicolò Lucchesi authored Nov 07, 2024
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  9d43afcc
- [Frontend] Tool calling parser for Granite 3.0 models (#9027) · ae62fd17
  Maximilien de Bayser authored Nov 07, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  ae62fd17
- [Bugfix] Make image processor respect `mm_processor_kwargs` for Qwen2-VL (#10112) · 999df95b
  Jiahao Li authored Nov 07, 2024
```
Signed-off-by: Jiahao Li <liplus17@163.com>
```
  999df95b
- [Frontend] Fix multiple values for keyword argument error (#10075) (#10076) · 0dfba97b
  Lei Yang authored Nov 07, 2024
```
Signed-off-by: Lei <ylxx@live.com>
```
  0dfba97b
- Adds method to read the pooling types from model's files (#9506) · aa9078fa
  Flávia Béo authored Nov 07, 2024
```
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  aa9078fa
- [Core][Distributed] Refactor ipc buffer init in CustomAllreduce (#10030) · 6192e9b8
  Hanzhi Zhou authored Nov 06, 2024
```
Signed-off-by: Hanzhi Zhou <hanzhi713@gmail.com>
```
  6192e9b8
- [Misc] Consolidate ModelConfig code related to HF config (#10104) · db7db4aa
  Cyrus Leung authored Nov 07, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  db7db4aa
- [V1][BugFix] Fix Generator construction in greedy + seed case (#10097) · 1fa020c5
  Nick Hill authored Nov 07, 2024
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  1fa020c5
- [Hardware][CPU] Update torch 2.5 (#9911) · a4b3e0c1
  Li, Jiang authored Nov 07, 2024
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a4b3e0c1
- [Frontend] Adjust try/except blocks in API impl (#10056) · 29862b88
  Nick Hill authored Nov 07, 2024
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  29862b88
- [Misc][XPU] Upgrade to Pytorch 2.5 for xpu backend (#9823) · d3859f18
  Yan Ma authored Nov 07, 2024
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  d3859f18
- [Bugfix] Fix FP8 torch._scaled_mm fallback for torch>2.5 with CUDA<12.4 (#10095) · 4ab32566
  Michael Goin authored Nov 06, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  4ab32566
- [core][distributed] add stateless_init_process_group (#10072) · 719c1ca4
  youkaichao authored Nov 06, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  719c1ca4
06 Nov, 2024 1 commit
- [V1] Make v1 more testable (#9888) · d58268c5
  Joe Runde authored Nov 06, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  d58268c5