Commits · 20cf2f553c223792ad3f65236b267586fa9bed6c · OpenDAS / vllm_cscc · GitLab

10 Nov, 2024 4 commits
- [Misc] small fixes to function tracing file path (#9543) · 20cf2f55
  Shawn Du authored Nov 11, 2024
```
Signed-off-by: Shawn Du <shawnd200@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  20cf2f55
- [doc] Polish the integration with huggingface doc (#10195) · bfb7d61a
  Yongzao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  bfb7d61a
- [Doc] Fix typo error in CONTRIBUTING.md (#10190) · 19682023
  FuryMartin authored Nov 10, 2024
```
Signed-off-by: FuryMartin <furymartin9910@outlook.com>
```
  19682023
- [ci][build] limit cmake version (#10188) · 9fa4bdde
  youkaichao authored Nov 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  9fa4bdde
09 Nov, 2024 15 commits
- [CI/Build] Split up models tests (#10069) · 51c2e1fc
  Cyrus Leung authored Nov 10, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51c2e1fc
- [Frontend][Core] Override HF `config.json` via CLI (#5836) · b09895a6
  Krishna Mandal authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b09895a6
- [Frontend] add `add_request_id` middleware (#9594) · d88bff1b
  cjackal authored Nov 09, 2024
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  d88bff1b
- bugfix: fix the bug that stream generate not work (#2756) · 9e372664
  Zhao Yingzhuo authored Nov 09, 2024
  
  9e372664
- [doc] explaining the integration with huggingface (#10173) · 8a4358ec
  youkaichao authored Nov 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  8a4358ec
- [bugfix] fix broken tests of mlp speculator (#10177) · bd46357a
  youkaichao authored Nov 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  bd46357a
- [Bugfix] Enable some fp8 and quantized fullgraph tests (#10171) · f192aeba
  bnellnm authored Nov 09, 2024
```
Signed-off-by: Bill Nell <bill@neuralmagic.com>
```
  f192aeba
- [CI/Build] Add run-hpu-test.sh script (#10167) · 8e1529dc
  Chendi.Xue authored Nov 09, 2024
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  8e1529dc
- [5/N] pass the whole config to model (#9983) · 1a95f10e
  youkaichao authored Nov 08, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1a95f10e
- [Doc] Adjust RunLLM location (#10176) · 49d2a41a
  Cyrus Leung authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  49d2a41a
- [CI/Build] Fix VLM broadcast tests `tensor_parallel_size` passing (#10161) · 47672f38
  Isotr0py authored Nov 09, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  47672f38
- [Bugfix] Ignore GPTQ quantization of Qwen2-VL visual module (#10169) · f83feccd
  Michael Goin authored Nov 08, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  f83feccd
- [0/N] Rename `MultiModalInputs` to `MultiModalKwargs` (#10040) · e0191a95
  Cyrus Leung authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e0191a95
- [CI/Build] Adding timeout in CPU CI to avoid CPU test queue blocking (#6892) · d7edca1d
  Li, Jiang authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d7edca1d
- [Kernel][Triton] Add Triton implementation for scaled_mm_triton to support fp8... · 127c0748
  rasmith authored Nov 08, 2024
```
[Kernel][Triton] Add Triton implementation for scaled_mm_triton to support fp8 and int8 SmoothQuant, symmetric case (#9857)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  127c0748
08 Nov, 2024 21 commits
- [Bugfix] SymIntArrayRef expected to contain concrete integers (#10170) · 10b67d86
  bnellnm authored Nov 08, 2024
```
Signed-off-by: Bill Nell <bill@neuralmagic.com>
```
  10b67d86
- [torch.compile] Fuse RMSNorm with quant (#9138) · 4f93dfe9
  Luka Govedič authored Nov 08, 2024
```
Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: youkaichao <youkaichao@126.com>
```
  4f93dfe9
- Rename vllm.logging to vllm.logging_utils (#10134) · e1b5a821
  Florian Zimmermeister authored Nov 08, 2024
  
  e1b5a821
- [CI/Build] Ignore .gitignored files for shellcheck (#10162) · 87713c60
  Luka Govedič authored Nov 08, 2024
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  87713c60
- [V1] Fix non-cudagraph op name (#10166) · b5815c84
  Woosuk Kwon authored Nov 08, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b5815c84
- [Misc] Improve Web UI (#10090) · 6b304715
  Rafael Vasquez authored Nov 08, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  6b304715
- Disable spec-decode + chunked-prefill for draft models with tensor parallelism > 1 (#10136) · f6778620
  sroy745 authored Nov 08, 2024
```
Signed-off-by: Sourashis Roy <sroy@roblox.com>
```
  f6778620
- Fix edge case Mistral tokenizer (#10152) · 0535e5fe
  Patrick von Platen authored Nov 08, 2024
  
  0535e5fe
- [CI/Build] Update CPU tests to include all "standard" tests (#5481) · b489fc3c
  Cyrus Leung authored Nov 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b489fc3c
- [V1]Enable APC by default only for text models (#10148) · 208ce622
  Roger Wang authored Nov 08, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  208ce622
- [Model] Expose size to Idefics3 as mm_processor_kwargs (#10146) · 1ff4aed5
  Isotr0py authored Nov 08, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  1ff4aed5
- [Bugfix][XPU] Fix xpu tp by introducing XpuCommunicator (#10144) · f10797c0
  Yan Ma authored Nov 08, 2024
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  f10797c0
- [Misc] Fix typo in #5895 (#10145) · f4c2187e
  Cyrus Leung authored Nov 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f4c2187e
- Add hf_transfer to testing image (#10096) · aea6ad62
  Michael Goin authored Nov 08, 2024
  
  aea6ad62
- Fixes a typo about 'max_decode_seq_len' which causes crashes with cuda graph. (#9285) · da07a9ea
  Tao He authored Nov 08, 2024
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  da07a9ea
- [Doc] Move CONTRIBUTING to docs site (#9924) · 3a7f15a3
  Russell Bryant authored Nov 08, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3a7f15a3
- [Misc] Fix ImportError causing by triton (#9493) · 7371749d
  Mengqing Cao authored Nov 08, 2024
  
  7371749d
- [Bugfix] Add error handling when server cannot respond any valid tokens (#5895) · ad39bd64
  DearPlanet authored Nov 08, 2024
  
  ad39bd64
- [Doc] Update FAQ links in spec_decode.rst (#9662) · 40d0e741
  whyiug authored Nov 08, 2024
```
Signed-off-by: whyiug <whyiug@hotmail.com>
```
  40d0e741
- [CI/Build] Give PR cleanup job PR write access (#10139) · 6bb52b0f
  Russell Bryant authored Nov 07, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  6bb52b0f
- [V1] Prefix caching (take 2) (#9972) · 201fc077
  Cody Yu authored Nov 07, 2024
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  201fc077