Commits · 241ad7b301facac0728e2b3312d71fe47acc8c9e · OpenDAS / vllm_cscc · GitLab

10 Jan, 2025 11 commits
- [ci] Fix sampler tests (#11922) · 241ad7b3
  youkaichao authored Jan 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  241ad7b3
- Replace "online inference" with "online serving" (#11923) · d85c47d6
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d85c47d6
- [platform] support pytorch custom op pluggable (#11328) · ef725fea
  wangxiyuan authored Jan 10, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  ef725fea
- [misc] remove python function call for custom activation op (#11885) · d907be7d
  cennn authored Jan 10, 2025
```
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  d907be7d
- [ci] fix gh200 tests (#11919) · d53575a5
  youkaichao authored Jan 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d53575a5
- [BUGFIX] Fix `UnspecifiedPlatform` package name (#11916) · 61af6332
  Kunshang Ji authored Jan 10, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  61af6332
- [Bugfix] Validate lora adapters to avoid crashing server (#11727) · ac2f3f7f
  Joe Runde authored Jan 10, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ac2f3f7f
- [torch.compile] Hide KV cache behind torch.compile boundary (#11677) · cf5f000d
  Chen Zhang authored Jan 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  cf5f000d
- [Doc] Show default pooling method in a table (#11904) · 3de2b1ea
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3de2b1ea
- [VLM] Enable tokenized inputs for merged multi-modal processor (#11900) · b844b99a
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b844b99a
- [Doc][5/N] Move Community and API Reference to the bottom (#11896) · c3cf54dd
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c3cf54dd
09 Jan, 2025 13 commits
- [Docs] Add Modal to deployment frameworks (#11907) · 36f53035
  Charles Frye authored Jan 09, 2025
  
  36f53035
- [Misc] Provide correct Pixtral-HF chat template (#11891) · 9a228348
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9a228348
- [ci]try to fix flaky multi-step tests (#11894) · bd828722
  youkaichao authored Jan 09, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  bd828722
- [platform] Allow platform specify attention backend (#11609) · 405eb8e3
  wangxiyuan authored Jan 09, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Co-authored-by: Mengqing Cao <cmq0113@163.com>
```
  405eb8e3
- [Doc] Add model development API Reference (#11884) · 65097ca0
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  65097ca0
- [Bugfix] fix beam search input errors and latency benchmark script (#11875) · 1d967acb
  Ye (Charlotte) Qi authored Jan 09, 2025
```
Signed-off-by: Ye Qi <yeq@meta.com>
Co-authored-by: yeq <yeq@devgpu004.lla3.facebook.com>
```
  1d967acb
- [Bugfix] Override dunder methods of placeholder modules (#11882) · 0bd1ff43
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0bd1ff43
- [perf]fix current stream (#11870) · 310aca88
  youkaichao authored Jan 09, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  310aca88
- [Doc] Intended links Python multiprocessing library (#11878) · a732900e
  Guspan Tanadi authored Jan 09, 2025
  
  a732900e
- [Misc] Move `print_*_once` from utils to logger (#11298) · d848800e
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Maxime Fournioux <55544262+mfournioux@users.noreply.github.com>
Co-authored-by: Maxime Fournioux <55544262+mfournioux@users.noreply.github.com>
```
  d848800e
- [Doc] Recommend uv and python 3.12 for quickstart guide (#11849) · 730e9592
  Michael Goin authored Jan 08, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  730e9592
- treat do_lower_case in the same way as the sentence-transformers library (#11815) · 1fe554ba
  Maximilien de Bayser authored Jan 09, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  1fe554ba
- [CI] Turn on basic correctness tests for V1 (#10864) · 615e4a54
  Tyler Michael Smith authored Jan 08, 2025
  
  615e4a54
08 Jan, 2025 16 commits
- [Docs] Add Google Cloud Meetup (#11864) · 3db0cafd
  Simon Mo authored Jan 08, 2025
  
  3db0cafd
- [Kernel][Triton][AMD] Use block size heuristic for avg 2.8x speedup for int8 models (#11698) · 526de822
  rasmith authored Jan 08, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  526de822
- [TPU][Quantization] TPU `W8A8` (#11785) · 56fe4c29
  Robert Shaw authored Jan 08, 2025
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56fe4c29
- [Misc]add some explanations for BlockHashType (#11847) · 47de8821
  WangErXiao authored Jan 09, 2025
  
  47de8821
- [Doc] Expand Multimodal API Reference (#11852) · 5984499e
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5984499e
- [Misc] Move some model utils into vision file (#11848) · ca47e176
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca47e176
- [Bugfix][XPU] fix silu_and_mul (#11823) · 78f4590b
  Yan Ma authored Jan 09, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  78f4590b
- [CI/Build][Bugfix] Fix CPU CI image clean up (#11836) · 2f702498
  Li, Jiang authored Jan 08, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  2f702498
- [Doc][4/N] Reorganize API Reference (#11843) · 6cd40a5b
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6cd40a5b
- [Doc] Move examples into categories (#11840) · aba8d6ee
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aba8d6ee
- [VLM] Reorganize profiling/processing-related code (#11812) · 2a0596bc
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2a0596bc
- [torch.compile] consider relevant code in compilation cache (#11614) · f1214117
  youkaichao authored Jan 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f1214117
- [Hardware][Apple] Native support for macOS Apple Silicon (#11696) · cfd3219f
  Wallas Henrique authored Jan 08, 2025
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  cfd3219f
- [Docs] Update sponsor name: 'Novita' to 'Novita AI' (#11833) · a1b2b860
  Simon Mo authored Jan 07, 2025
  
  a1b2b860
- [doc] update wheels url (#11830) · ad9f1aa6
  youkaichao authored Jan 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ad9f1aa6
- [misc] improve memory profiling (#11809) · 889e662e
  youkaichao authored Jan 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  889e662e