Commits · c9f09a4fe83ef13824ea1663214ac7aad08d2b31 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "32d2b4064feea38802489b71e47703d1f901a17e"

11 Jan, 2025 1 commit
- [mypy] Fix mypy warnings in api_server.py (#11941) · c9f09a4f
  Fred Reiss authored Jan 10, 2025
```
Signed-off-by: Fred Reiss <frreiss@us.ibm.com>
```
  c9f09a4f
10 Jan, 2025 20 commits
- [Bugfix] Check that number of images matches number of <|image|> tokens with mllama (#11939) · d45cbe70
  Travis Johnson authored Jan 10, 2025
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  d45cbe70
- [Misc] Update benchmark_prefix_caching.py fixed example usage (#11920) · 8a579408
  minmin authored Jan 11, 2025
```
Signed-off-by: Ren MinMin <renmm6@chinaunicom.cn>
Co-authored-by: Ren MinMin <renmm6@chinaunicom.cn>
```
  8a579408
- [Misc] Clean up debug code in Deepseek-V3 (#11930) · 46fa98cc
  Isotr0py authored Jan 11, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  46fa98cc
- [Hardware][CPU] Support MOE models on x86 CPU (#11831) · aa1e77a1
  Li, Jiang authored Jan 11, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  aa1e77a1
- Doc fix in `benchmark_long_document_qa_throughput.py` (#11933) · 5959564f
  Kuntai Du authored Jan 10, 2025
```
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  5959564f
- [Docs] Fix docstring in `get_ip` function (#11932) · f33e033e
  Kuntai Du authored Jan 10, 2025
```
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  f33e033e
- [Doc] Rename offline inference examples (#11927) · 482cdc49
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  482cdc49
- [platform] support custom torch.compile backend key (#11318) · 20410b2f
  wangxiyuan authored Jan 10, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  20410b2f
- [Doc] [1/N] Initial guide for merged multi-modal processor (#11925) · 12664ddd
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  12664ddd
- [ci] Fix sampler tests (#11922) · 241ad7b3
  youkaichao authored Jan 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  241ad7b3
- Replace "online inference" with "online serving" (#11923) · d85c47d6
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d85c47d6
- [platform] support pytorch custom op pluggable (#11328) · ef725fea
  wangxiyuan authored Jan 10, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  ef725fea
- [misc] remove python function call for custom activation op (#11885) · d907be7d
  cennn authored Jan 10, 2025
```
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  d907be7d
- [ci] fix gh200 tests (#11919) · d53575a5
  youkaichao authored Jan 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d53575a5
- [BUGFIX] Fix `UnspecifiedPlatform` package name (#11916) · 61af6332
  Kunshang Ji authored Jan 10, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  61af6332
- [Bugfix] Validate lora adapters to avoid crashing server (#11727) · ac2f3f7f
  Joe Runde authored Jan 10, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ac2f3f7f
- [torch.compile] Hide KV cache behind torch.compile boundary (#11677) · cf5f000d
  Chen Zhang authored Jan 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  cf5f000d
- [Doc] Show default pooling method in a table (#11904) · 3de2b1ea
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3de2b1ea
- [VLM] Enable tokenized inputs for merged multi-modal processor (#11900) · b844b99a
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b844b99a
- [Doc][5/N] Move Community and API Reference to the bottom (#11896) · c3cf54dd
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c3cf54dd
09 Jan, 2025 13 commits
- [Docs] Add Modal to deployment frameworks (#11907) · 36f53035
  Charles Frye authored Jan 09, 2025
  
  36f53035
- [Misc] Provide correct Pixtral-HF chat template (#11891) · 9a228348
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9a228348
- [ci]try to fix flaky multi-step tests (#11894) · bd828722
  youkaichao authored Jan 09, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  bd828722
- [platform] Allow platform specify attention backend (#11609) · 405eb8e3
  wangxiyuan authored Jan 09, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Co-authored-by: Mengqing Cao <cmq0113@163.com>
```
  405eb8e3
- [Doc] Add model development API Reference (#11884) · 65097ca0
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  65097ca0
- [Bugfix] fix beam search input errors and latency benchmark script (#11875) · 1d967acb
  Ye (Charlotte) Qi authored Jan 09, 2025
```
Signed-off-by: Ye Qi <yeq@meta.com>
Co-authored-by: yeq <yeq@devgpu004.lla3.facebook.com>
```
  1d967acb
- [Bugfix] Override dunder methods of placeholder modules (#11882) · 0bd1ff43
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0bd1ff43
- [perf]fix current stream (#11870) · 310aca88
  youkaichao authored Jan 09, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  310aca88
- [Doc] Intended links Python multiprocessing library (#11878) · a732900e
  Guspan Tanadi authored Jan 09, 2025
  
  a732900e
- [Misc] Move `print_*_once` from utils to logger (#11298) · d848800e
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Maxime Fournioux <55544262+mfournioux@users.noreply.github.com>
Co-authored-by: Maxime Fournioux <55544262+mfournioux@users.noreply.github.com>
```
  d848800e
- [Doc] Recommend uv and python 3.12 for quickstart guide (#11849) · 730e9592
  Michael Goin authored Jan 08, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  730e9592
- treat do_lower_case in the same way as the sentence-transformers library (#11815) · 1fe554ba
  Maximilien de Bayser authored Jan 09, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  1fe554ba
- [CI] Turn on basic correctness tests for V1 (#10864) · 615e4a54
  Tyler Michael Smith authored Jan 08, 2025
  
  615e4a54
08 Jan, 2025 6 commits
- [Docs] Add Google Cloud Meetup (#11864) · 3db0cafd
  Simon Mo authored Jan 08, 2025
  
  3db0cafd
- [Kernel][Triton][AMD] Use block size heuristic for avg 2.8x speedup for int8 models (#11698) · 526de822
  rasmith authored Jan 08, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  526de822
- [TPU][Quantization] TPU `W8A8` (#11785) · 56fe4c29
  Robert Shaw authored Jan 08, 2025
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56fe4c29
- [Misc]add some explanations for BlockHashType (#11847) · 47de8821
  WangErXiao authored Jan 09, 2025
  
  47de8821
- [Doc] Expand Multimodal API Reference (#11852) · 5984499e
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5984499e
- [Misc] Move some model utils into vision file (#11848) · ca47e176
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca47e176