Commits · f33e033e2782a9258d8ef6a359643944629d4ced · OpenDAS / vllm_cscc · GitLab

10 Jan, 2025 2 commits
- [Docs] Fix docstring in `get_ip` function (#11932) · f33e033e
  Kuntai Du authored Jan 10, 2025
```
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  f33e033e
- [torch.compile] Hide KV cache behind torch.compile boundary (#11677) · cf5f000d
  Chen Zhang authored Jan 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  cf5f000d
09 Jan, 2025 3 commits

[Bugfix] Override dunder methods of placeholder modules (#11882) · 0bd1ff43
Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
0bd1ff43
[perf]fix current stream (#11870) · 310aca88
youkaichao authored Jan 09, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
310aca88

[Misc] Move `print_*_once` from utils to logger (#11298) · d848800e

Cyrus Leung authored Jan 09, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Maxime Fournioux <55544262+mfournioux@users.noreply.github.com>
Co-authored-by: Maxime Fournioux <55544262+mfournioux@users.noreply.github.com>

d848800e

08 Jan, 2025 2 commits

[Hardware][Apple] Native support for macOS Apple Silicon (#11696) · cfd3219f
Wallas Henrique authored Jan 08, 2025
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
cfd3219f

[misc] improve memory profiling (#11809) · 889e662e

youkaichao authored Jan 08, 2025


Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

889e662e

06 Jan, 2025 2 commits
- [Doc][2/N] Reorganize Models and Usage sections (#11755) · ee77fdb5
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee77fdb5
- [Doc] [1/N] Reorganize Getting Started section (#11645) · 402d3783
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  402d3783
30 Dec, 2024 1 commit
- [platforms] enable platform plugins (#11602) · b12e87f9
  youkaichao authored Dec 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b12e87f9
28 Dec, 2024 1 commit
- [V1] [4/N] API Server: ZMQ/MP Utilities (#11541) · df04dffa
  Robert Shaw authored Dec 27, 2024
  
  df04dffa
27 Dec, 2024 1 commit
- [VLM] Support caching in merged multi-modal processor (#11396) · 10141809
  Cyrus Leung authored Dec 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  10141809
26 Dec, 2024 2 commits
- [2/N] API Server: Avoid ulimit footgun (#11530) · 55fb97f7
  Robert Shaw authored Dec 26, 2024
  
  55fb97f7
- [Misc] Add placeholder module (#11501) · eec906d8
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eec906d8
23 Dec, 2024 1 commit
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059
20 Dec, 2024 1 commit
- [misc] add early error message for custom ops (#11355) · c954f21a
  youkaichao authored Dec 19, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c954f21a
19 Dec, 2024 2 commits
- [Misc] Clean up and consolidate LRUCache (#11339) · cdf22afd
  Cyrus Leung authored Dec 20, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cdf22afd
- [VLM] Merged multimodal processor for Qwen2-Audio (#11303) · 6142ef0a
  Cyrus Leung authored Dec 19, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6142ef0a
17 Dec, 2024 1 commit
- [Bugfix] Fix request cancellation without polling (#11190) · 2d1b9baa
  Joe Runde authored Dec 17, 2024
  
  2d1b9baa
16 Dec, 2024 1 commit
- [core] overhaul memory profiling and fix backward compatibility (#10511) · 551603fe
  youkaichao authored Dec 16, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  551603fe
14 Dec, 2024 1 commit
- [VLM] Fully dynamic prompt replacement in merged input processor (#11199) · 93abf23a
  Cyrus Leung authored Dec 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  93abf23a
13 Dec, 2024 1 commit

[Refactor]A simple device-related refactor (#11163) · d1fa714c

Chenguang Li authored Dec 13, 2024


Signed-off-by: noemotiovon <noemotiovon@gmail.com>
Co-authored-by: noemotiovon <noemotiovon@gmail.com>

d1fa714c

11 Dec, 2024 1 commit
- [Model] PP support for Mamba-like models (#10992) · ffa48c91
  Mor Zusman authored Dec 11, 2024
```
Signed-off-by: mzusman <mor.zusmann@gmail.com>
```
  ffa48c91
10 Dec, 2024 1 commit
- [V1] Multiprocessing Tensor Parallel Support for v1 (#9856) · 28b3a1c7
  Tyler Michael Smith authored Dec 10, 2024
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  28b3a1c7
09 Dec, 2024 1 commit

[Neuron] Upgrade neuron to 2.20.2 (#11016) · 9c6459e4

xendo authored Dec 09, 2024


Signed-off-by: Jerzy Zagorski <jzagorsk@amazon.com>
Co-authored-by: Jerzy Zagorski <jzagorsk@amazon.com>

9c6459e4

07 Dec, 2024 1 commit
- [core][executor] simplify instance id (#10976) · 1b62745b
  youkaichao authored Dec 07, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1b62745b
05 Dec, 2024 1 commit
- [Doc] Create a new "Usage" section (#10827) · aa39a8e1
  Cyrus Leung authored Dec 05, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa39a8e1
03 Dec, 2024 1 commit
- [Build][Bugfix] Using the correct type hint (#10866) · a061fe60
  Gregory Shtrasberg authored Dec 03, 2024
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  a061fe60
01 Dec, 2024 1 commit
- [Model] Replace embedding models with pooling adapter (#10769) · 13370712
  Cyrus Leung authored Dec 01, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13370712
27 Nov, 2024 1 commit
- [Frontend] don't block event loop in tokenization (preprocess) in OpenAI compatible server (#10635) · 395b1c74
  tomeras91 authored Nov 27, 2024
```
Signed-off-by: Tomer Asida <tomera@ai21.com>
```
  395b1c74
26 Nov, 2024 1 commit
- [misc] do not read HOST_IP (#10644) · 6e9ff050
  youkaichao authored Nov 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6e9ff050
23 Nov, 2024 1 commit
- [2/N] handling placeholders in merged multi-modal processor (#10485) · c8acd805
  Cyrus Leung authored Nov 23, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c8acd805
22 Nov, 2024 1 commit
- [torch.compile] support all attention backends (#10558) · eebad39f
  youkaichao authored Nov 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eebad39f
21 Nov, 2024 3 commits
- [8/N] enable cli flag without a space (#10529) · 7560ae5c
  youkaichao authored Nov 21, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  7560ae5c
- [Misc] Suppress duplicated logging regarding multimodal input pipeline (#10530) · c51e397f
  Roger Wang authored Nov 21, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  c51e397f
- [torch.compile] Inductor code caching fix (#10273) · 8b0fe06c
  Luka Govedič authored Nov 21, 2024
```
Signed-off-by: luka <luka@neuralmagic.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
```
  8b0fe06c
20 Nov, 2024 1 commit
- [Misc] Add __setitem__ for LazyDict (#10469) · 9e05252b
  Yanyi Liu authored Nov 20, 2024
```
Signed-off-by: Yanyi Liu <wolfsonliu@163.com>
```
  9e05252b
18 Nov, 2024 1 commit
- [4/N][torch.compile] clean up set_torch_compile_backend (#10401) · 51bb12d1
  youkaichao authored Nov 17, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  51bb12d1
15 Nov, 2024 1 commit
- [Misc] Fix import error in tensorizer tests and cleanup some code (#10349) · b311efd0
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b311efd0
10 Nov, 2024 1 commit

[Misc] small fixes to function tracing file path (#9543) · 20cf2f55

Shawn Du authored Nov 11, 2024


Signed-off-by: Shawn Du <shawnd200@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

20cf2f55