Commits · 4b4eeb26d5e8f1000787973818b08e896dc27834 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "8fc64935a02129ec9b4059bdd6146b838c39e811"

24 Oct, 2024 7 commits
- [core] simplify seq group code (#9569) · 4fdc581f
  youkaichao authored Oct 24, 2024
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  4fdc581f
- [V1][Bugfix] Clean up requests when aborted (#9629) · 3770071e
  Woosuk Kwon authored Oct 23, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  3770071e
- [Bugfix] Fix PP for ChatGLM and Molmo (#9422) · 836e8ef6
  Cyrus Leung authored Oct 24, 2024
  
  836e8ef6
- [XPU] avoid triton import for xpu (#9440) · 056a68c7
  Yan Ma authored Oct 24, 2024
```
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  056a68c7
- [Bugfix]: Make chat content text allow type content (#9358) · 33bab410
  Vinay R Damodaran authored Oct 24, 2024
```
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
```
  33bab410
- [Bugfix] Use "vision_model" prefix for MllamaVisionModel (#9628) · b7df53cd
  Michael Goin authored Oct 23, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  b7df53cd
- [Bugfix][Model] Fix Mllama SDPA illegal memory access for batched multi-image (#9626) · bb01f291
  Michael Goin authored Oct 23, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  bb01f291
23 Oct, 2024 12 commits
- [Model] Add Qwen2-Audio model support (#9248) · fc6c2746
  Yunfei Chu authored Oct 24, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fc6c2746
- [Frontend] Enable Online Multi-image Support for MLlama (#9393) · 150b7790
  Alex Brooks authored Oct 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  150b7790
- [torch.compile] Adding torch compile annotations to some models (#9614) · 9013e24f
  Yongzao authored Oct 24, 2024
  
  9013e24f
- [Bugfix] Fix divide by zero when serving Mamba models (#9617) · e5ac6a41
  Tyler Michael Smith authored Oct 23, 2024
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  e5ac6a41
- [misc] comment to avoid future confusion about baichuan (#9620) · dbdd3b5e
  youkaichao authored Oct 23, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  dbdd3b5e
- [Bugfix] Fix `_init_vision_model` in NVLM_D model (#9611) · e7116c01
  Cyrus Leung authored Oct 23, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  e7116c01
- [Model] Add min_pixels / max_pixels to Qwen2VL as mm_processor_kwargs (#9612) · 31a08f5b
  Alex Brooks authored Oct 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  31a08f5b
- [VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217) · c18e1a34
  Cyrus Leung authored Oct 23, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  c18e1a34
- [Model] Initialize Florence-2 language backbone support (#9555) · 3ff57ebf
  Isotr0py authored Oct 23, 2024
  
  3ff57ebf
- [Hardware][XPU] using current_platform.is_xpu (#9605) · 2394962d
  Mengqing Cao authored Oct 23, 2024
  
  2394962d
- [Model] Support E5-V (#9576) · 831540cf
  Cyrus Leung authored Oct 23, 2024
  
  831540cf
- [Misc] Add an env var VLLM_LOGGING_PREFIX, if set, it will be prepend to all... · 29061ed9
  Flex Wang authored Oct 22, 2024
```
[Misc] Add an env var VLLM_LOGGING_PREFIX, if set, it will be prepend to all logging messages (#9590)
```
  29061ed9
22 Oct, 2024 17 commits
- [BugFix] Fix metrics error for --num-scheduler-steps > 1 (#8234) · b17046e2
  yulei authored Oct 23, 2024
  
  b17046e2
- [Bugfix] fix detokenizer shallow copy (#5919) · 23b899a8
  Aurick Qiao authored Oct 22, 2024
  
  23b899a8
- [torch.compile] auto infer dynamic_arg_dims from type annotation (#9589) · 17c79f3c
  youkaichao authored Oct 22, 2024
  
  17c79f3c
- [BugFix] Prevent exporting duplicate OpenTelemetry spans (#9017) · cd5601ac
  Ronen Schaffer authored Oct 22, 2024
  
  cd5601ac
- [Frontend] Support custom request_id from request (#9550) · 434984e6
  Yuhong Guo authored Oct 23, 2024
```
Co-authored-by: Yuhong Guo <yuhong.gyh@antgroup.com>
```
  434984e6
- [Bugfix] Eagle: change config name for fc bias (#9580) · 08075c34
  gopalsarda authored Oct 22, 2024
  
  08075c34
- [Model][VLM] Initialize support for Mono-InternVL model (#9528) · bb392ea2
  Isotr0py authored Oct 23, 2024
  
  bb392ea2
- [Neuron] [Bugfix] Fix neuron startup (#9374) · 9dbcce84
  xendo authored Oct 22, 2024
```
Co-authored-by: Jerzy Zagorski <jzagorsk@amazon.com>
```
  9dbcce84
- [V1] Implement vLLM V1 [1/N] (#9289) · 6c5af09b
  Woosuk Kwon authored Oct 22, 2024
  
  6c5af09b
- [Hardware][CPU] using current_platform.is_cpu (#9536) · 3ddbe255
  wangshuai09 authored Oct 22, 2024
  
  3ddbe255
- support TP in qwen2 bnb (#9574) · 0d02747f
  chenqianfzh authored Oct 22, 2024
  
  0d02747f
- [Core] Remove evictor_v1 (#9572) · ca30c3c8
  Kuntai Du authored Oct 21, 2024
  
  ca30c3c8
- [Bugfix]: phi.py get rope_theta from config file (#9503) · 74692421
  Falko1 authored Oct 22, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  74692421
- [Bugfix]: serialize config by value for --trust-remote-code (#6751) · b7299011
  Travis Johnson authored Oct 21, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b7299011
- 增加w8a8的triton环境变量控制 · 2009d4a1
  zhuwenwen authored Oct 22, 2024
  
  2009d4a1
- remove notes · f7512877
  zhuwenwen authored Oct 22, 2024
  
  f7512877
- [core] move parallel sampling out from vllm core (#9302) · 76a5e132
  youkaichao authored Oct 21, 2024
  
  76a5e132
21 Oct, 2024 4 commits
- [Frontend] Don't log duplicate error stacktrace for every request in the batch (#9023) · 711f3a78
  Wallas Henrique authored Oct 21, 2024
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
```
  711f3a78
- [BugFix] Update draft model TP size check to allow matching target TP size (#9394) · 15713e3b
  Nick Hill authored Oct 21, 2024
```
Co-authored-by: Baoyuan Qi <qibaoyuan@126.com>
```
  15713e3b
- [Frontend] Reduce frequency of client cancellation checking (#7959) · 9d9186be
  Nick Hill authored Oct 21, 2024
  
  9d9186be
- [Model][Bugfix] Fix batching with multi-image in PixtralHF (#9518) · 5241aa14
  Michael Goin authored Oct 21, 2024
  
  5241aa14