Commits · 2a131965a8144d571a4a211a44d1fc32e202ae10 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "00e5cbb96789fd9d083b4015cdcff318e4de3808"

08 Oct, 2024 7 commits
- mypy: check additional directories (#9162) · 2a131965
  Russell Bryant authored Oct 08, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  2a131965
- [Bugfix] Try to handle older versions of pytorch (#9086) · bd37b9fb
  bnellnm authored Oct 08, 2024
  
  bd37b9fb
- [Bugfix] fix OpenAI API server startup with --disable-frontend-multiprocessing (#8537) · 9a94ca4a
  Daniele authored Oct 08, 2024
  
  9a94ca4a
- [Frontend] Add Early Validation For Chat Template / Tool Call Parser (#9151) · 069d3bd8
  Alex Brooks authored Oct 08, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  069d3bd8
- [Core][Frontend] Add Support for Inference Time mm_processor_kwargs (#9131) · a3691b6b
  Alex Brooks authored Oct 08, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  a3691b6b
- [Frontend] API support for beam search for MQLLMEngine (#9117) · 8c746226
  Brendan Wong authored Oct 07, 2024
  
  8c746226
- [Intel GPU] Fix xpu decode input (#9145) · 80b57f00
  Kunshang Ji authored Oct 08, 2024
  
  80b57f00
07 Oct, 2024 8 commits
- [misc] fix comment and variable name (#9139) · fa45513a
  youkaichao authored Oct 07, 2024
  
  fa45513a
- [Model] Support NVLM-D and fix QK Norm in InternViT (#9045) · 151ef4ef
  Cyrus Leung authored Oct 07, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  151ef4ef
- [Core] Refactor GGUF parameters packing and forwarding (#8859) · f19da648
  Isotr0py authored Oct 07, 2024
  
  f19da648
- [Hardware][CPU] Cross-attention and Encoder-Decoder models support on CPU backend (#9089) · 4f95ffee
  Isotr0py authored Oct 07, 2024
  
  4f95ffee
- [Model] Explicit interface for vLLM models and support OOT embedding models (#9108) · 8c6de96e
  Cyrus Leung authored Oct 07, 2024
  
  8c6de96e
- [core] remove beam search from the core (#9105) · 18b296fd
  youkaichao authored Oct 06, 2024
  
  18b296fd
- [BugFix][Core] Fix BlockManagerV2 when Encoder Input is None (#9103) · c8f26bb6
  sroy745 authored Oct 06, 2024
  
  c8f26bb6
- [Bugfix][Hardware][CPU] Fix CPU model input for decode (#9044) · 487678d0
  Isotr0py authored Oct 07, 2024
  
  487678d0
06 Oct, 2024 7 commits
- [Bugfix] Fix incorrect updates to num_computed_tokens in multi-step scheduling (#9038) · cb3b2b9b
  Varun Sundar Rabindranath authored Oct 06, 2024
```
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  cb3b2b9b
- [Bugfix] fix tool_parser error handling when serve a model not support it (#8709) · fdf59d30
  Yanyi Liu authored Oct 06, 2024
  
  fdf59d30
- [Model] PP support for embedding models and update docs (#9090) · b22b7984
  Cyrus Leung authored Oct 06, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  b22b7984
- [Misc] Remove user-facing error for removed VLM args (#9104) · f22619fe
  Cyrus Leung authored Oct 06, 2024
  
  f22619fe
- [Frontend] API support for beam search (#9087) · 168cab6b
  Brendan Wong authored Oct 05, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  168cab6b
- [Bugfix] Fix try-catch conditions to import correct Flash Attention Backend in Draft Model (#9101) · 23fea871
  TJian authored Oct 05, 2024
  
  23fea871
- [core] use forward context for flash infer (#9097) · f4dd830e
  youkaichao authored Oct 05, 2024
  
  f4dd830e
05 Oct, 2024 5 commits
- [Bugfix] Fix order of arguments matters in config.yaml (#8960) · 5df18348
  Andy Dai authored Oct 05, 2024
  
  5df18348
- [Bugfix] Deprecate registration of custom configs to huggingface (#9083) · cfadb9c6
  Chen Zhang authored Oct 05, 2024
  
  cfadb9c6
- [Model] Support Gemma2 embedding model (#9004) · 15986f59
  Xin Yang authored Oct 04, 2024
  
  15986f59
- [Bugfix] Fixes Phi3v & Ultravox Multimodal EmbeddingInputs (#8979) · 53b3a330
  hhzhang16 authored Oct 04, 2024
  
  53b3a330
- [Bugfix] use blockmanagerv1 for encoder-decoder (#9084) · dac914b0
  Chen Zhang authored Oct 04, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  dac914b0
04 Oct, 2024 12 commits
- [torch.compile] improve allreduce registration (#9061) · 663874e0
  youkaichao authored Oct 04, 2024
  
  663874e0
- [Hardware][Neuron] Add on-device sampling support for Neuron (#8746) · cc90419e
  Chongming Ni authored Oct 04, 2024
```
Co-authored-by: Ashraf Mahgoub <ashymahg@amazon.com>
```
  cc90419e
- [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) · 05d68643
  ElizaWszola authored Oct 04, 2024
```
Co-authored-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Dipika Sikka <ds3822@columbia.edu>
```
  05d68643
- Adds truncate_prompt_tokens param for embeddings creation (#8999) · 0dcc8cbe
  Flávia Béo authored Oct 04, 2024
```
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
```
  0dcc8cbe
- [Core][VLM] Test registration for OOT multimodal models (#8717) · 26aa325f
  Roger Wang authored Oct 04, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  26aa325f
- [Model] add a bunch of supported lora modules for mixtral (#9008) · 9ade8bbc
  Prashant Gupta authored Oct 04, 2024
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  9ade8bbc
- [Bugfix] Reshape the dimensions of the input image embeddings in Qwen2VL (#9071) · 3d826d2c
  whyiug authored Oct 04, 2024
  
  3d826d2c
- [Misc] Move registry to its own file (#9064) · 0e36fd49
  Cyrus Leung authored Oct 04, 2024
  
  0e36fd49
- [Models] Add remaining model PP support (#7168) · 0f6d7a9a
  Murali Andoorveedu authored Oct 03, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0f6d7a9a
- [Misc] Enable multi-step output streaming by default (#9047) · 303d4479
  Michael Goin authored Oct 03, 2024
  
  303d4479
- [CI/Build] Per file CUDA Archs (improve wheel size and dev build times) (#8845) · aeb37c2a
  Lucas Wilkinson authored Oct 03, 2024
  
  aeb37c2a
- [Frontend][Feature] support tool calling for internlm/internlm2_5-7b-chat model (#8405) · 3dbb215b
  代君 authored Oct 04, 2024
  
  3dbb215b
03 Oct, 2024 1 commit
- [Bugfix] Weight loading fix for OPT model (#9042) · 2838d6b3
  Domen Vreš authored Oct 04, 2024
```
Co-authored-by: dvres <dvres@fri.uni-lj.si>
```
  2838d6b3