Commits · 4851c202bbfb5dadc5a3b3b4409d3f083f4e8e90 · OpenDAS / vllm_cscc

11 Sep, 2024 4 commits
- Pixtral (#8377) · d394787e
  Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  d394787e
- [Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77
  Yang Fan authored Sep 12, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3b7fea77
- [model] Support for Llava-Next-Video model (#7559) · 6a512a00
  Yangshen⚡Deng authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6a512a00
- [Hardware][NV] Add support for ModelOpt static scaling checkpoints. (#6112) · efcf946a
  Pavani Majety authored Sep 10, 2024
  
  efcf946a
07 Sep, 2024 3 commits
- [Model][VLM] Support multi-images inputs for InternVL2 models (#8201) · e8071259
  Isotr0py authored Sep 07, 2024
  
  e8071259
- [Bugfix] Fix Hermes tool call chat template bug (#8256) · 41e95c52
  Kyle Mistele authored Sep 06, 2024
```
Co-authored-by: Kyle Mistele <kyle@constellate.ai>
```
  41e95c52
- [misc] [doc] [frontend] LLM torch profiler support (#7943) · 12dd7158
  William Lin authored Sep 06, 2024
  
  12dd7158
06 Sep, 2024 2 commits
- [Misc] Remove `SqueezeLLM` (#8220) · 23f32229
  Dipika Sikka authored Sep 06, 2024
  
  23f32229
- add template_llama_chat.jinja · b5160479
  zhuwenwen authored Sep 06, 2024
  
  b5160479
05 Sep, 2024 2 commits
- [MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029) · 9da25a88
  Alex Brooks authored Sep 05, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9da25a88
- [Doc] Indicate more information about supported modalities (#8181) · 288a9388
  Cyrus Leung authored Sep 05, 2024
  
  288a9388
04 Sep, 2024 3 commits
- [Neuron] Adding support for adding/ overriding neuron configuration a… (#8062) · 008cf886
  Harsha vardhan manoj Bikki authored Sep 04, 2024
```
Co-authored-by: Harsha Bikki <harbikh@amazon.com>
```
  008cf886
- [Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649) · e02ce498
  Kyle Mistele authored Sep 04, 2024
```
Co-authored-by: constellate <constellate@1-ai-appserver-staging.codereach.com>
Co-authored-by: Kyle Mistele <kyle@constellate.ai>
```
  e02ce498
- [Model] Add Ultravox support for multiple audio chunks (#7963) · 2be8ec6e
  Peter Salas authored Sep 03, 2024
  
  2be8ec6e
02 Sep, 2024 1 commit
- fix error in test_long_context.py::test_batched_rope_kernel and add a demo · 5e19cdef
  zhuwenwen authored Sep 02, 2024
  
  5e19cdef
31 Aug, 2024 1 commit
- [Frontend][VLM] Add support for multiple multi-modal items (#8049) · 5231f089
  Roger Wang authored Aug 31, 2024
  
  5231f089
29 Aug, 2024 1 commit
- [Neuron] Adding support for context-lenght, token-gen buckets. (#7885) · 257afc37
  Harsha vardhan manoj Bikki authored Aug 29, 2024
```
Co-authored-by: Harsha Bikki <harbikh@amazon.com>
```
  257afc37
26 Aug, 2024 1 commit
- [Bugfix]: Use float32 for base64 embedding (#7855) · 0b769992
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Aug 26, 2024
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  0b769992
22 Aug, 2024 1 commit
- [Doc] Fix incorrect docs from #7615 (#7788) · 57792ed4
  Peter Salas authored Aug 22, 2024
  
  57792ed4
21 Aug, 2024 1 commit
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
20 Aug, 2024 1 commit
- [CI/Build] Pin OpenTelemetry versions and make errors clearer (#7266) · 2aa00d59
  Ronen Schaffer authored Aug 20, 2024
```
[CI/Build] Pin OpenTelemetry versions and make a availability errors clearer (#7266)
```
  2aa00d59
16 Aug, 2024 1 commit

Chat method for offline llm (#5049) · 3b19e39d

nunjunj authored Aug 16, 2024

Co-authored-by: nunjunj <ray@g-3ff9f30f2ed650001.c.vllm-405802.internal>
Co-authored-by: nunjunj <ray@g-1df6075697c3f0001.c.vllm-405802.internal>
Co-authored-by: nunjunj <ray@g-c5a2c23abc49e0001.c.vllm-405802.internal>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

3b19e39d

09 Aug, 2024 3 commits
- [Frontend] Support embeddings in the run_batch API (#7132) · 249b8822
  Pooya Davoodi authored Aug 09, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  249b8822
- [VLM][Doc] Add `stop_token_ids` to InternVL example (#7354) · 67abdbb4
  Isotr0py authored Aug 09, 2024
  
  67abdbb4
- [Core] Support serving encoder/decoder models (#7258) · 7eb4a51c
  Cyrus Leung authored Aug 09, 2024
  
  7eb4a51c
08 Aug, 2024 2 commits
- [Model] Rename MiniCPMVQwen2 to MiniCPMV2.6 (#7273) · 757ac70a
  Jee Jee Li authored Aug 08, 2024
  
  757ac70a
- update offline_inference.py · dd0c8f49
  zhuwenwen authored Aug 08, 2024
  
  dd0c8f49
06 Aug, 2024 1 commit

[Core] Subclass ModelRunner to support cross-attention & encoder sequences... · fd95e026

afeldman-nm authored Aug 06, 2024


[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

fd95e026

05 Aug, 2024 2 commits
- [Core] Support loading GGUF model (#5191) · 360bd67c
  Isotr0py authored Aug 06, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  360bd67c
- [Model] SiglipVisionModel ported from transformers (#6942) · c0d8f163
  Jungho Christopher Cho authored Aug 05, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  c0d8f163
31 Jul, 2024 1 commit
- update benchmarks and examples · 1190e964
  zhuwenwen authored Jul 31, 2024
  
  1190e964
29 Jul, 2024 1 commit
- [Model] Initialize support for InternVL2 series models (#6514) · 7cbd9ec7
  Isotr0py authored Jul 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  7cbd9ec7
27 Jul, 2024 5 commits
- [Model] Initial support for BLIP-2 (#5920) · 1ad86acf
  Cyrus Leung authored Jul 27, 2024
```
Co-authored-by: ywang96 <ywang@roblox.com>
```
  1ad86acf
- [bugfix] make args.stream work (#6831) · a57d7582
  Wang Ran (汪然) authored Jul 27, 2024
  
  a57d7582
- [Bugfix] Fix VLM example typo (#6859) · 925de97e
  Roger Wang authored Jul 26, 2024
  
  925de97e
- [Misc][VLM][Doc] Consolidate offline examples for vision language models (#6858) · aa46953a
  Roger Wang authored Jul 26, 2024
```
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  aa46953a
- Update README.md (#6847) · b5f49ee5
  Gurpreet Singh Dhami authored Jul 26, 2024
  
  b5f49ee5
25 Jul, 2024 3 commits
- [Bugfix] Add image placeholder for OpenAI Compatible Server of MiniCPM-V (#6787) · b75e314f
  Alphi authored Jul 26, 2024
```
Co-authored-by: hezhihui <hzh7269@modelbest.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b75e314f
- [Bugfix] Fix encoding_format in examples/openai_embedding_client.py (#6755) · 316a41ac
  Chang Su authored Jul 24, 2024
  
  316a41ac
- [Model] Adding support for MiniCPM-V (#4087) · 9e169a4c
  Alphi authored Jul 25, 2024
  
  9e169a4c