Commits · 2aa00d59ada908cbf58e241fb83b1a9b5c02f71b · OpenDAS / vllm_cscc

20 Aug, 2024 1 commit
- [CI/Build] Pin OpenTelemetry versions and make errors clearer (#7266) · 2aa00d59
  Ronen Schaffer authored Aug 20, 2024
```
[CI/Build] Pin OpenTelemetry versions and make a availability errors clearer (#7266)
```
  2aa00d59
16 Aug, 2024 1 commit

Chat method for offline llm (#5049) · 3b19e39d

nunjunj authored Aug 16, 2024

Co-authored-by: nunjunj <ray@g-3ff9f30f2ed650001.c.vllm-405802.internal>
Co-authored-by: nunjunj <ray@g-1df6075697c3f0001.c.vllm-405802.internal>
Co-authored-by: nunjunj <ray@g-c5a2c23abc49e0001.c.vllm-405802.internal>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

3b19e39d

09 Aug, 2024 3 commits
- [Frontend] Support embeddings in the run_batch API (#7132) · 249b8822
  Pooya Davoodi authored Aug 09, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  249b8822
- [VLM][Doc] Add `stop_token_ids` to InternVL example (#7354) · 67abdbb4
  Isotr0py authored Aug 09, 2024
  
  67abdbb4
- [Core] Support serving encoder/decoder models (#7258) · 7eb4a51c
  Cyrus Leung authored Aug 09, 2024
  
  7eb4a51c
08 Aug, 2024 1 commit
- [Model] Rename MiniCPMVQwen2 to MiniCPMV2.6 (#7273) · 757ac70a
  Jee Jee Li authored Aug 08, 2024
  
  757ac70a
06 Aug, 2024 1 commit

[Core] Subclass ModelRunner to support cross-attention & encoder sequences... · fd95e026

afeldman-nm authored Aug 06, 2024


[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

fd95e026

05 Aug, 2024 2 commits
- [Core] Support loading GGUF model (#5191) · 360bd67c
  Isotr0py authored Aug 06, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  360bd67c
- [Model] SiglipVisionModel ported from transformers (#6942) · c0d8f163
  Jungho Christopher Cho authored Aug 05, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  c0d8f163
29 Jul, 2024 1 commit
- [Model] Initialize support for InternVL2 series models (#6514) · 7cbd9ec7
  Isotr0py authored Jul 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  7cbd9ec7
27 Jul, 2024 5 commits
- [Model] Initial support for BLIP-2 (#5920) · 1ad86acf
  Cyrus Leung authored Jul 27, 2024
```
Co-authored-by: ywang96 <ywang@roblox.com>
```
  1ad86acf
- [bugfix] make args.stream work (#6831) · a57d7582
  Wang Ran (汪然) authored Jul 27, 2024
  
  a57d7582
- [Bugfix] Fix VLM example typo (#6859) · 925de97e
  Roger Wang authored Jul 26, 2024
  
  925de97e
- [Misc][VLM][Doc] Consolidate offline examples for vision language models (#6858) · aa46953a
  Roger Wang authored Jul 26, 2024
```
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  aa46953a
- Update README.md (#6847) · b5f49ee5
  Gurpreet Singh Dhami authored Jul 26, 2024
  
  b5f49ee5
25 Jul, 2024 3 commits
- [Bugfix] Add image placeholder for OpenAI Compatible Server of MiniCPM-V (#6787) · b75e314f
  Alphi authored Jul 26, 2024
```
Co-authored-by: hezhihui <hzh7269@modelbest.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b75e314f
- [Bugfix] Fix encoding_format in examples/openai_embedding_client.py (#6755) · 316a41ac
  Chang Su authored Jul 24, 2024
  
  316a41ac
- [Model] Adding support for MiniCPM-V (#4087) · 9e169a4c
  Alphi authored Jul 25, 2024
  
  9e169a4c
23 Jul, 2024 1 commit
- [doc][distributed] doc for setting up multi-node environment (#6529) · c051bfe4
  youkaichao authored Jul 22, 2024
```
[doc][distributed] add more doc for setting up multi-node environment (#6529)
```
  c051bfe4
18 Jul, 2024 1 commit
- [core][model] yet another cpu offload implementation (#6496) · 1c27d25f
  youkaichao authored Jul 17, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  1c27d25f
17 Jul, 2024 1 commit
- [Doc][CI/Build] Update docs and tests to use `vllm serve` (#6431) · 5bf35a91
  Cyrus Leung authored Jul 17, 2024
  
  5bf35a91
16 Jul, 2024 1 commit
- [CI/Build] vLLM cache directory for images (#6444) · d9701151
  Cyrus Leung authored Jul 16, 2024
  
  d9701151
15 Jul, 2024 1 commit
- [CI/Build][TPU] Add TPU CI test (#6277) · 4552e37b
  Woosuk Kwon authored Jul 15, 2024
```
Co-authored-by: kevin <kevin@anyscale.com>
```
  4552e37b
14 Jul, 2024 1 commit
- [Model] Initialize Fuyu-8B support (#3924) · 540c0368
  Isotr0py authored Jul 14, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  540c0368
07 Jul, 2024 1 commit
- [Model] Add PaliGemma (#5189) · 6206dcb2
  Roger Wang authored Jul 06, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6206dcb2
05 Jul, 2024 1 commit
- [Bugfix] Use templated datasource in grafana.json to allow automatic imports (#6136) · 0097bb18
  Christian Rohmann authored Jul 05, 2024
```
Signed-off-by: Christian Rohmann <christian.rohmann@inovex.de>
```
  0097bb18
03 Jul, 2024 2 commits

[vlm] Remove vision language config. (#6089) · d9e98f42

xwjiang2010 authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

d9e98f42

[Core] Dynamic image size support for VLMs (#5276) · 9831aec4

Cyrus Leung authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: ywang96 <ywang@roblox.com>
Co-authored-by: xwjiang2010 <87673679+xwjiang2010@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

9831aec4

02 Jul, 2024 1 commit

[VLM] Remove `image_input_type` from VLM config (#5852) · 98d6682c

xwjiang2010 authored Jul 02, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

98d6682c

01 Jul, 2024 1 commit
- [doc][misc] further lower visibility of simple api server (#6041) · 8893130b
  youkaichao authored Jul 01, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  8893130b
29 Jun, 2024 1 commit
- [Misc] Update Phi-3-Vision Example (#5981) · 329df38f
  Roger Wang authored Jun 28, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  329df38f
28 Jun, 2024 2 commits
- Unmark more files as executable (#5962) · 5d2a1a9c
  Tyler Michael Smith authored Jun 28, 2024
  
  5d2a1a9c
- [Core] Registry for processing model inputs (#5214) · 5cbe8d15
  Cyrus Leung authored Jun 28, 2024
```
Co-authored-by: ywang96 <ywang@roblox.com>
```
  5cbe8d15
27 Jun, 2024 3 commits
- [Doc] Add note about context length in Phi-3-Vision example (#5887) · 6eabc6cb
  Cyrus Leung authored Jun 27, 2024
  
  6eabc6cb
- [BugFix] Fix cuda graph for MLPSpeculator (#5875) · 2110557d
  Nick Hill authored Jun 26, 2024
```
Co-authored-by: Abhinav Goyal <abhinav.goyal@flipkart.com>
```
  2110557d
- [Misc] Add example for LLaVA-NeXT (#5879) · b9e84259
  Roger Wang authored Jun 26, 2024
  
  b9e84259
26 Jun, 2024 1 commit
- [Misc][Doc] Add Example of using OpenAI Server with VLM (#5832) · 3aa7b6cf
  Roger Wang authored Jun 25, 2024
  
  3aa7b6cf
21 Jun, 2024 1 commit

[Model] MLPSpeculator speculative decoding support (#4947) · b12518d3

Joshua Rosenkranz authored Jun 20, 2024


Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Davis Wertheimer <Davis.Wertheimer@ibm.com>

b12518d3

20 Jun, 2024 1 commit
- [Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718) · 8065a7e2
  Michael Goin authored Jun 20, 2024
  
  8065a7e2
19 Jun, 2024 1 commit
- [Bugfix] Fix sampling_params passed incorrectly in Phi3v example (#5684) · 7d46c8d3
  Isotr0py authored Jun 19, 2024
  
  7d46c8d3