Commits · dfb1a15dcb4c24bf7ff0ba7ddfc5d623ad519d7d · OpenDAS / vllm_cscc · GitLab

05 Aug, 2024 1 commit
- [ci][frontend] deduplicate tests (#7101) · dfb1a15d
  youkaichao authored Aug 05, 2024
  
  dfb1a15d
04 Aug, 2024 1 commit
- Support for guided decoding for offline LLM (#6878) · 654bc5ca
  Yihuan Bu authored Aug 03, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  654bc5ca
03 Aug, 2024 1 commit

[ Frontend ] Multiprocessing for OpenAI Server with `zeromq` (#6883) · ed812a73

Robert Shaw authored Aug 02, 2024


Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

ed812a73

02 Aug, 2024 1 commit
- [ci] set timeout for test_oot_registration.py (#7082) · 80694951
  youkaichao authored Aug 02, 2024
  
  80694951
01 Aug, 2024 1 commit
- [Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user (#6954) · 3c10591e
  zifeitong authored Jul 31, 2024
  
  3c10591e
29 Jul, 2024 1 commit
- [Frontend] New `allowed_token_ids` decoding request parameter (#6753) · 9f69d824
  Nick Hill authored Jul 29, 2024
  
  9f69d824
25 Jul, 2024 2 commits
- [Bugfix] Fix encoding_format in examples/openai_embedding_client.py (#6755) · 316a41ac
  Chang Su authored Jul 24, 2024
  
  316a41ac
- [Frontend] Represent tokens with identifiable strings (#6626) · 5689e256
  Evan Z. Liu authored Jul 24, 2024
  
  5689e256
23 Jul, 2024 2 commits
- [Frontend] Add Usage data in each chunk for chat_serving. #6540 (#6652) · 58f53034
  Yehoshua Cohen authored Jul 23, 2024
  
  58f53034
- [Misc] Manage HTTP connections in one place (#6600) · 97234be0
  Cyrus Leung authored Jul 23, 2024
  
  97234be0
22 Jul, 2024 1 commit
- [Frontend] Refactor prompt processing (#4028) · 739b61a3
  Cyrus Leung authored Jul 23, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  739b61a3
19 Jul, 2024 1 commit
- [Bugfix][Frontend] Fix missing `/metrics` endpoint (#6463) · 6366efc6
  Cyrus Leung authored Jul 19, 2024
  
  6366efc6
18 Jul, 2024 1 commit
- [BugFix][Frontend] Use LoRA tokenizer in OpenAI APIs (#6227) · e2fbaee7
  Nick Hill authored Jul 18, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e2fbaee7
17 Jul, 2024 1 commit
- [Doc][CI/Build] Update docs and tests to use `vllm serve` (#6431) · 5bf35a91
  Cyrus Leung authored Jul 17, 2024
  
  5bf35a91
16 Jul, 2024 2 commits
- [Frontend] Support for chat completions input in the tokenize endpoint (#5923) · 7a3d2a5b
  sasha0552 authored Jul 16, 2024
  
  7a3d2a5b
- [Bugfix][CI/Build] Test prompt adapters in openai entrypoint tests (#6419) · d92b3c5c
  Joe authored Jul 15, 2024
  
  d92b3c5c
15 Jul, 2024 1 commit
- [BugFix] BatchResponseData body should be optional (#6345) · b47008b4
  zifeitong authored Jul 14, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b47008b4
13 Jul, 2024 1 commit

[ci] try to add multi-node tests (#6280) · 41708e50

youkaichao authored Jul 12, 2024


Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

41708e50

12 Jul, 2024 1 commit
- [Misc] add fixture to guided processor tests (#6341) · b039cbbc
  Yihuan Bu authored Jul 12, 2024
  
  b039cbbc
05 Jul, 2024 1 commit
- [Frontend] Continuous usage stats in OpenAI completion API (#5742) · f1e15da6
  jvlunteren authored Jul 05, 2024
  
  f1e15da6
03 Jul, 2024 2 commits
- [vlm] Remove vision language config. (#6089) · d9e98f42
  xwjiang2010 authored Jul 03, 2024
```
Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  d9e98f42
- [CI] Fix base url doesn't strip "/" (#6087) · d18bab35
  SangBin Cho authored Jul 03, 2024
  
  d18bab35
02 Jul, 2024 2 commits

[Core] Pipeline Parallel Support (#4412) · c5832d2a
Murali Andoorveedu authored Jul 02, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
c5832d2a

[VLM] Remove `image_input_type` from VLM config (#5852) · 98d6682c

xwjiang2010 authored Jul 02, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

98d6682c

30 Jun, 2024 2 commits
- [Frontend]: Support base64 embedding (#5935) · c6c240aa
  llmpros authored Jun 30, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  c6c240aa
- [CI/Build] [3/3] Reorganize entrypoints tests (#5966) · 9d47f64e
  Cyrus Leung authored Jun 30, 2024
  
  9d47f64e
29 Jun, 2024 1 commit
- [Bugfix][CI/Build][Hardware][AMD] Install matching torchvision to fix AMD tests (#5949) · 9def1066
  Matt Wong authored Jun 29, 2024
  
  9def1066
28 Jun, 2024 1 commit
- [CI/Build] [2/3] Reorganize entrypoints tests (#5904) · 3b752a65
  Cyrus Leung authored Jun 28, 2024
  
  3b752a65
27 Jun, 2024 1 commit
- [CI/Build] [1/3] Reorganize entrypoints tests (#5526) · e9d32d07
  Cyrus Leung authored Jun 27, 2024
  
  e9d32d07
26 Jun, 2024 1 commit
- [Frontend] Add tokenize/detokenize endpoints (#5054) · c54269d9
  sasha0552 authored Jun 26, 2024
  
  c54269d9
25 Jun, 2024 1 commit
- [Hardware][AMD][CI/Build][Doc] Upgrade to ROCm 6.1, Dockerfile improvements, test fixes (#5422) · dd793d1d
  Matt Wong authored Jun 25, 2024
  
  dd793d1d
15 Jun, 2024 2 commits
- [CI/Build] Test both text and token IDs in batched OpenAI Completions API (#5568) · 81fbb365
  Cyrus Leung authored Jun 15, 2024
  
  81fbb365
- [mypy] Enable type checking for test directory (#5017) · 0e9164b4
  Cyrus Leung authored Jun 15, 2024
  
  0e9164b4
13 Jun, 2024 1 commit
- [CI/Build] Simplify OpenAI server setup in tests (#5100) · 39873476
  Cyrus Leung authored Jun 14, 2024
  
  39873476
11 Jun, 2024 2 commits
- [Bugfix][Frontend] Cleanup "fix chat logprobs" (#5026) · 640052b0
  Cyrus Leung authored Jun 11, 2024
  
  640052b0
- [Bugfix] OpenAI entrypoint limits logprobs while ignoring server defined --max-logprobs (#5312) · 351d5e7b
  maor-ps authored Jun 11, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  351d5e7b
10 Jun, 2024 1 commit
- [Feature][Frontend]: Continued `stream_options` implementation also in CompletionRequest (#5319) · 774d1035
  Itay Etelis authored Jun 10, 2024
  
  774d1035
07 Jun, 2024 2 commits
- [Frontend] Add OpenAI Vision API Support (#5237) · 7a9cb294
  Roger Wang authored Jun 07, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7a9cb294
- [Feature][Frontend]: Add support for `stream_options` in `ChatCompletionRequest` (#5135) · baa15a9e
  Itay Etelis authored Jun 07, 2024
  
  baa15a9e
06 Jun, 2024 1 commit
- [Frontend] enable passing multiple LoRA adapters at once to generate() (#5300) · 828da0d4
  Matthew Goldey authored Jun 06, 2024
  
  828da0d4