Commits · 88407532e7ec2dd3313f6cb3a31d8dd1fa868178 · OpenDAS / vllm_cscc · GitLab

13 Jun, 2024 1 commit
- [Bugfix]if the content is started with ":"(response of ping), client should i… (#5303) · 88407532
  Wang, Yi authored Jun 13, 2024
```
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  88407532
25 May, 2024 1 commit
- [Misc] Make Serving Benchmark More User-friendly (#5044) · f17a1a8f
  Roger Wang authored May 25, 2024
  
  f17a1a8f
17 Apr, 2024 1 commit
- [Bugfix] fix output parsing error for trtllm backend (#4137) · fe3b5bbc
  Elinx authored Apr 17, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  fe3b5bbc
12 Apr, 2024 1 commit
- [Doc] Add typing hints / mypy types cleanup (#3816) · c2b4a1bc
  Michael Feil authored Apr 11, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  c2b4a1bc
01 Apr, 2024 1 commit
- [Misc] Fix Benchmark TTFT Calculation for Chat Completions (#3768) · ccb58b23
  Roger Wang authored Apr 01, 2024
  
  ccb58b23
27 Mar, 2024 1 commit
- feat(benchmarks): Add Prefix Caching Benchmark to Serving Benchmark (#3277) · 45b6ef65
  Roger Wang authored Mar 27, 2024
  
  45b6ef65
16 Mar, 2024 2 commits
- [Misc] fix line length for entire codebase (#3444) · 8e67598a
  Simon Mo authored Mar 16, 2024
  
  8e67598a
- Replace `lstrip()` with `removeprefix()` to fix Ruff linter warning (#2958) · 14e3f9a1
  Ronen Schaffer authored Mar 16, 2024
  
  14e3f9a1
04 Mar, 2024 1 commit
- Fix the openai benchmarking requests to work with latest OpenAI apis (#2992) · 9a4548ba
  Chen Wang authored Mar 04, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  9a4548ba
13 Feb, 2024 1 commit
- Serving Benchmark Refactoring (#2433) · a4211a4d
  Roger Wang authored Feb 12, 2024
  
  a4211a4d