Commits · 99b471c205010a2b501073a9f1b4cbc6ef4db423 · OpenDAS / vllm_cscc · GitLab

17 Apr, 2024 1 commit
- [Bugfix] fix output parsing error for trtllm backend (#4137) · fe3b5bbc
  Elinx authored Apr 17, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  fe3b5bbc
12 Apr, 2024 1 commit
- [Doc] Add typing hints / mypy types cleanup (#3816) · c2b4a1bc
  Michael Feil authored Apr 11, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  c2b4a1bc
01 Apr, 2024 1 commit
- [Misc] Fix Benchmark TTFT Calculation for Chat Completions (#3768) · ccb58b23
  Roger Wang authored Apr 01, 2024
  
  ccb58b23
27 Mar, 2024 1 commit
- feat(benchmarks): Add Prefix Caching Benchmark to Serving Benchmark (#3277) · 45b6ef65
  Roger Wang authored Mar 27, 2024
  
  45b6ef65
16 Mar, 2024 2 commits
- [Misc] fix line length for entire codebase (#3444) · 8e67598a
  Simon Mo authored Mar 16, 2024
  
  8e67598a
- Replace `lstrip()` with `removeprefix()` to fix Ruff linter warning (#2958) · 14e3f9a1
  Ronen Schaffer authored Mar 16, 2024
  
  14e3f9a1
04 Mar, 2024 1 commit
- Fix the openai benchmarking requests to work with latest OpenAI apis (#2992) · 9a4548ba
  Chen Wang authored Mar 04, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  9a4548ba
13 Feb, 2024 1 commit
- Serving Benchmark Refactoring (#2433) · a4211a4d
  Roger Wang authored Feb 12, 2024
  
  a4211a4d