Commits · d06980dfa7e8dcc1738656beb46d3735c86faa21 · norm / vllm · GitLab

01 Dec, 2023 2 commits
- Fix Baichuan tokenizer error (#1874) · d06980df
  Woosuk Kwon authored Nov 30, 2023
  
  d06980df
- Support chat template and `echo` for chat API (#1756) · 66785cc0
  Adam Brusselback authored Nov 30, 2023
  
  66785cc0
30 Nov, 2023 10 commits
- docs: add instruction for langchain (#1162) · 05a38612
  Massimiliano Pronesti authored Nov 30, 2023
  
  05a38612
- Fix rope cache key error (#1867) · d27f4bae
  Roy authored Dec 01, 2023
  
  d27f4bae
- Support max-model-len argument for throughput benchmark (#1858) · 8d8c2f6f
  aisensiy authored Dec 01, 2023
  
  8d8c2f6f
- Remove max_num_seqs in latency benchmark script (#1855) · 51d3cb95
  Woosuk Kwon authored Nov 30, 2023
  
  51d3cb95
- Add profile option to latency benchmark script (#1839) · e74b1736
  Woosuk Kwon authored Nov 29, 2023
  
  e74b1736
- [FIX] Fix docker build error (#1831) (#1832) · f07c1cea
  Allen authored Nov 30, 2023
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  f07c1cea
- Avoid multiple instantiations of the RoPE class (#1828) · 63b2206a
  Jee Li authored Nov 30, 2023
  
  63b2206a
- Refactor Worker & InputMetadata (#1843) · 27feead2
  Woosuk Kwon authored Nov 29, 2023
  
  27feead2
- Disable Logs Requests should Disable Logging of requests. (#1779) · c7821956
  Michael McCulloch authored Nov 29, 2023
```
Co-authored-by: Michael McCulloch <mjm.gitlab@fastmail.com>
```
  c7821956
- [Docs] Add information about using shared memory in docker (#1845) · 0f621c2c
  Simon Mo authored Nov 29, 2023
  
  0f621c2c
29 Nov, 2023 6 commits
- Refactor Attention (#1840) · a9e45742
  Woosuk Kwon authored Nov 29, 2023
  
  a9e45742
- Better integration with Ray Serve (#1821) · 0229c386
  FlorianJoncour authored Nov 29, 2023
```
Co-authored-by: FlorianJoncour <florian@zetta-sys.com>
```
  0229c386
- [Fix] Fix RoPE in ChatGLM-32K (#1841) · a7b3e330
  Woosuk Kwon authored Nov 29, 2023
  
  a7b3e330
- [FIX] Fix formatting error in main branch (#1822) · e19a64c7
  Zhuohan Li authored Nov 28, 2023
  
  e19a64c7
- [FIX] Fix formatting error · 1cb4ad8d
  Zhuohan Li authored Nov 29, 2023
  
  1cb4ad8d
- Use the type BlockTable (#1791) · 6ed068a7
  explainerauthors authored Nov 28, 2023
  
  6ed068a7
28 Nov, 2023 3 commits
- [FIX] Fix class naming (#1803) · 708e6c18
  Zhuohan Li authored Nov 28, 2023
  
  708e6c18
- Fix OPT param names (#1819) · b9438904
  Woosuk Kwon authored Nov 28, 2023
  
  b9438904
- Correct comments in parallel_state.py (#1818) · a1125ad4
  explainerauthors authored Nov 28, 2023
  
  a1125ad4
27 Nov, 2023 2 commits
- Init model on GPU to reduce CPU memory footprint (#1796) · a8b150c5
  ljss authored Nov 28, 2023
  
  a8b150c5
- Added echo function to OpenAI API server. (#1504) · 665cbcec
  Yunmo Chen authored Nov 27, 2023
  
  665cbcec
24 Nov, 2023 2 commits
- Fix model docstrings (#1764) · 7c600440
  Woosuk Kwon authored Nov 23, 2023
  
  7c600440
- [Build] Avoid building too many extensions (#1624) · e0c6f556
  Yanming W authored Nov 23, 2023
  
  e0c6f556
22 Nov, 2023 4 commits
- Fix repetition penalty aligned with huggingface (#1577) · de23687d
  ljss authored Nov 23, 2023
  
  de23687d
- Set top_p=0 and top_k=-1 in greedy sampling (#1748) · 4cea74c7
  ljss authored Nov 23, 2023
  
  4cea74c7
- [DOCS] Add engine args documentation (#1741) · a921d8be
  Casper authored Nov 22, 2023
  
  a921d8be
- Add stop_token_ids in SamplingParams.__repr__ (#1745) · 094f716b
  陈序 authored Nov 22, 2023
  
  094f716b
21 Nov, 2023 6 commits
- [FIX] Fix the case when `input_is_parallel=False` for `ScaledActivation` (#1737) · 7d761fe3
  Zhuohan Li authored Nov 20, 2023
  
  7d761fe3
- [BugFix] Fix TP support for AWQ (#1731) · cf35d8f3
  Woosuk Kwon authored Nov 20, 2023
  
  cf35d8f3
- fix RAM OOM when load large models in tensor parallel mode. (#1395) · 4bb6b671
  boydfd authored Nov 21, 2023
```
Co-authored-by: ran_lin <rlin@thoughtworks.com>
```
  4bb6b671
- Rewrite torch.repeat_interleave to remove cpu synchronization (#1599) · 819b18e7
  ljss authored Nov 21, 2023
  
  819b18e7
- [Fix] Fix bugs in scheduler (#1727) · 19849db5
  Zhuofan authored Nov 21, 2023
  
  19849db5
- Fix hanging in the scheduler caused by long prompts (#1534) · 3d4ceb29
  陈序 authored Nov 21, 2023
  
  3d4ceb29
20 Nov, 2023 5 commits
- [BugFix] Fix a bug in loading safetensors (#1732) · f5a37c6c
  Woosuk Kwon authored Nov 20, 2023
  
  f5a37c6c
- [FIX] Update the doc link in README.md (#1730) · 32c927b5
  Zhuohan Li authored Nov 20, 2023
  
  32c927b5
- Migrate linter from `pylint` to `ruff` (#1665) · 5ffc0d13
  Simon Mo authored Nov 20, 2023
  
  5ffc0d13
- [Docs] Fix the code block's format in deploying_with_docker page (#1722) · 112627e8
  Wen Sun authored Nov 20, 2023
  
  112627e8
- Documentation about official docker image (#1709) · 37c1e3c2
  Simon Mo authored Nov 19, 2023
  
  37c1e3c2