Commits · 6ccc0bfffbcf1b7e927cc3dcf4159fc74ff94d40 · norm / vllm

08 Dec, 2023 2 commits

Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836) · 6ccc0bff

TJian authored Dec 08, 2023


Co-authored-by: Philipp Moritz <pcmoritz@gmail.com>
Co-authored-by: Amir Balwel <amoooori04@gmail.com>
Co-authored-by: root <kuanfu.liu@akirakan.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kuanfu <kuanfu.liu@embeddedllm.com>
Co-authored-by: miloice <17350011+kliuae@users.noreply.github.com>

6ccc0bff

fix typo in getenv call (#1972) · c8e7eb1e
Daya Khudia authored Dec 07, 2023

c8e7eb1e

07 Dec, 2023 3 commits
- [Docker] Adding number of nvcc_threads during build as envar (#1893) · 24f60a54
  AguirreNicolas authored Dec 07, 2023
  
  24f60a54
- Fix quickstart.rst typo jinja (#1964) · 42c02f58
  gottlike authored Dec 07, 2023
  
  42c02f58
- Make InternLM follow `rope_scaling` in `config.json` (#1956) · ebede26e
  Jie Li authored Dec 08, 2023
```
Co-authored-by: lijie8 <lijie8@sensetime.com>
```
  ebede26e
06 Dec, 2023 2 commits
- Fix typo in adding_model.rst (#1947) · d940ce49
  Peter Götz authored Dec 06, 2023
```
adpated -> adapted
```
  d940ce49
- Save pytorch profiler output for latency benchmark (#1871) · 05ff90b6
  Antoni Baum authored Dec 05, 2023
```
* Save profiler output

* Apply feedback from code review
```
  05ff90b6
05 Dec, 2023 1 commit
- Support ChatGLMForConditionalGeneration (#1932) · 1d9b737e
  dancingpipi authored Dec 06, 2023
```
Co-authored-by: shujunhua1 <shujunhua1@jd.com>
```
  1d9b737e
03 Dec, 2023 8 commits
- add custom server params (#1868) · 60dc62dc
  Roy authored Dec 04, 2023
  
  60dc62dc
- Bump up to v0.2.3 (#1903) · 0f90effc
  Woosuk Kwon authored Dec 03, 2023
  
  0f90effc
- Fix num_gpus when TP > 1 (#1852) · 464dd985
  Woosuk Kwon authored Dec 03, 2023
  
  464dd985
- chore(examples-docs): upgrade to OpenAI V1 (#1785) · c07a4428
  Massimiliano Pronesti authored Dec 03, 2023
  
  c07a4428
- Fix broken worker test (#1900) · cd3aa153
  Woosuk Kwon authored Dec 02, 2023
  
  cd3aa153
- Add PyTorch-native implementation of custom layers (#1898) · 9b294976
  Woosuk Kwon authored Dec 02, 2023
  
  9b294976
- Add Production Metrics in Prometheus format (#1890) · 5313c2cb
  Simon Mo authored Dec 02, 2023
  
  5313c2cb
- Fix broken sampler tests (#1896) · 5f09cbdb
  Woosuk Kwon authored Dec 02, 2023
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  5f09cbdb
02 Dec, 2023 1 commit
- [Docs] Update the AWQ documentation to highlight performance issue (#1883) · 4cefa9b4
  Simon Mo authored Dec 02, 2023
  
  4cefa9b4
01 Dec, 2023 4 commits
- Fix the typo in SamplingParams' docstring (#1886) · f86bd619
  Jerry authored Dec 01, 2023
  
  f86bd619
- Normalize head weights for Baichuan 2 (#1876) · e5452ddf
  Woosuk Kwon authored Nov 30, 2023
  
  e5452ddf
- Fix Baichuan tokenizer error (#1874) · d06980df
  Woosuk Kwon authored Nov 30, 2023
  
  d06980df
- Support chat template and `echo` for chat API (#1756) · 66785cc0
  Adam Brusselback authored Nov 30, 2023
  
  66785cc0
30 Nov, 2023 10 commits
- docs: add instruction for langchain (#1162) · 05a38612
  Massimiliano Pronesti authored Nov 30, 2023
  
  05a38612
- Fix rope cache key error (#1867) · d27f4bae
  Roy authored Dec 01, 2023
  
  d27f4bae
- Support max-model-len argument for throughput benchmark (#1858) · 8d8c2f6f
  aisensiy authored Dec 01, 2023
  
  8d8c2f6f
- Remove max_num_seqs in latency benchmark script (#1855) · 51d3cb95
  Woosuk Kwon authored Nov 30, 2023
  
  51d3cb95
- Add profile option to latency benchmark script (#1839) · e74b1736
  Woosuk Kwon authored Nov 29, 2023
  
  e74b1736
- [FIX] Fix docker build error (#1831) (#1832) · f07c1cea
  Allen authored Nov 30, 2023
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  f07c1cea
- Avoid multiple instantiations of the RoPE class (#1828) · 63b2206a
  Jee Li authored Nov 30, 2023
  
  63b2206a
- Refactor Worker & InputMetadata (#1843) · 27feead2
  Woosuk Kwon authored Nov 29, 2023
  
  27feead2
- Disable Logs Requests should Disable Logging of requests. (#1779) · c7821956
  Michael McCulloch authored Nov 29, 2023
```
Co-authored-by: Michael McCulloch <mjm.gitlab@fastmail.com>
```
  c7821956
- [Docs] Add information about using shared memory in docker (#1845) · 0f621c2c
  Simon Mo authored Nov 29, 2023
  
  0f621c2c
29 Nov, 2023 6 commits
- Refactor Attention (#1840) · a9e45742
  Woosuk Kwon authored Nov 29, 2023
  
  a9e45742
- Better integration with Ray Serve (#1821) · 0229c386
  FlorianJoncour authored Nov 29, 2023
```
Co-authored-by: FlorianJoncour <florian@zetta-sys.com>
```
  0229c386
- [Fix] Fix RoPE in ChatGLM-32K (#1841) · a7b3e330
  Woosuk Kwon authored Nov 29, 2023
  
  a7b3e330
- [FIX] Fix formatting error in main branch (#1822) · e19a64c7
  Zhuohan Li authored Nov 28, 2023
  
  e19a64c7
- [FIX] Fix formatting error · 1cb4ad8d
  Zhuohan Li authored Nov 29, 2023
  
  1cb4ad8d
- Use the type BlockTable (#1791) · 6ed068a7
  explainerauthors authored Nov 28, 2023
  
  6ed068a7
28 Nov, 2023 3 commits
- [FIX] Fix class naming (#1803) · 708e6c18
  Zhuohan Li authored Nov 28, 2023
  
  708e6c18
- Fix OPT param names (#1819) · b9438904
  Woosuk Kwon authored Nov 28, 2023
  
  b9438904
- Correct comments in parallel_state.py (#1818) · a1125ad4
  explainerauthors authored Nov 28, 2023
  
  a1125ad4