Commits · eeceadaecc80cc51c4e9ddae0cb99a33d379452d · OpenDAS / vllm_cscc · GitLab

13 Jul, 2024 7 commits
- [Misc] Add deprecation warning for beam search (#6402) · eeceadae
  Woosuk Kwon authored Jul 13, 2024
  
  eeceadae
- [ Misc ] More Cleanup of Marlin (#6359) · babf52da
  Robert Shaw authored Jul 13, 2024
```
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
```
  babf52da
- Updating LM Format Enforcer version to v10.3 (#6411) · 9da4aad4
  Noam Gat authored Jul 13, 2024
  
  9da4aad4
- [ci] try to add multi-node tests (#6280) · 41708e50
  youkaichao authored Jul 12, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  41708e50
- [Docs] Clean up latest news (#6401) · d80aef37
  Woosuk Kwon authored Jul 12, 2024
  
  d80aef37
- [Bugfix] Fix hard-coded value of x in context_attention_fwd (#6373) · e1684a76
  Thomas Parnell authored Jul 13, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  e1684a76
- [Doc] Fix Typo in Doc (#6392) · a27f87da
  Saliya Ekanayake authored Jul 12, 2024
```
Co-authored-by: Saliya Ekanayake <esaliya@d-matrix.ai>
```
  a27f87da
12 Jul, 2024 24 commits
- [ci] Fix wording for GH bot (#6398) · 16ff6bd5
  Kevin H. Luu authored Jul 12, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  16ff6bd5
- [Bugfix][TPU] Fix megacore setting for v5e-litepod (#6397) · f8f9ff57
  Woosuk Kwon authored Jul 12, 2024
  
  f8f9ff57
- Fix release pipeline's dir permission (#6391) · 6bc9710f
  Simon Mo authored Jul 12, 2024
  
  6bc9710f
- [Misc] Add generated git commit hash as `vllm.__commit__` (#6386) · 111fc6e7
  Michael Goin authored Jul 12, 2024
  
  111fc6e7
- [Bugfix] Fix illegal memory access in FP8 MoE kernel (#6382) · 75f64d8b
  Cody Yu authored Jul 12, 2024
  
  75f64d8b
- Fix release pipeline's -e flag (#6390) · 21b2dced
  Simon Mo authored Jul 12, 2024
  
  21b2dced
- Fix interpolation in release pipeline (#6389) · 07b35af8
  Simon Mo authored Jul 12, 2024
  
  07b35af8
- Fix release-pipeline.yaml (#6388) · bb1a784b
  Simon Mo authored Jul 12, 2024
  
  bb1a784b
- Build some nightly wheels by default (#6380) · d719ba24
  Simon Mo authored Jul 12, 2024
  
  d719ba24
- [MISC] Upgrade dependency to PyTorch 2.3.1 (#5327) · aa48e502
  Cody Yu authored Jul 12, 2024
  
  aa48e502
- [ci] Add GHA workflows to enable full CI run (#6381) · 4dbebd03
  Kevin H. Luu authored Jul 12, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  4dbebd03
- [ci] Add grouped tests & mark tests to run by default for fastcheck pipeline (#6365) · b75bce10
  Kevin H. Luu authored Jul 12, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  b75bce10
- [Misc] add fixture to guided processor tests (#6341) · b039cbbc
  Yihuan Bu authored Jul 12, 2024
  
  b039cbbc
- [Build/CI] Checking/Waiting for the GPU's clean state (#6379) · f9d25c25
  Alexei-V-Ivanov-AMD authored Jul 12, 2024
  
  f9d25c25
- [Bugfix] Fix dtype mismatch in PaliGemma (#6367) · 024ad87c
  Cyrus Leung authored Jul 12, 2024
  
  024ad87c
- [ Misc ] Support Models With Bias in `compressed-tensors` integration (#6356) · aea19f09
  Robert Shaw authored Jul 12, 2024
  
  aea19f09
- [Misc][Bugfix] Update transformers for tokenizer issue (#6364) · f7160d94
  Roger Wang authored Jul 12, 2024
  
  f7160d94
- [ Misc ] Remove separate bias add (#6353) · 6047187c
  Robert Shaw authored Jul 12, 2024
  
  6047187c
- [ROCm][AMD] unify CUDA_VISIBLE_DEVICES usage in cuda/rocm (#6352) · b6c16cf8
  Hongxia Yang authored Jul 12, 2024
  
  b6c16cf8
- [CI/Build] (2/2) Switching AMD CI to store images in Docker Hub (#6350) · d26a8b3f
  adityagoel14 authored Jul 12, 2024
  
  d26a8b3f
- [Model][Phi3-Small] Remove scipy from blocksparse_attention (#6343) · d59eb984
  Michael Goin authored Jul 11, 2024
  
  d59eb984
- [Bugfix] Fix usage stats logging exception warning with OpenVINO (#6349) · adf32e0a
  Helena Kloosterman authored Jul 12, 2024
  
  adf32e0a
- [distributed][misc] be consistent with pytorch for libcudart.so (#6346) · 2b0fb534
  youkaichao authored Jul 11, 2024
```
[distributed][misc] keep consistent with how pytorch finds libcudart.so (#6346)
```
  2b0fb534
- [Misc] Remove flashinfer warning, add flashinfer tests to CI (#6351) · d6ab5289
  Lily Liu authored Jul 11, 2024
  
  d6ab5289
11 Jul, 2024 9 commits
- [ BugFix ] Prompt Logprobs Detokenization (#6223) · 7ed6a4f0
  Robert Shaw authored Jul 11, 2024
```
Co-authored-by: Zifei Tong <zifeitong@gmail.com>
```
  7ed6a4f0
- [CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362) · a4feba92
  Kuntai Du authored Jul 11, 2024
  
  a4feba92
- [doc] update pipeline parallel in readme (#6347) · 2d23b42d
  youkaichao authored Jul 11, 2024
  
  2d23b42d
- [bug fix] Fix llava next feature size calculation. (#6339) · 1df43de9
  xwjiang2010 authored Jul 11, 2024
```
Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
```
  1df43de9
- Benchmark: add H100 suite (#6047) · 52b7fcb3
  Simon Mo authored Jul 11, 2024
  
  52b7fcb3
- [ Misc ] Refactor Marlin Python Utilities (#6082) · b675069d
  Robert Shaw authored Jul 11, 2024
```
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
```
  b675069d
- [BugFix] get_and_reset only when scheduler outputs are not empty (#6266) · 55f692b4
  Mor Zusman authored Jul 11, 2024
  
  55f692b4
- [Bugfix] GPTBigCodeForCausalLM: Remove lm_head from supported_lora_modules. (#6326) · 8a1415cf
  Thomas Parnell authored Jul 11, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  8a1415cf
- [BugFix]: fix engine timeout due to request abort (#6255) · 546b101f
  pushan authored Jul 11, 2024
```
Signed-off-by: yatta zhang <ytzhang01@foxmail.com>
Signed-off-by: zhangyuntao.dev <zhangyuntao.dev@bytedance.com>
Co-authored-by: zhangyuntao.dev <zhangyuntao.dev@bytedance.com>
```
  546b101f