Commits · 705f6a35aa92800b9c69c8b346168c3055fdebbd · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "d9c7db18da98acff14f01edec69f3090b953e21b"

15 Jul, 2024 11 commits
- [misc][distributed] fix pp missing layer condition (#6446) · 4cf256ae
  youkaichao authored Jul 15, 2024
  
  4cf256ae
- bump version to v0.5.2 (#6433) · 64fdc08c
  Simon Mo authored Jul 15, 2024
  
  64fdc08c
- [Bugfix] use float32 precision in samplers/test_logprobs.py for comparing with HF (#6409) · 4ef95b0f
  Thomas Parnell authored Jul 15, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  4ef95b0f
- [Bugfix] Add custom Triton cache manager to resolve MoE MP issue (#6140) · eaec4b91
  Thomas Parnell authored Jul 15, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Chih-Chieh-Yang <chih.chieh.yang@ibm.com>
```
  eaec4b91
- [Kernel] Use CUTLASS kernels for the FP8 layers with Bias (#6270) · c8fd97f2
  Tyler Michael Smith authored Jul 15, 2024
  
  c8fd97f2
- [VLM] Minor space optimization for `ClipVisionModel` (#6436) · 6ae1597d
  Roger Wang authored Jul 15, 2024
  
  6ae1597d
- [Bugfix] Convert image to RGB by default (#6430) · de199163
  Cyrus Leung authored Jul 15, 2024
  
  de199163
- [core][distributed] simplify code to support pipeline parallel (#6406) · 69672f11
  youkaichao authored Jul 14, 2024
  
  69672f11
- [Doc] add env docs for flashinfer backend (#6437) · 44874a0b
  DefTruth authored Jul 15, 2024
  
  44874a0b
- [BugFix] BatchResponseData body should be optional (#6345) · b47008b4
  zifeitong authored Jul 14, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b47008b4
- Report usage for beam search (#6404) · 32c9d7f7
  Simon Mo authored Jul 14, 2024
  
  32c9d7f7
14 Jul, 2024 4 commits
- [Feature] vLLM CLI (#5090) · dbfe254e
  Ethan Xu authored Jul 14, 2024
```
Co-authored-by: simon-mo <simon.mo@hey.com>
```
  dbfe254e
- [ Misc ] Enable Quantizing All Layers of DeekSeekv2 (#6423) · 73030b7d
  Robert Shaw authored Jul 14, 2024
  
  73030b7d
- [Model] Initialize Fuyu-8B support (#3924) · 540c0368
  Isotr0py authored Jul 14, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  540c0368
- [ Misc ] Apply MoE Refactor to Deepseekv2 To Support Fp8 (#6417) · fb6af8bc
  Robert Shaw authored Jul 13, 2024
  
  fb6af8bc
13 Jul, 2024 4 commits
- [Misc] Add deprecation warning for beam search (#6402) · eeceadae
  Woosuk Kwon authored Jul 13, 2024
  
  eeceadae
- [ Misc ] More Cleanup of Marlin (#6359) · babf52da
  Robert Shaw authored Jul 13, 2024
```
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
```
  babf52da
- [ci] try to add multi-node tests (#6280) · 41708e50
  youkaichao authored Jul 12, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  41708e50
- [Bugfix] Fix hard-coded value of x in context_attention_fwd (#6373) · e1684a76
  Thomas Parnell authored Jul 13, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  e1684a76
12 Jul, 2024 12 commits
- [Bugfix][TPU] Fix megacore setting for v5e-litepod (#6397) · f8f9ff57
  Woosuk Kwon authored Jul 12, 2024
  
  f8f9ff57
- [Misc] Add generated git commit hash as `vllm.__commit__` (#6386) · 111fc6e7
  Michael Goin authored Jul 12, 2024
  
  111fc6e7
- [Bugfix] Fix illegal memory access in FP8 MoE kernel (#6382) · 75f64d8b
  Cody Yu authored Jul 12, 2024
  
  75f64d8b
- [Bugfix] Fix dtype mismatch in PaliGemma (#6367) · 024ad87c
  Cyrus Leung authored Jul 12, 2024
  
  024ad87c
- [ Misc ] Support Models With Bias in `compressed-tensors` integration (#6356) · aea19f09
  Robert Shaw authored Jul 12, 2024
  
  aea19f09
- [ Misc ] Remove separate bias add (#6353) · 6047187c
  Robert Shaw authored Jul 12, 2024
  
  6047187c
- [ROCm][AMD] unify CUDA_VISIBLE_DEVICES usage in cuda/rocm (#6352) · b6c16cf8
  Hongxia Yang authored Jul 12, 2024
  
  b6c16cf8
- [Model][Phi3-Small] Remove scipy from blocksparse_attention (#6343) · d59eb984
  Michael Goin authored Jul 11, 2024
  
  d59eb984
- [Bugfix] Fix usage stats logging exception warning with OpenVINO (#6349) · adf32e0a
  Helena Kloosterman authored Jul 12, 2024
  
  adf32e0a
- [distributed][misc] be consistent with pytorch for libcudart.so (#6346) · 2b0fb534
  youkaichao authored Jul 11, 2024
```
[distributed][misc] keep consistent with how pytorch finds libcudart.so (#6346)
```
  2b0fb534
- fix bf16 error · bb73b5a6
  zhuwenwen authored Jul 12, 2024
  
  bb73b5a6
- [Misc] Remove flashinfer warning, add flashinfer tests to CI (#6351) · d6ab5289
  Lily Liu authored Jul 11, 2024
  
  d6ab5289
11 Jul, 2024 8 commits
- [ BugFix ] Prompt Logprobs Detokenization (#6223) · 7ed6a4f0
  Robert Shaw authored Jul 11, 2024
```
Co-authored-by: Zifei Tong <zifeitong@gmail.com>
```
  7ed6a4f0
- [bug fix] Fix llava next feature size calculation. (#6339) · 1df43de9
  xwjiang2010 authored Jul 11, 2024
```
Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
```
  1df43de9
- [ Misc ] Refactor Marlin Python Utilities (#6082) · b675069d
  Robert Shaw authored Jul 11, 2024
```
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
```
  b675069d
- [BugFix] get_and_reset only when scheduler outputs are not empty (#6266) · 55f692b4
  Mor Zusman authored Jul 11, 2024
  
  55f692b4
- [Bugfix] GPTBigCodeForCausalLM: Remove lm_head from supported_lora_modules. (#6326) · 8a1415cf
  Thomas Parnell authored Jul 11, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  8a1415cf
- [BugFix]: fix engine timeout due to request abort (#6255) · 546b101f
  pushan authored Jul 11, 2024
```
Signed-off-by: yatta zhang <ytzhang01@foxmail.com>
Signed-off-by: zhangyuntao.dev <zhangyuntao.dev@bytedance.com>
Co-authored-by: zhangyuntao.dev <zhangyuntao.dev@bytedance.com>
```
  546b101f
- [Misc] refactor(config): clean up unused code (#6320) · 3963a533
  aniaan authored Jul 11, 2024
  
  3963a533
- [Doc] Remove comments incorrectly copied from another project (#6286) · 99ded1e1
  daquexian authored Jul 11, 2024
  
  99ded1e1
10 Jul, 2024 1 commit
- [Bugfix][Neuron] Fix soft prompt method error in NeuronExecutor (#6313) · 997df46a
  Woosuk Kwon authored Jul 10, 2024
  
  997df46a