Commits · 07ab160741a486bbef23efbf26aaf2ea8a785ae1 · OpenDAS / vllm_cscc

09 Aug, 2024 1 commit
- [Model][Jamba] Mamba cache single buffer (#6739) · 07ab1607
  Mor Zusman authored Aug 09, 2024
```
Co-authored-by: Mor Zusman <morz@ai21.com>
```
  07ab1607
31 Jul, 2024 1 commit
- [Model] use FusedMoE layer in Jamba (#6935) · 2ee8d3ba
  Avshalom Manevich authored Jul 31, 2024
  
  2ee8d3ba
27 Jul, 2024 1 commit
- [Bugfix][Model] Jamba assertions and no chunked prefill by default for Jamba (#6784) · ed94e4f4
  tomeras91 authored Jul 27, 2024
  
  ed94e4f4
16 Jul, 2024 1 commit
- [BugFix][Model] Jamba - Handle aborted requests, Add tests and fix cleanup bug (#6425) · 9ad32dac
  Mor Zusman authored Jul 16, 2024
```
Co-authored-by: Mor Zusman <morz@ai21.com>
```
  9ad32dac
08 Jul, 2024 1 commit
- [Bugfix] Mamba cache Cuda Graph padding (#6214) · ddc369fb
  tomeras91 authored Jul 08, 2024
  
  ddc369fb
03 Jul, 2024 1 commit
- [Bugfix] Fix `compute_logits` in Jamba (#6093) · 7cd2ebb0
  Roger Wang authored Jul 03, 2024
  
  7cd2ebb0
02 Jul, 2024 1 commit

[Model] Jamba support (#4115) · 9d6a8daa

Mor Zusman authored Jul 03, 2024


Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Erez Schwartz <erezs@ai21.com>
Co-authored-by: Mor Zusman <morz@ai21.com>
Co-authored-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Tomer Asida <tomera@ai21.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

9d6a8daa