Commits · f205c09854853172a446c92aa81eb7199da324ab · OpenDAS / vllm_cscc

29 Aug, 2024 1 commit
- [Bugfix] Unify rank computation across regular decoding and speculative decoding (#7899) · f205c098
  Jonas M. Kübler authored Aug 29, 2024
  
  f205c098
25 Aug, 2024 1 commit
- [Spec Decoding] Streamline batch expansion tensor manipulation (#7851) · 1856aff4
  Nick Hill authored Aug 25, 2024
  
  1856aff4
01 Jul, 2024 1 commit
- [Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker (#5348) · 80ca1e6a
  sroy745 authored Jul 01, 2024
  
  80ca1e6a
21 Jun, 2024 1 commit

[Model] MLPSpeculator speculative decoding support (#4947) · b12518d3

Joshua Rosenkranz authored Jun 20, 2024


Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Davis Wertheimer <Davis.Wertheimer@ibm.com>

b12518d3

25 Mar, 2024 1 commit
- [CI] Try introducing isort. (#3495) · 01bfb22b
  SangBin Cho authored Mar 25, 2024
  
  01bfb22b
09 Mar, 2024 1 commit
- [Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103) · 8437bae6
  Cade Daniel authored Mar 08, 2024
  
  8437bae6