Commits · c3442c1f6fabe54adb82d2d676920c5f31b9834e · kecinstone / 2024pra-vllm

"examples/llm_engine_example.py" did not exist on "c3442c1f6fabe54adb82d2d676920c5f31b9834e"

20 May, 2023 2 commits
- Refactor system architecture (#109) · c3442c1f
  Woosuk Kwon authored May 20, 2023
  
  c3442c1f
- Remove unused parts in Megatron-LM code and add copyright notice (#110) · 7297fa6f
  Zhuohan Li authored May 20, 2023
  
  7297fa6f
19 May, 2023 1 commit
- Use runtime profiling to replace manual memory analyzers (#81) · f756799b
  Zhuohan Li authored May 19, 2023
  
  f756799b
15 May, 2023 3 commits
- Add docstrings to some modules and classes (#100) · b322fd16
  Woosuk Kwon authored May 14, 2023
  
  b322fd16
- Add copyright headers to source files adapted from FT (#104) · 667ba399
  Woosuk Kwon authored May 14, 2023
  
  667ba399
- Add copyright headers for HF models (#103) · 707ec647
  Woosuk Kwon authored May 14, 2023
  
  707ec647
11 May, 2023 2 commits
- Enhance SamplingParams (#96) · 42f1042e
  Woosuk Kwon authored May 11, 2023
  
  42f1042e
- Implement presence and frequency penalties (#95) · 55f8b0a5
  Woosuk Kwon authored May 10, 2023
  
  55f8b0a5
10 May, 2023 2 commits
- Support top-k sampling (#94) · 9f88db35
  Woosuk Kwon authored May 10, 2023
  
  9f88db35
- Avoid sorting waiting queue & Minor code cleaning (#93) · ae356774
  Woosuk Kwon authored May 10, 2023
  
  ae356774
09 May, 2023 2 commits
- Enhance model loader (#83) · add055e1
  Woosuk Kwon authored May 09, 2023
  
  add055e1
- Refactor system architecture (#82) · 7c041ab5
  Woosuk Kwon authored May 09, 2023
  
  7c041ab5