Commits · 67d96c29fba9b72cb4c4edbc26211c208a00ebdd · kecinstone / 2024pra-vllm

"examples/offline_inference_neuron.py" did not exist on "655a5e48df3937bf793add53aa95ce0c992a24c6"

20 Jun, 2023 1 commit
- Use slow tokenizer for open llama models (#168) · 67d96c29
  Woosuk Kwon authored Jun 19, 2023
  
  67d96c29
19 Jun, 2023 1 commit
- [Minor] Fix CompletionOutput.__repr__ (#157) · 7e2a913c
  Woosuk Kwon authored Jun 18, 2023
  
  7e2a913c
18 Jun, 2023 2 commits
- Add comments on swap space (#154) · 3f92038b
  Woosuk Kwon authored Jun 18, 2023
  
  3f92038b
- Reduce GPU memory utilization to make sure OOM doesn't happen (#153) · bf5f121c
  Zhuohan Li authored Jun 18, 2023
  
  bf5f121c
17 Jun, 2023 2 commits
- Add quickstart guide (#148) · bec7b2dc
  Zhuohan Li authored Jun 18, 2023
  
  bec7b2dc
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15