Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
norm
vllm
Commits
1a7eb7da6157541ed7867c9aff94231695f2cee9
Switch branch/tag
vllm
server.py
10 Mar, 2023
1 commit
Support beam search & parallel generation (#7)
· 1a7eb7da
Woosuk Kwon
authored
Mar 10, 2023
1a7eb7da
06 Mar, 2023
1 commit
Fix a bug in 1D input shape (#5)
· 04e5acc0
Woosuk Kwon
authored
Mar 06, 2023
04e5acc0
02 Mar, 2023
1 commit
Use FlashAttention for `multi_query_kv_attention` (#4)
· 3e9f991d
Woosuk Kwon
authored
Mar 01, 2023
3e9f991d
24 Feb, 2023
2 commits
Clean up the server script
· fa16389a
Woosuk Kwon
authored
Feb 24, 2023
fa16389a
[WIP] Add server script
· afdbe5d3
Woosuk Kwon
authored
Feb 24, 2023
afdbe5d3