Commits · b7ee940a828de9d339345e28eee8b13d60d97f26 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "1fd471e957526a34a0cb4b60d2e830cd6ca79fdc"

15 Jan, 2025 3 commits
- [V1][BugFix] Fix edge case in VLM scheduling (#12065) · b7ee940a
  Woosuk Kwon authored Jan 14, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b7ee940a
- [Platform] move current_memory_usage() into platform (#11369) · 9ddac563
  Shanshan Shen authored Jan 15, 2025
```
Signed-off-by: Shanshan Shen <467638484@qq.com>
```
  9ddac563
- [Kernel] Support MulAndSilu (#11624) · 42f5e7c5
  Jee Jee Li authored Jan 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  42f5e7c5
14 Jan, 2025 7 commits
- [Misc] Merge bitsandbytes_stacked_params_mapping and packed_modules_mapping (#11924) · a3a3ee4e
  Jee Jee Li authored Jan 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a3a3ee4e
- [Doc]: Update the Json Example of the `Engine Arguments` document (#12045) · 87054a57
  maang-h authored Jan 15, 2025
  
  87054a57
- [Bugfix][Kernel] Give unique name to BlockSparseFlashAttention (#12040) · a2d2acb4
  Chen Zhang authored Jan 14, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  a2d2acb4
- [Platform] Add output for Attention Backend (#11981) · 2e0e0176
  wangxiyuan authored Jan 14, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  2e0e0176
- [Kernel] Revert the API change of Attention.forward (#12038) · 1f18adb2
  Chen Zhang authored Jan 14, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  1f18adb2
- [Bugfix] Fix various bugs in multi-modal processor (#12031) · bb354e6b
  Cyrus Leung authored Jan 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bb354e6b
- [HPU][Bugfix] set_forward_context and CI test execution (#12014) · 078da319
  Konrad Zawora authored Jan 14, 2025
```
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
```
  078da319
13 Jan, 2025 12 commits
- [Bugfix] Fix deepseekv3 gate bias error (#12002) · f35ec461
  Steve Luo authored Jan 14, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  f35ec461
- [Platform] Move get_punica_wrapper() function to Platform (#11516) · a7d59688
  Shanshan Shen authored Jan 13, 2025
```
Signed-off-by: Shanshan Shen <467638484@qq.com>
```
  a7d59688
- [platform] add device_control env var (#12009) · 458e63a2
  youkaichao authored Jan 13, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  458e63a2
- [Kernel] unified_attention for Attention.forward (#11967) · 0f8cafe2
  Chen Zhang authored Jan 13, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  0f8cafe2
- Fix Max Token ID for Qwen-VL-Chat (#11980) · 5340a30d
  Alex Brooks authored Jan 13, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
```
  5340a30d
- [platform] add ray_device_key (#11948) · 89ce62a3
  youkaichao authored Jan 13, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  89ce62a3
- [Misc]Minor Changes about Worker (#11555) · c3f05b09
  Chenguang Li authored Jan 13, 2025
```
Signed-off-by: Chenguang Li <757486878@qq.com>
```
  c3f05b09
- [Misc] Fix Deepseek V2 fp8 kv-scale remapping (#11947) · cf6bbcb4
  Concurrensee authored Jan 13, 2025
```
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
```
  cf6bbcb4
- [CI][Spec Decode] fix: broken test for EAGLE model (#11972) · 80ea3af1
  Sungjae Lee authored Jan 13, 2025
```
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
```
  80ea3af1
- [Bug] Fix usage of `.transpose()` and `.view()` consecutively. (#11979) · 9dd02d85
  Siyuan Li authored Jan 13, 2025
  
  9dd02d85
- [V1] [2/n] Logging and Metrics - `OutputProcessor` Abstraction (#11973) · 619ae268
  Robert Shaw authored Jan 12, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
```
  619ae268
- [Model] Support GGUF models newly added in `transformers` 4.46.0 (#9685) · d14e98d9
  Isotr0py authored Jan 13, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d14e98d9
12 Jan, 2025 5 commits
- [V1][Core][1/n] Logging and Metrics (#11962) · 9597a095
  Robert Shaw authored Jan 12, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
```
  9597a095
- [Hardware][TPU] workaround fix for MoE on TPU (#11764) · 263a870e
  Avshalom Manevich authored Jan 12, 2025
  
  263a870e
- [Hardware][CPU] Multi-LoRA implementation for the CPU backend (#11100) · 8bddb735
  Akshat Tripathi authored Jan 12, 2025
```
Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Oleg Mosalov <oleg@krai.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Oleg Mosalov <oleg@krai.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  8bddb735
- [Model] Initialize support for Deepseek-VL2 models (#11578) · f967e51f
  Isotr0py authored Jan 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  f967e51f
- [V1] Avoid sending text prompt to core engine (#11963) · b25cfab9
  Roger Wang authored Jan 11, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  b25cfab9
11 Jan, 2025 5 commits
- [Model] Add cogagent model support vLLM (#11742) · 4b657d32
  sixgod authored Jan 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  4b657d32
- [Bugfix] Fix RobertaModel loading (#11940) · d697dc01
  Nicolò Lucchesi authored Jan 11, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d697dc01
- [Bugfix] fused_experts_impl wrong compute type for float32 (#11921) · c32a7c7c
  shaochangxu authored Jan 11, 2025
```
Signed-off-by: shaochangxu.scx <shaochangxu.scx@antgroup.com>
Co-authored-by: shaochangxu.scx <shaochangxu.scx@antgroup.com>
```
  c32a7c7c
- [Bugfix][SpecDecode] Adjust Eagle model architecture to align with intended design (#11672) · 2118d056
  Sungjae Lee authored Jan 11, 2025
```
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
```
  2118d056
- [mypy] Fix mypy warnings in api_server.py (#11941) · c9f09a4f
  Fred Reiss authored Jan 10, 2025
```
Signed-off-by: Fred Reiss <frreiss@us.ibm.com>
```
  c9f09a4f
10 Jan, 2025 8 commits
- [Bugfix] Check that number of images matches number of <|image|> tokens with mllama (#11939) · d45cbe70
  Travis Johnson authored Jan 10, 2025
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  d45cbe70
- [Misc] Clean up debug code in Deepseek-V3 (#11930) · 46fa98cc
  Isotr0py authored Jan 11, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  46fa98cc
- [Hardware][CPU] Support MOE models on x86 CPU (#11831) · aa1e77a1
  Li, Jiang authored Jan 11, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  aa1e77a1
- [Docs] Fix docstring in `get_ip` function (#11932) · f33e033e
  Kuntai Du authored Jan 10, 2025
```
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  f33e033e
- [platform] support custom torch.compile backend key (#11318) · 20410b2f
  wangxiyuan authored Jan 10, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  20410b2f
- [Doc] [1/N] Initial guide for merged multi-modal processor (#11925) · 12664ddd
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  12664ddd
- Replace "online inference" with "online serving" (#11923) · d85c47d6
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d85c47d6
- [platform] support pytorch custom op pluggable (#11328) · ef725fea
  wangxiyuan authored Jan 10, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  ef725fea