Unverified Commit 4497c8f8 authored by XiongfeiWei's avatar XiongfeiWei Committed by GitHub
Browse files

Fix lora tests failure in TPU CI due to the removal of LoRA bias (#26723)


Signed-off-by: default avatarXiongfei Wei <isaacwxf23@gmail.com>
parent 2e36cdbe
......@@ -2128,12 +2128,11 @@ def replace_set_lora(model):
lora_a: torch.Tensor,
lora_b: torch.Tensor,
embeddings_tensor: torch.Tensor | None,
bias: torch.Tensor | None = None,
):
# TODO: The integer index leads to a recompilation, but converting it
# to a tensor doesn't seem to work anymore. This might be fixed with a
# later release of torch_xla.
self._original_set_lora(index, lora_a, lora_b, embeddings_tensor, bias)
self._original_set_lora(index, lora_a, lora_b, embeddings_tensor)
torch_xla.sync(wait=False)
def _tpu_reset_lora(self, index: int):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment