Skip to content

GitLab

"git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "520198f56f31eef2fe032562ecf52b21928cb3bf"
Unverified Commit 21da3b24 authored by Yih-Dar's avatar Yih-Dar Committed by GitHub
Browse files

Update expect outputs of `IdeficsProcessorTest.test_tokenizer_padding` (#26779) 



fix
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
parent 7790943c
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 3 deletions
tests/models/idefics/test_processor_idefics.py
View file @ 21da3b24
...@@ -148,10 +148,9 @@ class IdeficsProcessorTest(TestCasePlus): ...@@ -148,10 +148,9 @@ class IdeficsProcessorTest(TestCasePlus):
processor = IdeficsProcessor(tokenizer=tokenizer, image_processor=image_processor) processor = IdeficsProcessor(tokenizer=tokenizer, image_processor=image_processor)
predicted_tokens = [ predicted_tokens = [
"<s>Describe this image.\nAssistant:<unk><unk><unk><unk><unk><unk><unk><unk><unk>", "<s> Describe this image.\nAssistant:<unk><unk><unk><unk><unk><unk><unk><unk><unk>",
"<s>Describe this image.\nAssistant:<unk><unk><unk><unk><unk><unk><unk><unk><unk><unk>", "<s> Describe this image.\nAssistant:<unk><unk><unk><unk><unk><unk><unk><unk><unk><unk>",
] ]
prompts = [[prompt] for prompt in self.prepare_prompts()[2]] prompts = [[prompt] for prompt in self.prepare_prompts()[2]]
max_length = processor(prompts, padding="max_length", truncation=True, max_length=20) max_length = processor(prompts, padding="max_length", truncation=True, max_length=20)
longest = processor(prompts, padding="longest", truncation=True, max_length=30) longest = processor(prompts, padding="longest", truncation=True, max_length=30)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment