Skip to content

GitLab

"...git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "02ec02d6d3580874b4a0b00d5b13ab0334114fd9"
Unverified Commit 21da3b24 authored by Yih-Dar's avatar Yih-Dar Committed by GitHub
Browse files

Update expect outputs of `IdeficsProcessorTest.test_tokenizer_padding` (#26779) 



fix
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
parent 7790943c
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 3 deletions
tests/models/idefics/test_processor_idefics.py
View file @ 21da3b24
......@@ -148,10 +148,9 @@ class IdeficsProcessorTest(TestCasePlus):
processor = IdeficsProcessor(tokenizer=tokenizer, image_processor=image_processor)
predicted_tokens = [
"<s>Describe this image.\nAssistant:<unk><unk><unk><unk><unk><unk><unk><unk><unk>",
"<s>Describe this image.\nAssistant:<unk><unk><unk><unk><unk><unk><unk><unk><unk><unk>",
"<s> Describe this image.\nAssistant:<unk><unk><unk><unk><unk><unk><unk><unk><unk>",
"<s> Describe this image.\nAssistant:<unk><unk><unk><unk><unk><unk><unk><unk><unk><unk>",
]
prompts = [[prompt] for prompt in self.prepare_prompts()[2]]
max_length = processor(prompts, padding="max_length", truncation=True, max_length=20)
longest = processor(prompts, padding="longest", truncation=True, max_length=30)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment