Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-16 16:27:45 +01:00
Code Issues Packages Projects Releases Wiki Activity

[to #42463204] support Pil.Image for image_captioning

Browse Source 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9049211
This commit is contained in:
lingcai.wl
2022-06-15 18:37:40 +08:00
parent c59833c7ee
commit d983bdfc8e
1 changed files with 5 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
modelscope/pipelines/multi_modal/image_captioning.py
View File

@@ -84,8 +84,11 @@ class ImageCaptionPipeline(Pipeline):
s = torch.cat([s, self.eos_item])
return s
patch_image = self.patch_resize_transform(
load_image(input)).unsqueeze(0)
if isinstance(input, Image.Image):
patch_image = self.patch_resize_transform(input).unsqueeze(0)
else:
patch_image = self.patch_resize_transform(
load_image(input)).unsqueeze(0)
patch_mask = torch.tensor([True])
text = 'what does the image describe?'
src_text = encode_text(