Commit Graph

1679 Commits

Author SHA1 Message Date
xingjun.wang
41a40edef3 ok Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 19:05:22 +08:00
xingjun.wang
7fdfb1cd5d change version 2023-05-12 19:05:12 +08:00
xingjun.wang
9be87e6754 ok Merge branch 'dev/merge_github_master_0512' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 18:06:26 +08:00
tongmu.wh
ca0cf2b5cf merge master ,加入speaker change locating pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12601179
2023-05-12 17:53:56 +08:00
hejunjie.hjj
1cd67ef060 [to #42322933] add cvpr23 fastinst model 2023-05-12 17:51:00 +08:00
xingjun.wang
112466e069 update class ExtractiveSummarizationPipeline(Pipeline): 2023-05-12 17:37:58 +08:00
xingjun.wang
92270f5f23 ok Merge branch 'dev/merge_github_master_0512' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 17:32:46 +08:00
xingjun.wxj
e630621599 Virgo SDK supports odps data source
1. Support ODPS datasource for virgo sdk.
2. Adapt "inner_url" parser for single-modal and multi-modal datasets.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12583695

* add virgo sdk odps data

* refine virgo sdk args and odps fetch batch data pipeline

* add inner import for odps

* del import VirgoDataset in MsDataset

* fix import VirgoDataset

* support inner url downloading

* refine dataset.py and maxcompute_utils.py

* add ut for virgo odps data batch

* reset unifold ut level as 1

* refine virgo batch data
2023-05-12 17:27:19 +08:00
xingjun.wxj
cafc90da21 Fix master UT on level0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12599393

* reset ut level for test_run_with_model_name_for_unite_large and test_run_with_model_name_for_unite_base

* fix master UT for level0

* update EasyCVFace2DKeypointsPipelineTest skip info
2023-05-12 17:25:32 +08:00
xingjun.wang
0cf0ac2112 merge master 2023-05-12 17:13:10 +08:00
wangmeng.xwm
f0d519219f add clip_interrogator
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12388571

* init commit of clip_interrogator

* fix format

* fix environment dependencies

* fix backend.mps

* fix test image path

* add model introduction and paper link

* add comment example for pipeline, fix device control
2023-05-12 16:06:52 +08:00
Xingjun.Wang
72b617dab9 Merge pull request #289 from Restry/patch-1
修复 fid_dialogue_pipeline.py 在cpu下推理时的异常
2023-05-12 15:38:53 +08:00
Xingjun.Wang
75410651ba Merge pull request #297 from slin000111/master
add torch2 compile to nlp pipelines
2023-05-12 11:03:15 +08:00
zhifu.gzf
f2e197ba91 rm easrasr 2023-05-12 10:39:22 +08:00
zhifu.gzf
c16a3b847f audio funasr pipeline kwargs 2023-05-12 09:02:05 +08:00
wucong.lyb
4c0b13d157 fix func update_local_model; change funasr version
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12595406
2023-05-11 20:13:20 +08:00
hemu.zp
49339941df Add convert megatron ckpt script
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12555222

* add convert megatron ckpt script
2023-05-11 15:50:30 +08:00
Wang Qiang
63777b995d Fix bug: install taming error prompt (#296) 2023-05-11 15:23:22 +08:00
slin000111
5a0e022133 Merge branch 'modelscope_dev'
translation evaluation pipeline
2023-05-11 15:16:46 +08:00
slin000111
d76303d324 translation evaluation pipeline 2023-05-11 15:11:22 +08:00
wanyu.wy
58df448182 Add trainer for UniTE 2023-05-11 14:41:08 +08:00
hemu.zp
ca85447363 remove pai-easycv requirement
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12564234
2023-05-11 14:31:18 +08:00
mulin.lyh
7b14a0e11f Pipeline input, output and parameter normalization. 2023-05-11 11:20:01 +08:00
slin000111
76af9b70f5 Merge branch 'modelscope_dev'
add argument compile to nlp pipelines
2023-05-11 10:33:39 +08:00
slin000111
1c5222d6c1 add argument compile to nlp pipelines 2023-05-11 10:27:45 +08:00
mulin.lyh
ba646ef1d2 display hub error message
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12581373
2023-05-10 20:58:44 +08:00
hehong.chh
b80c13036f fix bug: hypotheses did't init in cpu device、make fid_dialogue_test available
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12406082
2023-05-10 11:10:31 +08:00
Li Tong
626b60e8c2 fix issue: Batch and single are not uniform #215 (#258)
* fix issue: Batch and single are not uniform #215, https://github.com/modelscope/modelscope/issues/215

* remove extra code

* fix bug

* update test

---------

Co-authored-by: ezeli.lt <ezeli.lt@alibaba-inc.com>
Co-authored-by: hemu <hemu.zp@alibaba-inc.com>
2023-05-10 10:49:54 +08:00
xfanplus
cb35b9c04e fix type checking of inputs for np.array (#271)
* fix type checking of inputs for np.array

inputs type of np.ndarray is not checked correctly.

* add docstr for /preprocessor.py

add docstr about np.ndarray, shape and order
2023-05-10 10:34:42 +08:00
ly261666
bdd282a127 [to #42322933] add transface model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12568301
2023-05-10 01:04:10 +08:00
jiangnana.jnn
46072898da remove easycv codes, plugin access
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11965727

* remove easycv codes

* fix custome msdatasets import and remove metainfo

* fix pipeline imports

* fix pre-check

* fix models import

* fix pre-check

* merge master
2023-05-09 17:58:01 +08:00
zhangzhicheng.zzc
038c5fea48 add verified if whl installed 2023-05-08 15:59:38 +08:00
leway
1f2bb82ea6 Update fid_dialogue_pipeline.py
修复在cpu下推理时的错误,这里不应该检查cuda是否可用。这里的逻辑似乎有错误
2023-05-07 14:51:47 +08:00
mulin.lyh
d772d96cf5 [to #49147498]feat: support python3.8 2023-05-06 18:01:02 +08:00
bin.xue
6d68f0ea64 [to #42322933] add ONNX exporter for ans dfsmn 2023-04-28 10:33:32 +08:00
Wang Qiang
9bfc4a9d83 Add finetuning stable diffusion example (#285) 2023-04-28 10:18:42 +08:00
chenyafeng.cyf
93f73a26e7 add rdino model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12406691
2023-04-26 11:18:28 +08:00
zhangzhicheng.zzc
1719ecad03 stable diffusion allow postprocess kwargs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12418063
* stable diffusion allow postprocess kwargs
2023-04-21 18:34:29 +08:00
yuanzhi.zyz
b19cc13ca7 update ocr_reco
1. 增加本地lmdb输入的接口;
2. finetune后模型的keys有prefix,导致不能直接读取,已在model初始化时统一替换;
3. 添加各个模型的cpu和gpu测试。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12256669
* add local_lmdb read
2023-04-21 15:05:16 +08:00
xingjun.wxj
92f7c66d12 Add progress bar and fix cache dir issue
1. Add progress bar for dataframe apply when downloading data files.
2. Fix cache data files issue
3. Refine _prepare_and_download() func

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12408412
* add progress bar and fix cache dir

* add progress bar and fix cache dir

* refine code
2023-04-21 13:49:17 +08:00
bin.xue
dd4299e0c8 [to #42322933] add DFSMN model to far field KWS
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12334627
* feat: set stream mode in constructor

* fix: commit model file

* doc: add more information about DFSMN

* fix: seperation model evaluate returns None in speechbrain whose version < 0.5.12
2023-04-20 22:45:07 +08:00
guangpan.cd
8debc432cf Quick fix to ChineseStableDiffusion meta tensor bug.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12382517
* Quick fix to ChineseStableDiffusion meta tensor bug.
2023-04-19 17:11:25 +08:00
mulin.lyh
8ea82e6f6d * add lfs append 2023-04-18 20:32:11 +08:00
Xu Wenqing
e8bca5a11e Set default topk when num_classes < 5 (#269)
* set default topk when num_classes < 6

* add comments

* format changes with yapf

---------

Co-authored-by: Xu Wenqing <xwq391974@alibaba-inc.com>
2023-04-18 20:30:13 +08:00
xingjun.wxj
976bdf4ebc Add virgo hub
1. Add Hubs.virgo in MsDataset.load()
2. Add VirgoDownloader pipeline
3. Add auth for virgo hub.
4. Add other utils.
5. cherry-pick from https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12352198?file=8c317278a40b19fe76825fb749e768fdbfd6a711

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12351633
2023-04-18 17:01:43 +08:00
shuying.shu
a355eefbd4 fix OOM for bassl
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12354474
2023-04-18 14:43:09 +08:00
biwen.lbw
3033e54d5e update test data
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12355868
* update test data
2023-04-18 14:42:09 +08:00
liugao.lg
4225048dbf provide allow_remote
优化模版文件,提升独立repo接入成功率,降低用户阅读文档带来的歧义
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12354329
* provide allow_remote
2023-04-18 14:41:51 +08:00
Firmament-cyou
e841261557 Merge pull request #275 from modelscope/master-merge-internal2023-0417
Master merge internal2023 0417
2023-04-17 15:01:30 +08:00
zhifu.gzf
a40c6f452e support funasr for mac
增加asr pipeline对于mac支持,在mac上自测没问题
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12341467
2023-04-17 10:17:55 +08:00