Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-23 19:49:24 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,822 Commits 263 Branches 106 Tags
update/list_datasets
Commit Graph

1195 Commits

Author SHA1 Message Date
jiangnana.jnn
376ba9fef9 [to #42322933]update easycv pipelines 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10208603

    * update easycv pipelines
 2022-09-22 15:15:29 +08:00
yichang.zyc
b537bb8c27 fix vg return value 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10207239
 2022-09-21 18:57:34 +08:00
jiangnana.jnn
1794e08af7 fix dist training 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10185634

    * fix dist training
 2022-09-21 17:47:50 +08:00
行嗔
5d83f62312 mnli finetune done 2022-09-21 15:52:10 +08:00
yuze.zyz
c2b1ff8389 [to #42322933] Add exporter module for onnx,ts and other formats. 
1. Add exporter module
2. Move collate_fn out of the base pipeline class for reusing.
3. Add dummy inputs method in nlp tokenization preprocessor base class
4. Support Mapping in tensor numpify and detaching.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10037704
 2022-09-21 14:25:06 +08:00
wenmeng.zwm
6808e9a301 [to #44902099] add license for framework files 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10189613
 2022-09-20 17:49:31 +08:00
yuze.zyz
4cdd0c23eb [to #42322933] Refactor and fix some bugs 
1. Fix a bug in trainer's progress bar
2. Fix a bug that trainer does not support dataset in config file
3. Add feature: support go on training via checkpoint file
4. Add feature: support fixed filename when saving best checkpoint
5. Fix a bug that no id2label in config file after finetune of nlp models
6. Fix some other bugs
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10138906
 2022-09-19 17:05:35 +08:00
myf272609
0041ab0ab8 [to #42322933] add multi-style cartoon models to ut 
1. 卡通化接入多风格模型（原始日漫风、3D、手绘风、素描风、艺术特效风格），添加ut接入测试
2. 修改pipeline中模型文件名称至通用名
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10153717
 2022-09-19 11:28:01 +08:00
lingcai.wl
0548d92de8 [to #44657982] fix some demo problems 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10083156
 2022-09-19 10:27:26 +08:00
wenmeng.zwm
7fb25d7bbb [to #42322933]fix UT error for 830 version 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10142442
 2022-09-16 22:42:39 +08:00
mulin.lyh
b0b711b39c [to #44964129]fix: ci result always pass 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10140476
 2022-09-15 19:28:39 +08:00
jiangnana.jnn
adee5d10ae update EasyCV MsDataset 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10103248

    * update EasyCV MSDataset
 2022-09-15 18:11:03 +08:00
xingjun.wxj
7cb72cc46e [to #42322933]MsDataset upload bugfix for 0830 version. 
CR link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10109035#tab=changes&file=8348e8153b2f4a6dbd52e471b4980542355408ed

Please refer to aone links:

1. https://aone.alibaba-inc.com/v2/project/1162242/bug#viewIdentifier=b622c099e2199bc034401fbe&openWorkitemIdentifier=44889184

2. https://aone.alibaba-inc.com/v2/project/1162242/bug#viewIdentifier=b622c099e2199bc034401fbe&openWorkitemIdentifier=44858810

3. https://aone.alibaba-inc.com/v2/project/1162242/bug#viewIdentifier=b622c099e2199bc034401fbe&openWorkitemIdentifier=44857728

4. https://aone.alibaba-inc.com/v2/project/1162242/bug#viewIdentifier=b622c099e2199bc034401fbe&openWorkitemIdentifier=44658972
 2022-09-14 19:24:48 +08:00
caorongyu.cry
77cfcf0a9a [to #42322933] commit nlp_convai_text2sql_pretrain_cn inference process to modelscope 
commit nlp_convai_text2sql_pretrain_cn inference process to modelscope
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10025155
 2022-09-14 19:04:56 +08:00
mulin.lyh
ff58300d09 [to #44857956]fix: disable git command username/password prompt 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10106602

    * [to #44857956]fix: disable git command username/password prompt
 2022-09-14 06:44:04 +08:00
dingkun.ldk
54e1a6d88b [to #42322933]830NLP 篇章排序/文本表示模型代码check 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9856179
 2022-09-10 15:59:56 +08:00
Yingda Chen
e0ef60ca9b [to #42322933] skip demo test by default 2022-09-09 14:56:33 +08:00
ly119399
b41b10f897 [to #42322933] space finetune on generation task 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10061562
 2022-09-09 14:27:08 +08:00
bin.xue
4be7737122 [to #42322933] audio pipelines accept url as input 2022-09-09 13:51:09 +08:00
shichen.fsc
84c384cc57 [to #42322933] add httpurl support for KWS 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10078262
 2022-09-09 10:06:20 +08:00
jiangnana.jnn
5e176da3a1 adapt to msdataset for EasyCV 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9935664

    * adapt to msdataset for EasyCV
 2022-09-09 10:01:51 +08:00
lingcai.wl
7a49fa1cc6 [to #44657982] add unittest for demo and demotest utils 
unittest for demo service
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006180
 2022-09-08 14:08:51 +08:00
cyc385202
d4759e4c24 [to #42322933] 加入space模型在banking数据集上的finetune代码 
加入space模型在banking数据集上的微调代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006792
 2022-09-08 13:45:14 +08:00
shichen.fsc
6fd5f671fa [to #42322933] add httpurl support for ASR 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10043608
 2022-09-08 11:00:35 +08:00
tingwei.gtw
7b23c41748 [to #42322933] Add video-inpainting files 
视频编辑的cr
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10026166
 2022-09-07 21:06:25 +08:00
mulin.lyh
ad6bb1e7d9 [to #44790143]fix: add ipythonkernel to image for dsw 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10049527

    * add ipykernel to image for dsw
 2022-09-07 20:51:15 +08:00
shichen.fsc
a8fd9c4afe [to #42322933] add new pipeline - PoNet for fill-mask 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10019083
 2022-09-07 20:12:44 +08:00
dingkun.ldk
7ed4015bdc [to #42322933]支持词性标注 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9980774
 2022-09-07 11:57:30 +08:00
ly261666
8f05fa8cf1 [to #42322933] 新增MogFace人脸检测器 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9921926
 2022-09-07 09:35:59 +08:00
ly261666
c12957a9eb [to #42322933] 新增Mtcnn人脸检测器 
1. 完成Maas-cv CR标准 自查
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9951519

    * [to #42322933] 新增Mtcnn人脸检测器
 2022-09-06 22:53:55 +08:00
eniac.xcw
d38076b072 makes test code clear 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10041992
 2022-09-06 22:18:51 +08:00
wenmeng.zwm
fabb4716d4 [to #44610931] fix: add device usage when device is None or empty 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10039848

    * add device usage when device is None or empty

    * update docker env
 2022-09-06 21:47:59 +08:00
xuangen.hlh
f7f29ed1ff DALL-E 2: 修复dev/dalle2_1分支问题，增加测试代码，本地测试通过 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10037492
 2022-09-06 20:47:23 +08:00
wenmeng.zwm
cd8ac57fdd [to #44742129] support model tag for integration 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10035056

* support model tag for integration
 2022-09-06 19:06:49 +08:00
yuze.zyz
01e768503c [to #42322933] Fix random seed for trainer 
1. Fix random seed for trainer and init it at the first line of init
2. Add a regress test for fixed training
3. Change the dataset 'dureader_robust_qg' to 'DuReader_robust-QG'
4. Change some datasets from loading hf.datasets to loading msdataset.load
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10029509
 2022-09-06 15:13:14 +08:00
ly261666
9cbf246a8c [to #42322933] 新增ULFD人脸检测器 
1. 完成Maas-cv CR标准 自查
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9957634
 2022-09-06 10:02:49 +08:00
suluyan.sly
904374d329 [to #42322933] feat: plug inference 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9931748
 2022-09-05 20:58:08 +08:00
行嗔
5cf6910bed Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-09-05 20:48:41 +08:00
hemu.zp
3d3f9b4537 [to #42322933] fix checkpoint format 
1. 修复 palm，gpt3，mplug 模型存在的 finetune 后保存 checkpoint 与原有 checkpoint key 字段存在区别无法使用 from_pretrained 导入的问题
2. 调整 test_finetune_mplug.py 为只保存训练结束时的 checkpoint，减少 ci 耗时
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10016517
 2022-09-05 17:51:22 +08:00
liangting.zl
4484dcaa04 [to #42322933] feat: add hand keypoints pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9961906

    * feat: add hand keypoints pipeline
 2022-09-05 16:42:40 +08:00
mulin.lyh
042cff7d68 [to #44702084]fix: ci pip install domain in single commands, find with requirement install failed is complicated. 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10014958

    * [to #44702084]fix: ci pip install domain in single commands, find with requirement install failed is complicated.
 2022-09-05 16:08:50 +08:00
bin.xue
b870e4eed5 [to #42322933] test: use custom config to reduce test time 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10011826

、
 2022-09-05 13:26:30 +08:00
yuze.zyz
a9c14e4ead [to #42322933] Support saving the best checkpoint for inference 
1. Support saving the best checkpoint for inference
2. Fix a bug that _max_iters field does not exist in trainer
3. Fix a bug that function in lambda_lr field cannot be saved to file
4. Fix a bug that save_pretrained would not be called by iterating
5. Fix a bug that interval is not passed from BestCkptHook's init
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9972765
 2022-09-05 11:07:48 +08:00
ly261666
adab7d3391 [to #42322933] 新增FER人脸属性识别 
完成Maas-cv CR自查；
新增个Task，已经跟产品确认可以增加，正在走流程中，目前还不在https://aone.alibaba-inc.com/v2/project/1181559/req#viewIdentifier=d7f112f9d023e2108fa1b0d8这里，后续会增加过来
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9976346
 2022-09-05 09:53:58 +08:00
行嗔
db534fe946 add hf dataset 2022-09-04 16:08:25 +08:00
ly261666
f508be8918 [to #42322933] 新增RetinaFace人脸检测器 
1. 新增人脸检测RetinaFace模型；
2. 完成Maas-cv CR标准自查
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9945188
 2022-09-03 23:48:42 +08:00
xingguang.zxg
0451627626 [to #42322933]商品显著性分割v1.0 
商品显著性检测模型，依赖opencv，mmcv-full
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9909897
 2022-09-03 13:21:31 +08:00
Yingda Chen
39a309b655 [to #42322933] reduce train epoch from 3 to w 2022-09-03 12:18:52 +08:00
shouzhou.bx
4073376f51 [to #42322933]add face 2d keypoints by EasyCV 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9934673

    * add face 2d keypoints
 2022-09-02 20:53:29 +08:00
suluyan.sly
5a2634610a [to #42322933]skip sbert_en&bert_ch to save ci time 
![](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/251924/40165669611078357/image.png)
fill mask pipeline 测试时间过长

这个task测了4个模型。从保证代码正确性的功能角度看，只测一个bert类(比如sbert中文），一个roberta类（veco)。减少测试的模型数量以减少测试时长。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006556

    * skip sbert_en&bert_ch to save ci time
 2022-09-02 20:03:19 +08:00