Commit Graph

1197 Commits

Author SHA1 Message Date
shouzhou.bx
4073376f51 [to #42322933]add face 2d keypoints by EasyCV
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9934673

    * add face 2d keypoints
2022-09-02 20:53:29 +08:00
suluyan.sly
5a2634610a [to #42322933]skip sbert_en&bert_ch to save ci time
![](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/251924/40165669611078357/image.png)
fill mask pipeline 测试时间过长

这个task测了4个模型。从保证代码正确性的功能角度看,只测一个bert类(比如sbert中文),一个roberta类(veco)。减少测试的模型数量以减少测试时长。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006556

    * skip sbert_en&bert_ch to save ci time
2022-09-02 20:03:19 +08:00
xingguang.zxg
4d3716cf4e [to #42322933]文本指导的语义分割模型
文本指导的语义分割模型,根据输入的文本信息,讲图像中对应文本描述的物体分割出来。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9942863
2022-09-02 14:14:47 +08:00
jiangnana.jnn
1a22fa0222 fix trainer unittest
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9970626

    * fix trainer unittest
2022-09-02 14:06:08 +08:00
xianzhe.xxz
1bac4f3349 [to #42322933]add tinynas-detection pipeline and models
接入tinynas-detection,新增tinynas object detection pipeline以及tinynas models。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9938220
2022-09-02 13:10:31 +08:00
mulin.lyh
9e14d6727b [to #44571845]fix: ci support multiple image
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9974293
2022-09-02 11:02:43 +08:00
peter.lx
780330897a [to #42322933] add Deberta v2 modeling and fill_mask task, with master merged
add Deberta v2 modeling and fill_mask task, with master merged
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9966511
2022-09-01 22:17:14 +08:00
lllcho.lc
291f8fe68c [to #42322933] Add action-detection model
添加新的action-detection task
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9898947
2022-09-01 18:14:37 +08:00
行嗔
c546f2a8b9 Merge remote-tracking branch 'origin/master' into ofa/finetune
# Conflicts:
#	modelscope/preprocessors/multi_modal.py
2022-09-01 18:08:58 +08:00
行嗔
a3aee4bec2 test finetune 2022-09-01 18:02:07 +08:00
fubang.zfb
8f81807537 [to #42322933] 关系抽取
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9938140
2022-09-01 16:31:51 +08:00
pengyu.lpy
ce41ded423 [to #42322933]modify test_segmentation_pipeline.py for damo models
基于easycv上线的segformer,对应上传了5个对应的达摩院的分割模型,所以修正了tests/pipelines/easycv_pipelines/test_segmentation_pipeline.py内容让其能够便利测试
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9934634
2022-09-01 15:48:40 +08:00
yongfei.zyf
c8b6030b8e [to #42322933] Add hicossl_video_embedding_pipeline to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9969472
2022-09-01 14:20:04 +08:00
xuanjie.wxb
e5c9ded870 [to #42322933] add lstm-crf ner model code
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9901220

    * add lstm-crf ner model code
2022-09-01 09:19:59 +08:00
shuying.shu
a9deb3895c [to #42322933] movie scene segmentation模型接入
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9872869
2022-08-31 20:54:20 +08:00
Yingda Chen
681ea8cd17 [to #42322933] disable image diffusion tests 2022-08-31 12:57:14 +08:00
yuze.zyz
fbde374659 [to #42322933] add regress tests
Add regression test for some unit tests.
Firstly, Run a baseline test to create a pickle file which contains the inputs and outputs of modules, then changes can be observed between
the latest version and the baseline file.
Some baseline files are submitted in the data/test/regression folder
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9814693
2022-08-30 23:17:07 +08:00
xiangpeng.wxp
054151d92f [to #42322933]nlp_translation_preprocess
* nlp translation preprocess branch
 * pull the latest master
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9920445
2022-08-30 22:08:27 +08:00
mulin.lyh
12698b31a0 [to #44340132] fix: ci case run out of gpu memory 2022-08-30 17:59:15 +08:00
shichen.fsc
2b380f0410 [to #42322933] add new Task - document segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9942858

    * [Add] add document-segmentation
2022-08-30 15:30:00 +08:00
feiwu.yfw
2b64cf2bb6 [to #42322933]支持从dataset json文件中获取参数
* dataset json file add args
2022-08-30 15:15:15 +08:00
shichen.fsc
745bd5a9e0 [to #42322933] remove some unittest about asr
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9941890
2022-08-30 14:28:25 +08:00
yuze.zyz
88d0804dcd [to #42322933] Add S4: child-tuning
1. add child-tuning optimizer and ut
2. fix a training bug which can cause interruption after cross-evaluation
3. move model.params from cfg to default args in build_optimizer to prevent the saving of params in save_pretrained
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9891963
2022-08-30 10:52:07 +08:00
hemu.zp
a9089570e5 [to #42322933] Add mplug retrieval pipeline and finetune
支持 MPLUG 模型 image-text-retrieval 任务的 pipeline 和 finetune
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9919955
2022-08-30 10:50:52 +08:00
bin.xue
3e66244c0d [to #42322933] Add ANS trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9892528
2022-08-30 10:23:22 +08:00
eniac.xcw
8c9348de2c [to #42322933]add team model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9908976
2022-08-30 10:07:39 +08:00
hanyuan.chy
00b448a2fe [to #42322933] support 3d body keypoints
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9862567
2022-08-27 14:11:30 +08:00
leyuan.hjy
285192850d [to #42322933] feat(RealtimeObjectDetection):新增实时检测pipeline
新增实时目标检测pipeline
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9788299
2022-08-27 10:48:56 +08:00
feiwu.yfw
39485426e7 [to #42322933]:fix msdataset
* 修复了zip文件不同打包模式下返回路径错误问题。
* 修复了替换了数据集文件重新下载时校验失败问题。
* 修复dataset oss文件在 REUSE 模式下重复下载的问题。
* 修复了csv数据集的meta json文件中某个split的meta和file字段都为''时加载所有split失败的问题。
 * 修复了不同版本datasets路径不一致的问题。
2022-08-26 22:41:13 +08:00
hemu.zp
20a935d406 [to #42322933] add gpt3 base finetune
添加 gpt3 中小模型单机单卡下的 finetune 代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9899004
2022-08-26 14:54:45 +08:00
jiangnana.jnn
930d55d9ad support EasyCV framework and add Segformer model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9781849

    * support EasyCV
2022-08-26 13:58:50 +08:00
tanfan.zjh
dc45fce542 [to #42322933]新增FAQ问答模型
Maas新增FAQ问答模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9797053
2022-08-26 13:06:41 +08:00
xingjun.wxj
44033290d4 [to #42322933]MsDataset 支持上传数据集压缩包和meta
1. MsDataset支持upload数据文件(压缩包)
2. MsDataset支持clone和upload meta data
3. 使用MsDataset.load()下载数据集,支持web端显示数据集下载计数
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9831232
2022-08-25 22:28:10 +08:00
james.wjg
8ac65d5586 [to #42322933] video_summarization 修改test中的结果可视化
video_summarization 修改test中的结果可视化
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9902499
2022-08-25 22:00:03 +08:00
hemu.zp
b92e2ca0a0 [to #42322933] add vqa and caption finetuning for mplug
添加 mplug 模型 caption 及 vqa 任务的 finetuning 支持
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9858028
2022-08-25 21:26:51 +08:00
tianchu.gtc
0b6725add6 [to #42322933]semantic segmentation 模型接入
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9851374
2022-08-25 15:50:24 +08:00
zhangzhicheng.zzc
b94bb74f66 [to #42322933]Add model.save_pretrained method and allow finetune results used by pipeline 2022-08-24 21:39:08 +08:00
wenmeng.zwm
c72e5f4ae8 [to #43878347] skip device placement test
skip this test which will result in too much debug log for placement although debug level is canceled after this test case

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9875987
2022-08-24 15:08:22 +08:00
tianchu.gtc
cdebef4689 [to #42322933]panoptic segmentation 模型接入
panoptic segmentation 模型接入
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9758389
2022-08-24 15:05:16 +08:00
james.wjg
5f326e46f3 cv/video_summarization
新增video summarization模型的inference和finetune
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9840532
2022-08-24 13:41:47 +08:00
zhangzhicheng.zzc
5b0b54633b [to #42322933]compatible with windows path on only core parts
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9855254
2022-08-24 13:35:42 +08:00
yingda.chen
04bb8061e6 [to #42322933]move postprocess helper into utilities
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9856286
2022-08-23 14:27:19 +08:00
Yingda Chen
63233c2122 Revert "[to #42322933]move postprocess helper into utilities"
This reverts commit 4cc0395ac5.
2022-08-23 12:13:15 +08:00
Yingda Chen
4cc0395ac5 [to #42322933]move postprocess helper into utilities 2022-08-23 12:11:49 +08:00
lee.lcy
9c4765923a [to #42322933] add image-reid-person
add image-reid-person
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9818427
2022-08-22 21:57:05 +08:00
wenmeng.zwm
aaa604cb16 [to #43878347] device placement support certain gpu
1. add device util to verify, create and place device
2. pipeline and trainer support update
3.  fix pipeline which use tf models does not place model to the right device

usage

```python
pipe = pipeline('damo/xxx', device='cpu')
pipe = pipeline('damo/xxx', device='gpu')
pipe = pipeline('damo/xxx', device='gpu:0')
pipe = pipeline('damo/xxx', device='gpu:2')
pipe = pipeline('damo/xxx', device='cuda')
pipe = pipeline('damo/xxx', device='cuda:1')
```
 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9800672
2022-08-22 15:32:00 +08:00
yuanzhi.zyz
4b501dd44a [to #42322933]ocr-recognition re-upload
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9826159
2022-08-19 19:02:27 +08:00
lanjinpeng.ljp
c6db966a99 [to #42322933]support video-single-object-tracking
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9781254

    * support single object tracking
2022-08-19 15:55:58 +08:00
Yingda Chen
df4f1a538d [to #42322933]disable ocr test temporarily 2022-08-19 14:01:06 +08:00
wenmeng.zwm
e85b27107e [to #44236829] import nlp preprocessor to make UT run successfully while igoring ast scanning error 2022-08-19 10:24:21 +08:00