Commit Graph

1176 Commits

Author SHA1 Message Date
shichen.fsc
84c384cc57 [to #42322933] add httpurl support for KWS
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10078262
2022-09-09 10:06:20 +08:00
jiangnana.jnn
5e176da3a1 adapt to msdataset for EasyCV
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9935664

    * adapt to msdataset for EasyCV
2022-09-09 10:01:51 +08:00
lingcai.wl
7a49fa1cc6 [to #44657982] add unittest for demo and demotest utils
unittest for demo service
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006180
2022-09-08 14:08:51 +08:00
cyc385202
d4759e4c24 [to #42322933] 加入space模型在banking数据集上的finetune代码
加入space模型在banking数据集上的微调代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006792
2022-09-08 13:45:14 +08:00
shichen.fsc
6fd5f671fa [to #42322933] add httpurl support for ASR
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10043608
2022-09-08 11:00:35 +08:00
tingwei.gtw
7b23c41748 [to #42322933] Add video-inpainting files
视频编辑的cr
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10026166
2022-09-07 21:06:25 +08:00
mulin.lyh
ad6bb1e7d9 [to #44790143]fix: add ipythonkernel to image for dsw
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10049527

    * add ipykernel to image for dsw
2022-09-07 20:51:15 +08:00
shichen.fsc
a8fd9c4afe [to #42322933] add new pipeline - PoNet for fill-mask
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10019083
2022-09-07 20:12:44 +08:00
dingkun.ldk
7ed4015bdc [to #42322933]支持词性标注
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9980774
2022-09-07 11:57:30 +08:00
ly261666
8f05fa8cf1 [to #42322933] 新增MogFace人脸检测器
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9921926
2022-09-07 09:35:59 +08:00
ly261666
c12957a9eb [to #42322933] 新增Mtcnn人脸检测器
1. 完成Maas-cv CR标准 自查
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9951519

    * [to #42322933] 新增Mtcnn人脸检测器
2022-09-06 22:53:55 +08:00
eniac.xcw
d38076b072 makes test code clear
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10041992
2022-09-06 22:18:51 +08:00
wenmeng.zwm
fabb4716d4 [to #44610931] fix: add device usage when device is None or empty
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10039848

    * add device usage when device is None or empty

    * update docker env
2022-09-06 21:47:59 +08:00
xuangen.hlh
f7f29ed1ff DALL-E 2: 修复dev/dalle2_1分支问题,增加测试代码,本地测试通过
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10037492
2022-09-06 20:47:23 +08:00
wenmeng.zwm
cd8ac57fdd [to #44742129] support model tag for integration
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10035056

* support model tag for integration
2022-09-06 19:06:49 +08:00
yuze.zyz
01e768503c [to #42322933] Fix random seed for trainer
1. Fix random seed for trainer and init it at the first line of init
2. Add a regress test for fixed training
3. Change the dataset 'dureader_robust_qg' to 'DuReader_robust-QG'
4. Change some datasets from loading hf.datasets to loading msdataset.load
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10029509
2022-09-06 15:13:14 +08:00
ly261666
9cbf246a8c [to #42322933] 新增ULFD人脸检测器
1. 完成Maas-cv CR标准 自查
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9957634
2022-09-06 10:02:49 +08:00
suluyan.sly
904374d329 [to #42322933] feat: plug inference
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9931748
2022-09-05 20:58:08 +08:00
行嗔
5cf6910bed Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-09-05 20:48:41 +08:00
hemu.zp
3d3f9b4537 [to #42322933] fix checkpoint format
1. 修复 palm,gpt3,mplug 模型存在的 finetune 后保存 checkpoint 与原有 checkpoint key 字段存在区别无法使用 from_pretrained 导入的问题
2. 调整 test_finetune_mplug.py 为只保存训练结束时的 checkpoint,减少 ci 耗时
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10016517
2022-09-05 17:51:22 +08:00
liangting.zl
4484dcaa04 [to #42322933] feat: add hand keypoints pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9961906

    * feat: add hand keypoints pipeline
2022-09-05 16:42:40 +08:00
mulin.lyh
042cff7d68 [to #44702084]fix: ci pip install domain in single commands, find with requirement install failed is complicated.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10014958

    * [to #44702084]fix: ci pip install domain in single commands, find with requirement install failed is complicated.
2022-09-05 16:08:50 +08:00
bin.xue
b870e4eed5 [to #42322933] test: use custom config to reduce test time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10011826
2022-09-05 13:26:30 +08:00
yuze.zyz
a9c14e4ead [to #42322933] Support saving the best checkpoint for inference
1. Support saving the best checkpoint for inference
2. Fix a bug that _max_iters field does not exist in trainer
3. Fix a bug that function in lambda_lr field cannot be saved to file
4. Fix a bug that save_pretrained would not be called by iterating
5. Fix a bug that interval is not passed from BestCkptHook's init
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9972765
2022-09-05 11:07:48 +08:00
ly261666
adab7d3391 [to #42322933] 新增FER人脸属性识别
完成Maas-cv CR自查;
新增个Task,已经跟产品确认可以增加,正在走流程中,目前还不在https://aone.alibaba-inc.com/v2/project/1181559/req#viewIdentifier=d7f112f9d023e2108fa1b0d8这里,后续会增加过来
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9976346
2022-09-05 09:53:58 +08:00
行嗔
db534fe946 add hf dataset 2022-09-04 16:08:25 +08:00
ly261666
f508be8918 [to #42322933] 新增RetinaFace人脸检测器
1. 新增人脸检测RetinaFace模型;
2. 完成Maas-cv CR标准自查
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9945188
2022-09-03 23:48:42 +08:00
xingguang.zxg
0451627626 [to #42322933]商品显著性分割v1.0
商品显著性检测模型,依赖opencv,mmcv-full
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9909897
2022-09-03 13:21:31 +08:00
Yingda Chen
39a309b655 [to #42322933] reduce train epoch from 3 to w 2022-09-03 12:18:52 +08:00
shouzhou.bx
4073376f51 [to #42322933]add face 2d keypoints by EasyCV
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9934673

    * add face 2d keypoints
2022-09-02 20:53:29 +08:00
suluyan.sly
5a2634610a [to #42322933]skip sbert_en&bert_ch to save ci time
![](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/251924/40165669611078357/image.png)
fill mask pipeline 测试时间过长

这个task测了4个模型。从保证代码正确性的功能角度看,只测一个bert类(比如sbert中文),一个roberta类(veco)。减少测试的模型数量以减少测试时长。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006556

    * skip sbert_en&bert_ch to save ci time
2022-09-02 20:03:19 +08:00
xingguang.zxg
4d3716cf4e [to #42322933]文本指导的语义分割模型
文本指导的语义分割模型,根据输入的文本信息,讲图像中对应文本描述的物体分割出来。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9942863
2022-09-02 14:14:47 +08:00
jiangnana.jnn
1a22fa0222 fix trainer unittest
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9970626

    * fix trainer unittest
2022-09-02 14:06:08 +08:00
xianzhe.xxz
1bac4f3349 [to #42322933]add tinynas-detection pipeline and models
接入tinynas-detection,新增tinynas object detection pipeline以及tinynas models。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9938220
2022-09-02 13:10:31 +08:00
mulin.lyh
9e14d6727b [to #44571845]fix: ci support multiple image
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9974293
2022-09-02 11:02:43 +08:00
peter.lx
780330897a [to #42322933] add Deberta v2 modeling and fill_mask task, with master merged
add Deberta v2 modeling and fill_mask task, with master merged
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9966511
2022-09-01 22:17:14 +08:00
lllcho.lc
291f8fe68c [to #42322933] Add action-detection model
添加新的action-detection task
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9898947
2022-09-01 18:14:37 +08:00
行嗔
c546f2a8b9 Merge remote-tracking branch 'origin/master' into ofa/finetune
# Conflicts:
#	modelscope/preprocessors/multi_modal.py
2022-09-01 18:08:58 +08:00
行嗔
a3aee4bec2 test finetune 2022-09-01 18:02:07 +08:00
fubang.zfb
8f81807537 [to #42322933] 关系抽取
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9938140
2022-09-01 16:31:51 +08:00
pengyu.lpy
ce41ded423 [to #42322933]modify test_segmentation_pipeline.py for damo models
基于easycv上线的segformer,对应上传了5个对应的达摩院的分割模型,所以修正了tests/pipelines/easycv_pipelines/test_segmentation_pipeline.py内容让其能够便利测试
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9934634
2022-09-01 15:48:40 +08:00
yongfei.zyf
c8b6030b8e [to #42322933] Add hicossl_video_embedding_pipeline to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9969472
2022-09-01 14:20:04 +08:00
xuanjie.wxb
e5c9ded870 [to #42322933] add lstm-crf ner model code
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9901220

    * add lstm-crf ner model code
2022-09-01 09:19:59 +08:00
shuying.shu
a9deb3895c [to #42322933] movie scene segmentation模型接入
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9872869
2022-08-31 20:54:20 +08:00
Yingda Chen
681ea8cd17 [to #42322933] disable image diffusion tests 2022-08-31 12:57:14 +08:00
yuze.zyz
fbde374659 [to #42322933] add regress tests
Add regression test for some unit tests.
Firstly, Run a baseline test to create a pickle file which contains the inputs and outputs of modules, then changes can be observed between
the latest version and the baseline file.
Some baseline files are submitted in the data/test/regression folder
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9814693
2022-08-30 23:17:07 +08:00
xiangpeng.wxp
054151d92f [to #42322933]nlp_translation_preprocess
* nlp translation preprocess branch
 * pull the latest master
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9920445
2022-08-30 22:08:27 +08:00
mulin.lyh
12698b31a0 [to #44340132] fix: ci case run out of gpu memory 2022-08-30 17:59:15 +08:00
shichen.fsc
2b380f0410 [to #42322933] add new Task - document segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9942858

    * [Add] add document-segmentation
2022-08-30 15:30:00 +08:00
feiwu.yfw
2b64cf2bb6 [to #42322933]支持从dataset json文件中获取参数
* dataset json file add args
2022-08-30 15:15:15 +08:00