Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-24 20:19:51 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,671 Commits 267 Branches 107 Tags
fix/trust_remote_code_
Commit Graph

1158 Commits

Author SHA1 Message Date
行嗔
5cf6910bed Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-09-05 20:48:41 +08:00
hemu.zp
3d3f9b4537 [to #42322933] fix checkpoint format 
1. 修复 palm，gpt3，mplug 模型存在的 finetune 后保存 checkpoint 与原有 checkpoint key 字段存在区别无法使用 from_pretrained 导入的问题
2. 调整 test_finetune_mplug.py 为只保存训练结束时的 checkpoint，减少 ci 耗时
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10016517
 2022-09-05 17:51:22 +08:00
liangting.zl
4484dcaa04 [to #42322933] feat: add hand keypoints pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9961906

    * feat: add hand keypoints pipeline
 2022-09-05 16:42:40 +08:00
mulin.lyh
042cff7d68 [to #44702084]fix: ci pip install domain in single commands, find with requirement install failed is complicated. 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10014958

    * [to #44702084]fix: ci pip install domain in single commands, find with requirement install failed is complicated.
 2022-09-05 16:08:50 +08:00
bin.xue
b870e4eed5 [to #42322933] test: use custom config to reduce test time 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10011826

、
 2022-09-05 13:26:30 +08:00
yuze.zyz
a9c14e4ead [to #42322933] Support saving the best checkpoint for inference 
1. Support saving the best checkpoint for inference
2. Fix a bug that _max_iters field does not exist in trainer
3. Fix a bug that function in lambda_lr field cannot be saved to file
4. Fix a bug that save_pretrained would not be called by iterating
5. Fix a bug that interval is not passed from BestCkptHook's init
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9972765
 2022-09-05 11:07:48 +08:00
ly261666
adab7d3391 [to #42322933] 新增FER人脸属性识别 
完成Maas-cv CR自查；
新增个Task，已经跟产品确认可以增加，正在走流程中，目前还不在https://aone.alibaba-inc.com/v2/project/1181559/req#viewIdentifier=d7f112f9d023e2108fa1b0d8这里，后续会增加过来
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9976346
 2022-09-05 09:53:58 +08:00
行嗔
db534fe946 add hf dataset 2022-09-04 16:08:25 +08:00
ly261666
f508be8918 [to #42322933] 新增RetinaFace人脸检测器 
1. 新增人脸检测RetinaFace模型；
2. 完成Maas-cv CR标准自查
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9945188
 2022-09-03 23:48:42 +08:00
xingguang.zxg
0451627626 [to #42322933]商品显著性分割v1.0 
商品显著性检测模型，依赖opencv，mmcv-full
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9909897
 2022-09-03 13:21:31 +08:00
Yingda Chen
39a309b655 [to #42322933] reduce train epoch from 3 to w 2022-09-03 12:18:52 +08:00
shouzhou.bx
4073376f51 [to #42322933]add face 2d keypoints by EasyCV 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9934673

    * add face 2d keypoints
 2022-09-02 20:53:29 +08:00
suluyan.sly
5a2634610a [to #42322933]skip sbert_en&bert_ch to save ci time 
![](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/251924/40165669611078357/image.png)
fill mask pipeline 测试时间过长

这个task测了4个模型。从保证代码正确性的功能角度看，只测一个bert类(比如sbert中文），一个roberta类（veco)。减少测试的模型数量以减少测试时长。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006556

    * skip sbert_en&bert_ch to save ci time
 2022-09-02 20:03:19 +08:00
xingguang.zxg
4d3716cf4e [to #42322933]文本指导的语义分割模型 
文本指导的语义分割模型，根据输入的文本信息，讲图像中对应文本描述的物体分割出来。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9942863
 2022-09-02 14:14:47 +08:00
jiangnana.jnn
1a22fa0222 fix trainer unittest 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9970626

    * fix trainer unittest
 2022-09-02 14:06:08 +08:00
xianzhe.xxz
1bac4f3349 [to #42322933]add tinynas-detection pipeline and models 
接入tinynas-detection，新增tinynas object detection pipeline以及tinynas models。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9938220
 2022-09-02 13:10:31 +08:00
mulin.lyh
9e14d6727b [to #44571845]fix: ci support multiple image 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9974293
 2022-09-02 11:02:43 +08:00
peter.lx
780330897a [to #42322933] add Deberta v2 modeling and fill_mask task, with master merged 
add Deberta v2 modeling and fill_mask task, with master merged
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9966511
 2022-09-01 22:17:14 +08:00
lllcho.lc
291f8fe68c [to #42322933] Add action-detection model 
添加新的action-detection task
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9898947
 2022-09-01 18:14:37 +08:00
行嗔
c546f2a8b9 Merge remote-tracking branch 'origin/master' into ofa/finetune 
# Conflicts:
#	modelscope/preprocessors/multi_modal.py
 2022-09-01 18:08:58 +08:00
行嗔
a3aee4bec2 test finetune 2022-09-01 18:02:07 +08:00
fubang.zfb
8f81807537 [to #42322933] 关系抽取 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9938140
 2022-09-01 16:31:51 +08:00
pengyu.lpy
ce41ded423 [to #42322933]modify test_segmentation_pipeline.py for damo models 
基于easycv上线的segformer，对应上传了5个对应的达摩院的分割模型，所以修正了tests/pipelines/easycv_pipelines/test_segmentation_pipeline.py内容让其能够便利测试
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9934634
 2022-09-01 15:48:40 +08:00
yongfei.zyf
c8b6030b8e [to #42322933] Add hicossl_video_embedding_pipeline to maas lib 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9969472
 2022-09-01 14:20:04 +08:00
xuanjie.wxb
e5c9ded870 [to #42322933] add lstm-crf ner model code 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9901220

    * add lstm-crf ner model code
 2022-09-01 09:19:59 +08:00
shuying.shu
a9deb3895c [to #42322933] movie scene segmentation模型接入 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9872869
 2022-08-31 20:54:20 +08:00
Yingda Chen
681ea8cd17 [to #42322933] disable image diffusion tests 2022-08-31 12:57:14 +08:00
yuze.zyz
fbde374659 [to #42322933] add regress tests 
Add regression test for some unit tests.
Firstly, Run a baseline test to create a pickle file which contains the inputs and outputs of modules, then changes can be observed between
the latest version and the baseline file.
Some baseline files are submitted in the data/test/regression folder
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9814693
 2022-08-30 23:17:07 +08:00
xiangpeng.wxp
054151d92f [to #42322933]nlp_translation_preprocess 
* nlp translation preprocess branch
 * pull the latest master
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9920445
 2022-08-30 22:08:27 +08:00
mulin.lyh
12698b31a0 [to #44340132] fix: ci case run out of gpu memory 2022-08-30 17:59:15 +08:00
shichen.fsc
2b380f0410 [to #42322933] add new Task - document segmentation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9942858

    * [Add] add document-segmentation
 2022-08-30 15:30:00 +08:00
feiwu.yfw
2b64cf2bb6 [to #42322933]支持从dataset json文件中获取参数 
* dataset json file add args
 2022-08-30 15:15:15 +08:00
shichen.fsc
745bd5a9e0 [to #42322933] remove some unittest about asr 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9941890
 2022-08-30 14:28:25 +08:00
yuze.zyz
88d0804dcd [to #42322933] Add S4: child-tuning 
1. add child-tuning optimizer and ut
2. fix a training bug which can cause interruption after cross-evaluation
3. move model.params from cfg to default args in build_optimizer to prevent the saving of params in save_pretrained
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9891963
 2022-08-30 10:52:07 +08:00
hemu.zp
a9089570e5 [to #42322933] Add mplug retrieval pipeline and finetune 
支持 MPLUG 模型 image-text-retrieval 任务的 pipeline 和 finetune
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9919955
 2022-08-30 10:50:52 +08:00
bin.xue
3e66244c0d [to #42322933] Add ANS trainer 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9892528
 2022-08-30 10:23:22 +08:00
eniac.xcw
8c9348de2c [to #42322933]add team model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9908976
 2022-08-30 10:07:39 +08:00
hanyuan.chy
00b448a2fe [to #42322933] support 3d body keypoints 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9862567
 2022-08-27 14:11:30 +08:00
leyuan.hjy
285192850d [to #42322933] feat(RealtimeObjectDetection):新增实时检测pipeline 
新增实时目标检测pipeline
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9788299
 2022-08-27 10:48:56 +08:00
feiwu.yfw
39485426e7 [to #42322933]:fix msdataset 
* 修复了zip文件不同打包模式下返回路径错误问题。
* 修复了替换了数据集文件重新下载时校验失败问题。
* 修复dataset oss文件在 REUSE 模式下重复下载的问题。
* 修复了csv数据集的meta json文件中某个split的meta和file字段都为''时加载所有split失败的问题。
 * 修复了不同版本datasets路径不一致的问题。
 2022-08-26 22:41:13 +08:00
hemu.zp
20a935d406 [to #42322933] add gpt3 base finetune 
添加 gpt3 中小模型单机单卡下的 finetune 代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9899004
 2022-08-26 14:54:45 +08:00
jiangnana.jnn
930d55d9ad support EasyCV framework and add Segformer model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9781849

    * support EasyCV
 2022-08-26 13:58:50 +08:00
tanfan.zjh
dc45fce542 [to #42322933]新增FAQ问答模型 
Maas新增FAQ问答模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9797053
 2022-08-26 13:06:41 +08:00
xingjun.wxj
44033290d4 [to #42322933]MsDataset 支持上传数据集压缩包和meta 
1. MsDataset支持upload数据文件(压缩包)
2. MsDataset支持clone和upload meta data
3. 使用MsDataset.load()下载数据集，支持web端显示数据集下载计数
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9831232
 2022-08-25 22:28:10 +08:00
james.wjg
8ac65d5586 [to #42322933] video_summarization 修改test中的结果可视化 
video_summarization 修改test中的结果可视化
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9902499
 2022-08-25 22:00:03 +08:00
hemu.zp
b92e2ca0a0 [to #42322933] add vqa and caption finetuning for mplug 
添加 mplug 模型 caption 及 vqa 任务的 finetuning 支持
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9858028
 2022-08-25 21:26:51 +08:00
tianchu.gtc
0b6725add6 [to #42322933]semantic segmentation 模型接入 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9851374
 2022-08-25 15:50:24 +08:00
zhangzhicheng.zzc
b94bb74f66 [to #42322933]Add model.save_pretrained method and allow finetune results used by pipeline 2022-08-24 21:39:08 +08:00
wenmeng.zwm
c72e5f4ae8 [to #43878347] skip device placement test 
skip this test which will result in too much debug log for placement although debug level is canceled after this test case

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9875987
 2022-08-24 15:08:22 +08:00
tianchu.gtc
cdebef4689 [to #42322933]panoptic segmentation 模型接入 
panoptic segmentation 模型接入
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9758389
 2022-08-24 15:05:16 +08:00