Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-24 12:10:09 +01:00
Code Issues Packages Projects Releases Wiki Activity
513 Commits 267 Branches 107 Tags
fbde374659b31466f48124c79cc26c852553ca9f
Commit Graph

513 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yuze.zyz
fbde374659 [to #42322933] add regress tests 
Add regression test for some unit tests.
Firstly, Run a baseline test to create a pickle file which contains the inputs and outputs of modules, then changes can be observed between
the latest version and the baseline file.
Some baseline files are submitted in the data/test/regression folder
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9814693
 2022-08-30 23:17:07 +08:00
xiangpeng.wxp
054151d92f [to #42322933]nlp_translation_preprocess 
* nlp translation preprocess branch
 * pull the latest master
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9920445
 2022-08-30 22:08:27 +08:00
mulin.lyh
12698b31a0 [to #44340132] fix: ci case run out of gpu memory 2022-08-30 17:59:15 +08:00
shichen.fsc
2b380f0410 [to #42322933] add new Task - document segmentation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9942858

    * [Add] add document-segmentation
 2022-08-30 15:30:00 +08:00
feiwu.yfw
2b64cf2bb6 [to #42322933]支持从dataset json文件中获取参数 
* dataset json file add args
 2022-08-30 15:15:15 +08:00
shichen.fsc
745bd5a9e0 [to #42322933] remove some unittest about asr 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9941890
 2022-08-30 14:28:25 +08:00
yuze.zyz
88d0804dcd [to #42322933] Add S4: child-tuning 
1. add child-tuning optimizer and ut
2. fix a training bug which can cause interruption after cross-evaluation
3. move model.params from cfg to default args in build_optimizer to prevent the saving of params in save_pretrained
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9891963
 2022-08-30 10:52:07 +08:00
hemu.zp
a9089570e5 [to #42322933] Add mplug retrieval pipeline and finetune 
支持 MPLUG 模型 image-text-retrieval 任务的 pipeline 和 finetune
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9919955
 2022-08-30 10:50:52 +08:00
bin.xue
3e66244c0d [to #42322933] Add ANS trainer 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9892528
 2022-08-30 10:23:22 +08:00
eniac.xcw
8c9348de2c [to #42322933]add team model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9908976
 2022-08-30 10:07:39 +08:00
hanyuan.chy
00b448a2fe [to #42322933] support 3d body keypoints 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9862567
 2022-08-27 14:11:30 +08:00
leyuan.hjy
285192850d [to #42322933] feat(RealtimeObjectDetection):新增实时检测pipeline 
新增实时目标检测pipeline
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9788299
 2022-08-27 10:48:56 +08:00
feiwu.yfw
39485426e7 [to #42322933]:fix msdataset 
* 修复了zip文件不同打包模式下返回路径错误问题。
* 修复了替换了数据集文件重新下载时校验失败问题。
* 修复dataset oss文件在 REUSE 模式下重复下载的问题。
* 修复了csv数据集的meta json文件中某个split的meta和file字段都为''时加载所有split失败的问题。
 * 修复了不同版本datasets路径不一致的问题。
 2022-08-26 22:41:13 +08:00
hemu.zp
20a935d406 [to #42322933] add gpt3 base finetune 
添加 gpt3 中小模型单机单卡下的 finetune 代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9899004
 2022-08-26 14:54:45 +08:00
jiangnana.jnn
930d55d9ad support EasyCV framework and add Segformer model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9781849

    * support EasyCV
 2022-08-26 13:58:50 +08:00
tanfan.zjh
dc45fce542 [to #42322933]新增FAQ问答模型 
Maas新增FAQ问答模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9797053
 2022-08-26 13:06:41 +08:00
wenmeng.zwm
52f581d7d5 [to #43115513] bump version to 0.3.7 2022-08-26 11:52:52 +08:00
pangda
83b0adf0a2 [to #42322933] fix bug for multi-lang text 
支持多语言tokenize（830模型）
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9900916
 2022-08-25 23:04:14 +08:00
xingjun.wxj
44033290d4 [to #42322933]MsDataset 支持上传数据集压缩包和meta 
1. MsDataset支持upload数据文件(压缩包)
2. MsDataset支持clone和upload meta data
3. 使用MsDataset.load()下载数据集，支持web端显示数据集下载计数
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9831232
 2022-08-25 22:28:10 +08:00
james.wjg
8ac65d5586 [to #42322933] video_summarization 修改test中的结果可视化 
video_summarization 修改test中的结果可视化
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9902499
 2022-08-25 22:00:03 +08:00
hemu.zp
b92e2ca0a0 [to #42322933] add vqa and caption finetuning for mplug 
添加 mplug 模型 caption 及 vqa 任务的 finetuning 支持
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9858028
 2022-08-25 21:26:51 +08:00
tianchu.gtc
0b6725add6 [to #42322933]semantic segmentation 模型接入 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9851374
 2022-08-25 15:50:24 +08:00
zhangzhicheng.zzc
b94bb74f66 [to #42322933]Add model.save_pretrained method and allow finetune results used by pipeline 2022-08-24 21:39:08 +08:00
menrui.mr
427f0e83ea [to #42322933]ofa文生图接入clip reranking后处理 & 修复预处理中的一个Bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9880918
 2022-08-24 19:06:29 +08:00
xixing.tj
7da07a8370 [to #42322933]ocr_detection pipeline jupyter环境bug fix 
ocr_detection pipeline jupyter环境优化
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9876662
 2022-08-24 15:30:38 +08:00
wenmeng.zwm
c72e5f4ae8 [to #43878347] skip device placement test 
skip this test which will result in too much debug log for placement although debug level is canceled after this test case

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9875987
 2022-08-24 15:08:22 +08:00
tianchu.gtc
cdebef4689 [to #42322933]panoptic segmentation 模型接入 
panoptic segmentation 模型接入
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9758389
 2022-08-24 15:05:16 +08:00
james.wjg
5f326e46f3 cv/video_summarization 
新增video summarization模型的inference和finetune
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9840532
 2022-08-24 13:41:47 +08:00
zhangzhicheng.zzc
5b0b54633b [to #42322933]compatible with windows path on only core parts 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9855254
 2022-08-24 13:35:42 +08:00
wenmeng.zwm
0128d44517 [to #43115513] remove additional empty section header 2022-08-23 19:30:51 +08:00
lanjinpeng.ljp
8820782d42 fix file header in video-single-object-tracking 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9857596
 2022-08-23 15:16:54 +08:00
yingda.chen
04bb8061e6 [to #42322933]move postprocess helper into utilities 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9856286
 2022-08-23 14:27:19 +08:00
Yingda Chen
63233c2122 Revert "[to #42322933]move postprocess helper into utilities" 
This reverts commit 4cc0395ac5.
 2022-08-23 12:13:15 +08:00
Yingda Chen
4cc0395ac5 [to #42322933]move postprocess helper into utilities 2022-08-23 12:11:49 +08:00
lee.lcy
9c4765923a [to #42322933] add image-reid-person 
add image-reid-person
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9818427
 2022-08-22 21:57:05 +08:00
mulin.lyh
01bb751425 [to #43653669]feat: auto build docker images 
auto build docker images
aone 任务： https://test.aone.alibaba-inc.com/jobs/1824567?buildId=143470479
修改任务分支
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9566518

    * [to #43653669]feat: auto build docker images
 2022-08-22 16:01:42 +08:00
wenmeng.zwm
aaa604cb16 [to #43878347] device placement support certain gpu 
1. add device util to verify, create and place device
2. pipeline and trainer support update
3.  fix pipeline which use tf models does not place model to the right device

usage

```python
pipe = pipeline('damo/xxx', device='cpu')
pipe = pipeline('damo/xxx', device='gpu')
pipe = pipeline('damo/xxx', device='gpu:0')
pipe = pipeline('damo/xxx', device='gpu:2')
pipe = pipeline('damo/xxx', device='cuda')
pipe = pipeline('damo/xxx', device='cuda:1')
```
 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9800672
 2022-08-22 15:32:00 +08:00
yuanzhi.zyz
4b501dd44a [to #42322933]ocr-recognition re-upload 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9826159
 2022-08-19 19:02:27 +08:00
lanjinpeng.ljp
c6db966a99 [to #42322933]support video-single-object-tracking 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9781254

    * support single object tracking
 2022-08-19 15:55:58 +08:00
zhangzhicheng.zzc
67af7ee4fc [to #44236829] record classname as default module name during ast-scanning 2022-08-19 15:11:39 +08:00
Yingda Chen
df4f1a538d [to #42322933]disable ocr test temporarily 2022-08-19 14:01:06 +08:00
wenmeng.zwm
e85b27107e [to #44236829] import nlp preprocessor to make UT run successfully while igoring ast scanning error 2022-08-19 10:24:21 +08:00
hemu.zp
161555f97d [to #42322933] add mplug image-caption 
添加 MPLUG 模型 image-captioning 任务
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9745826
 2022-08-18 11:03:20 +08:00
feiwu.yfw
35548bd492 [to #43875101] 
msdataset add coco dataset
unify taskdataset and ms dataset
fix hf datasets
 2022-08-17 22:51:22 +08:00
piaoyu.lxy
87290ed6f0 [to #42322933] fix punkt file 
删除模型仓库中多余的文件，只保留punkt.zip文件，运行时解压
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9800149
 2022-08-17 21:16:13 +08:00
jiangnana.jnn
cfc3d1eed7 fix trainer about iters_per_epoch 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9791200

    * fix trainer about iters_per_epoch
 2022-08-17 20:06:25 +08:00
ya235025
4c08bd752a [to #42322933]更新中文CLIP模型inference代码 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9763330
 2022-08-17 18:40:55 +08:00
lingchen.zlm
01ec568ce1 [to #42322933] inference speedup for multimodal model GEMM 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9786728
 2022-08-17 15:53:54 +08:00
bin.xue
d0933a2374 [to #42322933] add far field kws model pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9767151
 2022-08-16 20:23:55 +08:00
wenmeng.zwm
f47a51d3cf [to #43115513] bump version to 0.3.5 2022-08-16 17:40:37 +08:00