Commit Graph

1176 Commits

Author SHA1 Message Date
shichen.fsc
745bd5a9e0 [to #42322933] remove some unittest about asr
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9941890
2022-08-30 14:28:25 +08:00
yuze.zyz
88d0804dcd [to #42322933] Add S4: child-tuning
1. add child-tuning optimizer and ut
2. fix a training bug which can cause interruption after cross-evaluation
3. move model.params from cfg to default args in build_optimizer to prevent the saving of params in save_pretrained
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9891963
2022-08-30 10:52:07 +08:00
hemu.zp
a9089570e5 [to #42322933] Add mplug retrieval pipeline and finetune
支持 MPLUG 模型 image-text-retrieval 任务的 pipeline 和 finetune
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9919955
2022-08-30 10:50:52 +08:00
bin.xue
3e66244c0d [to #42322933] Add ANS trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9892528
2022-08-30 10:23:22 +08:00
eniac.xcw
8c9348de2c [to #42322933]add team model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9908976
2022-08-30 10:07:39 +08:00
hanyuan.chy
00b448a2fe [to #42322933] support 3d body keypoints
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9862567
2022-08-27 14:11:30 +08:00
leyuan.hjy
285192850d [to #42322933] feat(RealtimeObjectDetection):新增实时检测pipeline
新增实时目标检测pipeline
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9788299
2022-08-27 10:48:56 +08:00
feiwu.yfw
39485426e7 [to #42322933]:fix msdataset
* 修复了zip文件不同打包模式下返回路径错误问题。
* 修复了替换了数据集文件重新下载时校验失败问题。
* 修复dataset oss文件在 REUSE 模式下重复下载的问题。
* 修复了csv数据集的meta json文件中某个split的meta和file字段都为''时加载所有split失败的问题。
 * 修复了不同版本datasets路径不一致的问题。
2022-08-26 22:41:13 +08:00
hemu.zp
20a935d406 [to #42322933] add gpt3 base finetune
添加 gpt3 中小模型单机单卡下的 finetune 代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9899004
2022-08-26 14:54:45 +08:00
jiangnana.jnn
930d55d9ad support EasyCV framework and add Segformer model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9781849

    * support EasyCV
2022-08-26 13:58:50 +08:00
tanfan.zjh
dc45fce542 [to #42322933]新增FAQ问答模型
Maas新增FAQ问答模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9797053
2022-08-26 13:06:41 +08:00
xingjun.wxj
44033290d4 [to #42322933]MsDataset 支持上传数据集压缩包和meta
1. MsDataset支持upload数据文件(压缩包)
2. MsDataset支持clone和upload meta data
3. 使用MsDataset.load()下载数据集,支持web端显示数据集下载计数
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9831232
2022-08-25 22:28:10 +08:00
james.wjg
8ac65d5586 [to #42322933] video_summarization 修改test中的结果可视化
video_summarization 修改test中的结果可视化
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9902499
2022-08-25 22:00:03 +08:00
hemu.zp
b92e2ca0a0 [to #42322933] add vqa and caption finetuning for mplug
添加 mplug 模型 caption 及 vqa 任务的 finetuning 支持
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9858028
2022-08-25 21:26:51 +08:00
tianchu.gtc
0b6725add6 [to #42322933]semantic segmentation 模型接入
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9851374
2022-08-25 15:50:24 +08:00
zhangzhicheng.zzc
b94bb74f66 [to #42322933]Add model.save_pretrained method and allow finetune results used by pipeline 2022-08-24 21:39:08 +08:00
wenmeng.zwm
c72e5f4ae8 [to #43878347] skip device placement test
skip this test which will result in too much debug log for placement although debug level is canceled after this test case

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9875987
2022-08-24 15:08:22 +08:00
tianchu.gtc
cdebef4689 [to #42322933]panoptic segmentation 模型接入
panoptic segmentation 模型接入
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9758389
2022-08-24 15:05:16 +08:00
james.wjg
5f326e46f3 cv/video_summarization
新增video summarization模型的inference和finetune
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9840532
2022-08-24 13:41:47 +08:00
zhangzhicheng.zzc
5b0b54633b [to #42322933]compatible with windows path on only core parts
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9855254
2022-08-24 13:35:42 +08:00
yingda.chen
04bb8061e6 [to #42322933]move postprocess helper into utilities
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9856286
2022-08-23 14:27:19 +08:00
Yingda Chen
63233c2122 Revert "[to #42322933]move postprocess helper into utilities"
This reverts commit 4cc0395ac5.
2022-08-23 12:13:15 +08:00
Yingda Chen
4cc0395ac5 [to #42322933]move postprocess helper into utilities 2022-08-23 12:11:49 +08:00
lee.lcy
9c4765923a [to #42322933] add image-reid-person
add image-reid-person
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9818427
2022-08-22 21:57:05 +08:00
wenmeng.zwm
aaa604cb16 [to #43878347] device placement support certain gpu
1. add device util to verify, create and place device
2. pipeline and trainer support update
3.  fix pipeline which use tf models does not place model to the right device

usage

```python
pipe = pipeline('damo/xxx', device='cpu')
pipe = pipeline('damo/xxx', device='gpu')
pipe = pipeline('damo/xxx', device='gpu:0')
pipe = pipeline('damo/xxx', device='gpu:2')
pipe = pipeline('damo/xxx', device='cuda')
pipe = pipeline('damo/xxx', device='cuda:1')
```
 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9800672
2022-08-22 15:32:00 +08:00
yuanzhi.zyz
4b501dd44a [to #42322933]ocr-recognition re-upload
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9826159
2022-08-19 19:02:27 +08:00
lanjinpeng.ljp
c6db966a99 [to #42322933]support video-single-object-tracking
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9781254

    * support single object tracking
2022-08-19 15:55:58 +08:00
Yingda Chen
df4f1a538d [to #42322933]disable ocr test temporarily 2022-08-19 14:01:06 +08:00
wenmeng.zwm
e85b27107e [to #44236829] import nlp preprocessor to make UT run successfully while igoring ast scanning error 2022-08-19 10:24:21 +08:00
hemu.zp
161555f97d [to #42322933] add mplug image-caption
添加 MPLUG 模型 image-captioning 任务
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9745826
2022-08-18 11:03:20 +08:00
feiwu.yfw
35548bd492 [to #43875101]
msdataset add coco dataset
unify taskdataset and ms dataset
fix hf datasets
2022-08-17 22:51:22 +08:00
jiangnana.jnn
cfc3d1eed7 fix trainer about iters_per_epoch
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9791200

    * fix trainer about iters_per_epoch
2022-08-17 20:06:25 +08:00
ya235025
4c08bd752a [to #42322933]更新中文CLIP模型inference代码
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9763330
2022-08-17 18:40:55 +08:00
bin.xue
d0933a2374 [to #42322933] add far field kws model pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9767151
2022-08-16 20:23:55 +08:00
jiangnana.jnn
76482cc3ea [to #43850241] fix processor and collate_fn
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9644184

    * fix ditributed training and eval
2022-08-16 12:04:07 +08:00
wendi.hwd
d3fac4f5be [to #42322933] support salient detection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9722903
2022-08-16 09:15:53 +08:00
ashui.cbh
8ce641fd0c [to #42322933]create utils/cv/heatmap
根据反馈 将用到的util_func 放入modelscope/utils/cv 下
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9759481
2022-08-15 18:14:11 +08:00
ashui.cbh
c2edc29776 [to #42322933] support crowd-counting
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9728416
2022-08-12 17:46:42 +08:00
mulin.lyh
c57c91c359 [to #44031139]fix: fix hub ci case delete test project failure
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9736416

    * [to #44031139]fix: fix hub ci case delete test project failure
2022-08-12 13:56:47 +08:00
piaoyu.lxy
2dc3286524 [to #42322933] add conversational_text_to_sql pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9580066
2022-08-11 11:19:11 +08:00
yaoxiong.hyx
69c57e0f55 [to #42322933]support ocr_recognition
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9592902
2022-08-10 16:42:09 +08:00
Yingda Chen
df6bb3deaf [to #42322933] update tts model id 2022-08-10 15:42:48 +08:00
ly119399
16139cefb6 [to #42322933] modify space task name 2022-08-10 14:27:47 +08:00
hemu.zp
59c5dd8dfe [to #42322933] remove sep token at the end of tokenizer output
generate 时去除 tokenizer 输出结尾的 sep,修复 gpt3 模型目前续写内容与上文无关的 bug
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9696570
2022-08-10 13:46:23 +08:00
shouzhou.bx
ac1ba2a0e0 [to #42322933]bugfix : add PIL image type support and model.to(devices) for body_2d_keypoints ipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9684583
2022-08-09 18:07:09 +08:00
mulin.lyh
3272b2755c [to #43909247]fix: access token in code, move to environment
move access token to environment variable.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9681287

    * [to #43909247]fix: access token in code, move to environment
2022-08-09 17:46:56 +08:00
dangwei.ldw
5fcb8e2342 [to #42322933]fix onnx thread error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9669460

    * fix onnx thread error
2022-08-09 17:46:24 +08:00
yichang.zyc
5cbd9ff8fd [to #42322933]replace clip modelid
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9691512
2022-08-09 17:31:30 +08:00
yingda.chen
5ea690d743 [to #42322933]split text generation tests
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9684735

    * split test generation tests
2022-08-09 17:01:53 +08:00
mulin.lyh
578f82e501 [to #43887377]fix: sdk api concurrent call snapshort download file will conflict
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9672696

    * [to #43887377]fix: sdk api concurrent call snapshort download file  will conflict
2022-08-08 17:19:30 +08:00