Commit Graph

1961 Commits

Author SHA1 Message Date
wenmeng.zwm
e2bf864f63 update audio requirements to use funasr>=0.1.4 2022-12-07 11:37:38 +08:00
wenmeng.zwm
4cba118f16 bump version to 1.1.0 2022-12-07 11:37:38 +08:00
wenmeng.zwm
6ae8cc5cf4 update publish.yaml 2022-12-07 00:11:54 +08:00
wenmeng.zwm
9c79bab432 update publish.yaml 2022-12-07 00:09:05 +08:00
wenmeng.zwm
bf2832c451 update publish workflow 2022-12-07 00:01:14 +08:00
wenmeng.zwm
b1205989ca update release workflow 2022-12-06 23:38:30 +08:00
wenmeng.zwm
e80bcca36d add debug workflow 2022-12-06 23:25:56 +08:00
wenmeng.zwm
2c295e67e4 update release workflow 2022-12-06 22:59:59 +08:00
wenmeng.zwm
0c93b3bda2 add release workflow 2022-12-06 22:35:17 +08:00
shiyi.zxh
c3a494e46d [to #42322933]
enable finetune of ofa-mmspeech 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10981972
2022-12-06 20:58:49 +08:00
yuze.zyz
a0d2581028 Fix gpt_neo decode
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10985686
2022-12-06 12:29:42 +08:00
pangda
5fd3e7bb43 [to #42322933] Add early stop hook 2022-12-06 10:54:47 +08:00
xuanjie.wxb
a3a942352e support prompt ner
修改preprocessor增加对prompt模型的支持。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10972542
2022-12-06 10:39:37 +08:00
ly261666
ed23d460d5 [to #42322933] Add facial landmark confidence model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10780109
2022-12-05 21:07:35 +08:00
yuze.zyz
bf97dd7501 Fix dist judgement when torch.distributed.is_available is always False
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10976015
2022-12-05 19:46:36 +08:00
ly261666
262f738460 [to #42322933] add FairFace face attribute model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10726376
2022-12-05 17:20:48 +08:00
wenmeng.zwm
d68d66f8c1 fix redundant log when using distributed training using pytorch
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10959078
2022-12-05 17:14:46 +08:00
mulin.lyh
892a237918 [to #46549395]fix: fix http_get_file headers is None, will exception
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10973267
2022-12-05 16:58:11 +08:00
suluyan.sly
c36b1cce8a [to #42322933] fix for plug
1. update pipeline for new preprocessor
2. update trainer for dist_info (remove megatron-ddp wapper)

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10969594
2022-12-05 14:34:21 +08:00
ly261666
9d43823f36 [to #42322933] add TinyMogFace face detector
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10792564
2022-12-05 12:01:26 +08:00
baiguan.yt
ce0480f7ed update image-portait-enhancement trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10717891
2022-12-05 11:43:52 +08:00
hemu.zp
941dbe75cf [to #42322933] Add GPT-3 tensor parallel finetuning
Add GPT-3 tensor parallel finetuning, adjust some distributed codes to make tensor and data parallel compatible.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10949507
2022-12-05 10:01:32 +08:00
jiangyu.xzy
db7c5d1494 asr 统一接口,支持conformer和uniasr模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10964641

    * support new asr paraformer model

* support asr conformer model

* add new asr model tests

* fix format

* support new in params

* fix conflict

* type fix

* fix conflict
2022-12-05 09:59:55 +08:00
pangda
54d219e90b [to #42322933] add UT for NER&EL models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10897188
2022-12-04 15:53:32 +08:00
hemu.zp
346da3d489 [to #42322933] Add mplug pretrained model
Add pre-trained models for mplug finetuning.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10963691
2022-12-04 15:27:50 +08:00
ly261666
492aa98d9a [to #42322933] Add face mask model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10897202

    * [to #42322933] 新增ArcFace人脸识别模型
2022-12-04 15:25:27 +08:00
Yingda Chen
c95dbf3ee7 Merge pull request #45 from co63oc/test1
typo fix, no code change
2022-12-04 12:34:50 +08:00
wenmeng.zwm
82af080c18 upate git-lfs install instruction
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10963252

    * upate git-lfs install instruction
2022-12-03 17:42:20 +08:00
chenxujun
99507a5cc6 Fix some words 2022-12-03 14:39:55 +08:00
dingkun.ldk
000976836f 1130中文分词/词性标注新增LSTM轻量化模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10931263
2022-12-03 13:15:33 +08:00
Yingda Chen
b796020fc1 Merge pull request #39 from co63oc/patch-1
Update modelscope_env_init.sh

no code change, gated tests run not require.d
2022-12-03 11:35:26 +08:00
Yingda Chen
33934fccf7 Merge pull request #40 from co63oc/patch-2
Update develop.md

no code change, gated tests not required.
2022-12-03 11:34:09 +08:00
Yingda Chen
22417100c7 Merge pull request #41 from co63oc/patch-3
Update faq.md

no code change, merge without gated tests.
2022-12-03 11:26:25 +08:00
chenxujun
ea5c2a2155 Update faq.md
Fix typo
2022-12-03 08:53:55 +08:00
chenxujun
79da49e078 Update develop.md
Fix typo
2022-12-03 08:50:51 +08:00
yichang.zyc
90034236ab ofa asr support url 2022-12-03 08:49:11 +08:00
chenxujun
d510683475 Update modelscope_env_init.sh
Fix typo
2022-12-03 06:59:31 +08:00
jinmao.yk
d84a1df65a add video human matting task code
add video human matting task code
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10839854
2022-12-02 19:44:01 +08:00
mulin.lyh
b293095bd0 [to #46522320]fix: fix download file timeout too short
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10961023

    * [to #46522320]fix: fix download file timeout too short
2022-12-02 19:41:59 +08:00
wanggui.hwg
e8608df930 Add support for UniTE
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10909489
2022-12-02 18:15:02 +08:00
hemu.zp
8184c86c5f [to #42322933] Fix bug for text generation task model
Fixed the bug for generate method in TaskModelForTextGeneration, which was unavailable due to the upgrade of the transformers library to version 4.24.0

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10791805
2022-12-02 17:52:19 +08:00
ly119399
2f17daa23f [to #42322933] reduce the GPU usage of dialog trianer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10955485
2022-12-02 17:32:26 +08:00
suluyan.sly
2863a8f7fa [to #42322933] fix hook.__init__
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10957489

* fix hook.__init__
2022-12-02 17:09:06 +08:00
yuze.zyz
348e87e697 change sequence_length to max_length
To cooperate with other tokenizing args, change sequence_length to max_length, meanwhile making the input args compatible with old 'sequence_length' arg.
2022-12-02 16:57:09 +08:00
ly261666
4208d51e23 substitute face detection model in skin_retouching_pipeline.py
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10909902
2022-12-02 15:41:08 +08:00
wenmeng.zwm
c9a6b887a2 add tensorboard hook for visualization
1. add tensorboard hook to default config
2. add image visualization support to tensorboard hook and trainer
3. move evaluation logic out of single_gpu_test and multi_gpu_test to make prediction results available for further processing such as result saving and visualization.

visualization results are as follows:
![image.png](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/29212/38448470860386707/image.png)
![image.png](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/29212/38437794200606734/image.png)
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10894813
2022-12-02 15:13:24 +08:00
ziyuan.tw
31316b8d29 add nextvit-small_image-classification_Dailylife-labels model
支持1130新上线模.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10886253
2022-12-02 14:46:49 +08:00
ly119399
5ae1e08db6 [to #42322933] fix bug of tableQA on gpu
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10943053
2022-12-02 10:38:30 +08:00
zhangzhicheng.zzc
a318f27247 [to #42322933] speed up the ast indexing during editing
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10907357
2022-12-02 10:06:24 +08:00
yuze.zyz
0e4766f41d Fix bugs in testlevel1 & 2
1. Fix: ws regression failed.
2. Fix: label2id missing in text_classification_pipeline when preprocessor is passed in through args.
3. Fix: remove obsolete imports
4. Fix: incomplete modification
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10936431
2022-12-01 21:16:55 +08:00