1118 Commits

Author SHA1 Message Date
mulin.lyh
ef1296ab21 release 1.1.3 v1.1.3 2022-12-21 13:46:01 +08:00
mulin.lyh
9e8d7bed6a [to #46852519]fix: fix useragent string and a trainer invokedby
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11164288

    * [to #46852519]fix: fix useragent string and a trainer invokedby
2022-12-21 08:29:57 +08:00
mulin.lyh
02aa5f1e42 [to #46852519]fix: statistics header not correct set
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11160051

    * [to #46852519]fix: statistics header not correct set
2022-12-21 06:29:12 +08:00
wenmeng.zwm
c1d297260d Merge branch 'release/1.1' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into release/1.1 2022-12-14 21:55:01 +08:00
xingjun.wxj
42f060172d [to #42322933] Fix timeout issue for uni-fold list_oss_objects api
1. 下载uni-fold数据集,因为包含百万以上的objects,在调用list_objects接口时需要至少300s,所以全量下载数据集时 有用户反馈报超时错误
2. 目前hub api中因为采用了统一的self.session.get接口,默认timeout被设置为了60s
3. 修改timeout=1800

link:  https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11097756
2022-12-14 21:53:59 +08:00
wenmeng.zwm
9011ebe051 bump version to 1.1.2 v1.1.2 2022-12-12 10:20:31 +08:00
jiangyu.xzy
a3f3f90d68 fix demo service dataloader bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11049894

    * fix dataloader bug

* fix dataloader bug
2022-12-12 10:19:52 +08:00
wenmeng.zwm
8f8dc97c3a Merge branch 'release/1.1' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into release/1.1 2022-12-07 20:02:01 +08:00
jinmao.yk
c396ad556d fix log format to avoid misunderstanding
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11013023
v1.1.1
2022-12-07 19:04:51 +08:00
pangda
1c63578b53 fix save_pretrained & load_checkpoint bug in DDP mode
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11012439

    * fix save_pretrained & load_checkpoint bug in DDP mode
2022-12-07 18:48:26 +08:00
zhangzhicheng.zzc
cc5dd48598 [to #46619305] add kwargs in init method to allow additional kwargs 2022-12-07 18:47:11 +08:00
wanggui.hwg
d1f4b0509a [to #42322933] Fix bugs for UniTE
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11011725
2022-12-07 17:26:45 +08:00
mulin.lyh
ac93a82a77 [to #46604161]fix: git repository initialize lfs bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11005012
2022-12-07 13:17:14 +08:00
wenmeng.zwm
deaa4245c0 add project description 2022-12-07 13:17:14 +08:00
wenmeng.zwm
a8f70573a9 add project description 2022-12-07 13:17:14 +08:00
wenmeng.zwm
8582d2d32d bump versionto 1.1.1 and update release time 2022-12-07 11:53:07 +08:00
wenmeng.zwm
b224ec375b update setup.py 2022-12-07 11:51:10 +08:00
wenmeng.zwm
e1956f9f46 update audio requirements to use funasr>=0.1.4 2022-12-07 11:37:57 +08:00
wenmeng.zwm
3db8550a8e add release workflow for relase branch 2022-12-06 23:49:34 +08:00
yuze.zyz
d2e5aa9af3 Fix gpt_neo decode
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10985686
2022-12-06 13:36:43 +08:00
wenmeng.zwm
6d18bcffe0 Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into release/1.1 2022-12-05 22:03:47 +08:00
ly261666
ed23d460d5 [to #42322933] Add facial landmark confidence model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10780109
2022-12-05 21:07:35 +08:00
yuze.zyz
bf97dd7501 Fix dist judgement when torch.distributed.is_available is always False
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10976015
2022-12-05 19:46:36 +08:00
ly261666
262f738460 [to #42322933] add FairFace face attribute model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10726376
2022-12-05 17:20:48 +08:00
wenmeng.zwm
d68d66f8c1 fix redundant log when using distributed training using pytorch
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10959078
2022-12-05 17:14:46 +08:00
mulin.lyh
892a237918 [to #46549395]fix: fix http_get_file headers is None, will exception
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10973267
2022-12-05 16:58:11 +08:00
suluyan.sly
c36b1cce8a [to #42322933] fix for plug
1. update pipeline for new preprocessor
2. update trainer for dist_info (remove megatron-ddp wapper)

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10969594
2022-12-05 14:34:21 +08:00
ly261666
9d43823f36 [to #42322933] add TinyMogFace face detector
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10792564
2022-12-05 12:01:26 +08:00
baiguan.yt
ce0480f7ed update image-portait-enhancement trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10717891
2022-12-05 11:43:52 +08:00
hemu.zp
941dbe75cf [to #42322933] Add GPT-3 tensor parallel finetuning
Add GPT-3 tensor parallel finetuning, adjust some distributed codes to make tensor and data parallel compatible.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10949507
2022-12-05 10:01:32 +08:00
jiangyu.xzy
db7c5d1494 asr 统一接口,支持conformer和uniasr模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10964641

    * support new asr paraformer model

* support asr conformer model

* add new asr model tests

* fix format

* support new in params

* fix conflict

* type fix

* fix conflict
2022-12-05 09:59:55 +08:00
pangda
54d219e90b [to #42322933] add UT for NER&EL models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10897188
2022-12-04 15:53:32 +08:00
hemu.zp
346da3d489 [to #42322933] Add mplug pretrained model
Add pre-trained models for mplug finetuning.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10963691
2022-12-04 15:27:50 +08:00
ly261666
492aa98d9a [to #42322933] Add face mask model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10897202

    * [to #42322933] 新增ArcFace人脸识别模型
2022-12-04 15:25:27 +08:00
wenmeng.zwm
82af080c18 upate git-lfs install instruction
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10963252

    * upate git-lfs install instruction
2022-12-03 17:42:20 +08:00
dingkun.ldk
000976836f 1130中文分词/词性标注新增LSTM轻量化模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10931263
2022-12-03 13:15:33 +08:00
wenmeng.zwm
7d259c3a35 Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into release/1.1 2022-12-03 11:09:32 +08:00
yichang.zyc
90034236ab ofa asr support url 2022-12-03 08:49:11 +08:00
jinmao.yk
d84a1df65a add video human matting task code
add video human matting task code
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10839854
2022-12-02 19:44:01 +08:00
mulin.lyh
b293095bd0 [to #46522320]fix: fix download file timeout too short
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10961023

    * [to #46522320]fix: fix download file timeout too short
2022-12-02 19:41:59 +08:00
wanggui.hwg
e8608df930 Add support for UniTE
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10909489
2022-12-02 18:15:02 +08:00
hemu.zp
8184c86c5f [to #42322933] Fix bug for text generation task model
Fixed the bug for generate method in TaskModelForTextGeneration, which was unavailable due to the upgrade of the transformers library to version 4.24.0

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10791805
2022-12-02 17:52:19 +08:00
ly119399
2f17daa23f [to #42322933] reduce the GPU usage of dialog trianer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10955485
2022-12-02 17:32:26 +08:00
suluyan.sly
2863a8f7fa [to #42322933] fix hook.__init__
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10957489

* fix hook.__init__
2022-12-02 17:09:06 +08:00
yuze.zyz
348e87e697 change sequence_length to max_length
To cooperate with other tokenizing args, change sequence_length to max_length, meanwhile making the input args compatible with old 'sequence_length' arg.
2022-12-02 16:57:09 +08:00
ly261666
4208d51e23 substitute face detection model in skin_retouching_pipeline.py
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10909902
2022-12-02 15:41:08 +08:00
wenmeng.zwm
c9a6b887a2 add tensorboard hook for visualization
1. add tensorboard hook to default config
2. add image visualization support to tensorboard hook and trainer
3. move evaluation logic out of single_gpu_test and multi_gpu_test to make prediction results available for further processing such as result saving and visualization.

visualization results are as follows:
![image.png](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/29212/38448470860386707/image.png)
![image.png](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/29212/38437794200606734/image.png)
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10894813
2022-12-02 15:13:24 +08:00
ziyuan.tw
31316b8d29 add nextvit-small_image-classification_Dailylife-labels model
支持1130新上线模.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10886253
2022-12-02 14:46:49 +08:00
ly119399
5ae1e08db6 [to #42322933] fix bug of tableQA on gpu
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10943053
2022-12-02 10:38:30 +08:00
zhangzhicheng.zzc
a318f27247 [to #42322933] speed up the ast indexing during editing
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10907357
2022-12-02 10:06:24 +08:00