260 Commits

Author SHA1 Message Date
bin.xue
525fa3ea89 [to #42322933]test: use 'master' branch in training test
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10509580
2022-10-25 12:10:07 +08:00
行嗔
cc8b78eac8 update rdrop 2022-10-25 11:55:37 +08:00
行嗔
0c64d3fca5 Merge remote-tracking branch 'origin/ofa/finetune_loss' into ofa/finetune
# Conflicts:
#	tests/trainers/test_ofa_trainer.py
2022-10-25 11:48:03 +08:00
翎航
1bb1eeec77 fix ut 2022-10-25 10:55:24 +08:00
行嗔
2288a0fdf3 fix all comments 2022-10-25 10:18:33 +08:00
行嗔
df5bd86048 fix a ut bug 2022-10-25 10:15:06 +08:00
行嗔
9e3f035fa7 fix a ut bug 2022-10-25 10:13:48 +08:00
行嗔
d5b2dabaf5 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-25 10:13:02 +08:00
huizheng.hz
a1738690c9 [to #42322933]test_image_denoise_trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10465138
2022-10-25 10:08:57 +08:00
yingda.chen
de7b6a06e9 [to #42322933] remove revision usage for face detection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10507910

    * [to #42322933] remove revision usage for face detection
2022-10-25 09:28:01 +08:00
行嗔
cb9a2b9d10 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-25 00:52:52 +08:00
行嗔
85a7832d57 fix a typo 2022-10-25 00:52:35 +08:00
zhangyanzhao.zyz
c4dbb69d65 [to #42322933]增加对text-ranking任务中文模型的单元测试,以方便得到官方模型打标。
增加对text-ranking任务中文模型的单元测试,以方便得到官方模型打标。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492754
2022-10-24 23:41:20 +08:00
行嗔
46c3bdcfe8 fix a bug 2022-10-24 23:19:23 +08:00
翎航
73469b8400 fix loss&log 2022-10-24 19:44:04 +08:00
行嗔
1682ea7dec fix local path 2022-10-24 18:07:18 +08:00
行嗔
55fb3b05a9 format finetune code, and ut case 2022-10-23 21:29:17 +08:00
行嗔
44026e0bf8 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-23 10:36:46 +08:00
yuze.zyz
707cbef013 [to #42322933]Fix bug in daily UT
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491891
2022-10-22 23:25:18 +08:00
zhangyanzhao.zyz
824ee8232c [to #42322933]更新语义相关性任务英文名称为text ranking,修改对应变量名和类名
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491951
2022-10-22 17:12:48 +08:00
Yingda Chen
dee93c40e2 [to #42322933] force download dataset for portraint enhancement 2022-10-22 16:28:30 +08:00
行嗔
330a8ac68f Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-21 16:26:34 +08:00
baiguan.yt
533ab3df63 [to #42322933]update msdatasets for image-portrait-enhancement training
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10453584
2022-10-21 14:54:24 +08:00
翎航
9b8cfc4ece modify ofatrainer 2022-10-20 22:32:41 +08:00
Yingda Chen
b559ea50ca Merge remote-tracking branch 'origin' into ofa/finetune 2022-10-20 17:40:03 +08:00
yuze.zyz
acba1786b0 [to #42322933] Fix bug in UT daily
1. Fix bugs in daily test
2. Fix a bug that the updating of lr is before the first time of updating of optimizer
    TODO this will still cause warnings when GA is above 1
3. Remove the judgement of mode in text-classification's preprocessor to fit the base trainer(Bug)
     Update some regression bins to fit the preprocessor
4. Update the regression tool to let outer code modify atol and rtol
5. Add the default metric for text-classification task
6. Remove the useless ckpt conversion method in bert to avoid the requirement of tf when loading modeling_bert
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10430764
2022-10-20 15:29:34 +08:00
shouzhou.bx
01d521dd78 [to #42322933]add face 2d keypoints finetune test case
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421808

    * add face 2d keypoints & human wholebody keypoint finrtune test case
2022-10-20 11:51:52 +08:00
Yingda Chen
089cadab4b [to #42322933] disable unstable trainer test 2022-10-20 08:51:25 +08:00
行嗔
e76f5a96a3 fix comments 2022-10-19 17:34:59 +08:00
行嗔
8257e28a4f Merge remote-tracking branch 'origin/master' into ofa/finetune
# Conflicts:
#	modelscope/metrics/__init__.py
2022-10-18 16:41:21 +08:00
huizheng.hz
c0b546a96e [to #42322933]add subset_name when loading dataset (NAFNet image denoising)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10427797
2022-10-18 14:34:26 +08:00
hanyuan.chy
2d50c812df [to #42322933] support finetune on cv/hand_2d_keypoints
添加2d手部关键点检测finetune功能
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10371710
2022-10-13 13:48:11 +08:00
bin.xue
3863efc14d [to #42322933] add far field KWS trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10275823
2022-10-13 10:15:33 +08:00
yuxiang.tyx
2989492bc0 [to #42322933]更新face_detection_scrfd模型并支持finetune, 新增card_detection模型
1. 调整face_detection的文件层级(scrfd与其余新增face_detection方法平级);
2. 增加极大脸/旋转脸的检测方法,更新了新模型;
3. 支持读入数据集并finetune和eval;
4. 新增card_detection模型,支持读入datasethub数据集并finetune
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10244540
2022-10-12 19:58:50 +08:00
huizheng.hz
922f4c589b [to #42322933]图像去噪using msdataset to load dataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10338265
2022-10-11 22:46:30 +08:00
ashui.cbh
69da8f91ac [to #42322933]suport image inpainting
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10111615
2022-10-11 20:49:13 +08:00
laiyin.lyc
09d2296f36 [to #44847108] add sparsity hook (pst algorithm)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10198228

    * [to #44847108] add sparsity hook (pst algorithm)
2022-10-11 16:05:20 +08:00
行嗔
dbf022efe8 caption finetune done, add belu 2022-09-30 17:44:35 +08:00
行嗔
a0c57e1538 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-09-28 16:03:04 +08:00
行嗔
3b09d848ce update 2022-09-28 16:02:28 +08:00
yuze.zyz
357a233ee3 [to #42322933] fix bug: checkpoint hook and bestckpthook exists at the same time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10227608
2022-09-27 23:03:00 +08:00
行嗔
537827e5a1 Merge remote-tracking branch 'origin/master' into ofa/finetune
# Conflicts:
#	modelscope/models/multi_modal/ofa_for_all_tasks.py
#	modelscope/msdatasets/ms_dataset.py
#	modelscope/trainers/utils/inference.py
2022-09-25 16:35:08 +08:00
行嗔
d979b90439 Merge branch 'master' into ofa/finetune
# Conflicts:
#	modelscope/preprocessors/multi_modal.py
#	modelscope/trainers/trainer.py
#	tests/pipelines/test_ofa_tasks.py
2022-09-25 16:28:26 +08:00
jiangnana.jnn
1794e08af7 fix dist training
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10185634

    * fix dist training
2022-09-21 17:47:50 +08:00
行嗔
5d83f62312 mnli finetune done 2022-09-21 15:52:10 +08:00
wenmeng.zwm
6808e9a301 [to #44902099] add license for framework files
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10189613
2022-09-20 17:49:31 +08:00
yuze.zyz
4cdd0c23eb [to #42322933] Refactor and fix some bugs
1. Fix a bug in trainer's progress bar
2. Fix a bug that trainer does not support dataset in config file
3. Add feature: support go on training via checkpoint file
4. Add feature: support fixed filename when saving best checkpoint
5. Fix a bug that no id2label in config file after finetune of nlp models
6. Fix some other bugs
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10138906
2022-09-19 17:05:35 +08:00
wenmeng.zwm
7fb25d7bbb [to #42322933]fix UT error for 830 version
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10142442
2022-09-16 22:42:39 +08:00
jiangnana.jnn
adee5d10ae update EasyCV MsDataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10103248

    * update EasyCV MSDataset
2022-09-15 18:11:03 +08:00
dingkun.ldk
54e1a6d88b [to #42322933]830NLP 篇章排序/文本表示模型代码check
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9856179
2022-09-10 15:59:56 +08:00