Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-07-10 12:33:28 +02:00
Code Issues Packages Projects Releases Wiki Activity
1,961 Commits 275 Branches 121 Tags
bug/example_bug_fixed
Commit Graph

250 Commits

Author SHA1 Message Date
行嗔
cb9a2b9d10 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-25 00:52:52 +08:00
行嗔
85a7832d57 fix a typo 2022-10-25 00:52:35 +08:00
zhangyanzhao.zyz
c4dbb69d65 [to #42322933]增加对text-ranking任务中文模型的单元测试，以方便得到官方模型打标。 
增加对text-ranking任务中文模型的单元测试，以方便得到官方模型打标。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492754
 2022-10-24 23:41:20 +08:00
行嗔
46c3bdcfe8 fix a bug 2022-10-24 23:19:23 +08:00
翎航
73469b8400 fix loss&log 2022-10-24 19:44:04 +08:00
行嗔
1682ea7dec fix local path 2022-10-24 18:07:18 +08:00
行嗔
55fb3b05a9 format finetune code, and ut case 2022-10-23 21:29:17 +08:00
行嗔
44026e0bf8 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-23 10:36:46 +08:00
yuze.zyz
707cbef013 [to #42322933]Fix bug in daily UT 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491891
 2022-10-22 23:25:18 +08:00
zhangyanzhao.zyz
824ee8232c [to #42322933]更新语义相关性任务英文名称为text ranking，修改对应变量名和类名 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491951
 2022-10-22 17:12:48 +08:00
Yingda Chen
dee93c40e2 [to #42322933] force download dataset for portraint enhancement 2022-10-22 16:28:30 +08:00
行嗔
330a8ac68f Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-21 16:26:34 +08:00
baiguan.yt
533ab3df63 [to #42322933]update msdatasets for image-portrait-enhancement training 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10453584
 2022-10-21 14:54:24 +08:00
翎航
9b8cfc4ece modify ofatrainer 2022-10-20 22:32:41 +08:00
Yingda Chen
b559ea50ca Merge remote-tracking branch 'origin' into ofa/finetune 2022-10-20 17:40:03 +08:00
yuze.zyz
acba1786b0 [to #42322933] Fix bug in UT daily 
1. Fix bugs in daily test
2. Fix a bug that the updating of lr is before the first time of updating of optimizer
    TODO this will still cause warnings when GA is above 1
3. Remove the judgement of mode in text-classification's preprocessor to fit the base trainer(Bug)
     Update some regression bins to fit the preprocessor
4. Update the regression tool to let outer code modify atol and rtol
5. Add the default metric for text-classification task
6. Remove the useless ckpt conversion method in bert to avoid the requirement of tf when loading modeling_bert
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10430764
 2022-10-20 15:29:34 +08:00
shouzhou.bx
01d521dd78 [to #42322933]add face 2d keypoints finetune test case 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421808

    * add face 2d keypoints & human wholebody keypoint finrtune test case
 2022-10-20 11:51:52 +08:00
Yingda Chen
089cadab4b [to #42322933] disable unstable trainer test 2022-10-20 08:51:25 +08:00
行嗔
e76f5a96a3 fix comments 2022-10-19 17:34:59 +08:00
行嗔
8257e28a4f Merge remote-tracking branch 'origin/master' into ofa/finetune 
# Conflicts:
#	modelscope/metrics/__init__.py
 2022-10-18 16:41:21 +08:00
huizheng.hz
c0b546a96e [to #42322933]add subset_name when loading dataset (NAFNet image denoising) 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10427797
 2022-10-18 14:34:26 +08:00
hanyuan.chy
2d50c812df [to #42322933] support finetune on cv/hand_2d_keypoints 
添加2d手部关键点检测finetune功能
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10371710
 2022-10-13 13:48:11 +08:00
bin.xue
3863efc14d [to #42322933] add far field KWS trainer 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10275823
 2022-10-13 10:15:33 +08:00
yuxiang.tyx
2989492bc0 [to #42322933]更新face_detection_scrfd模型并支持finetune, 新增card_detection模型 
1. 调整face_detection的文件层级(scrfd与其余新增face_detection方法平级);
2. 增加极大脸/旋转脸的检测方法，更新了新模型；
3. 支持读入数据集并finetune和eval；
4. 新增card_detection模型，支持读入datasethub数据集并finetune
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10244540
 2022-10-12 19:58:50 +08:00
huizheng.hz
922f4c589b [to #42322933]图像去噪using msdataset to load dataset 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10338265
 2022-10-11 22:46:30 +08:00
ashui.cbh
69da8f91ac [to #42322933]suport image inpainting 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10111615
 2022-10-11 20:49:13 +08:00
laiyin.lyc
09d2296f36 [to #44847108] add sparsity hook (pst algorithm) 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10198228

    * [to #44847108] add sparsity hook (pst algorithm)
 2022-10-11 16:05:20 +08:00
行嗔
dbf022efe8 caption finetune done, add belu 2022-09-30 17:44:35 +08:00
行嗔
a0c57e1538 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-09-28 16:03:04 +08:00
行嗔
3b09d848ce update 2022-09-28 16:02:28 +08:00
yuze.zyz
357a233ee3 [to #42322933] fix bug: checkpoint hook and bestckpthook exists at the same time 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10227608
 2022-09-27 23:03:00 +08:00
行嗔
537827e5a1 Merge remote-tracking branch 'origin/master' into ofa/finetune 
# Conflicts:
#	modelscope/models/multi_modal/ofa_for_all_tasks.py
#	modelscope/msdatasets/ms_dataset.py
#	modelscope/trainers/utils/inference.py
 2022-09-25 16:35:08 +08:00
行嗔
d979b90439 Merge branch 'master' into ofa/finetune 
# Conflicts:
#	modelscope/preprocessors/multi_modal.py
#	modelscope/trainers/trainer.py
#	tests/pipelines/test_ofa_tasks.py
 2022-09-25 16:28:26 +08:00
jiangnana.jnn
1794e08af7 fix dist training 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10185634

    * fix dist training
 2022-09-21 17:47:50 +08:00
行嗔
5d83f62312 mnli finetune done 2022-09-21 15:52:10 +08:00
wenmeng.zwm
6808e9a301 [to #44902099] add license for framework files 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10189613
 2022-09-20 17:49:31 +08:00
yuze.zyz
4cdd0c23eb [to #42322933] Refactor and fix some bugs 
1. Fix a bug in trainer's progress bar
2. Fix a bug that trainer does not support dataset in config file
3. Add feature: support go on training via checkpoint file
4. Add feature: support fixed filename when saving best checkpoint
5. Fix a bug that no id2label in config file after finetune of nlp models
6. Fix some other bugs
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10138906
 2022-09-19 17:05:35 +08:00
wenmeng.zwm
7fb25d7bbb [to #42322933]fix UT error for 830 version 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10142442
 2022-09-16 22:42:39 +08:00
jiangnana.jnn
adee5d10ae update EasyCV MsDataset 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10103248

    * update EasyCV MSDataset
 2022-09-15 18:11:03 +08:00
dingkun.ldk
54e1a6d88b [to #42322933]830NLP 篇章排序/文本表示模型代码check 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9856179
 2022-09-10 15:59:56 +08:00
ly119399
b41b10f897 [to #42322933] space finetune on generation task 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10061562
 2022-09-09 14:27:08 +08:00
jiangnana.jnn
5e176da3a1 adapt to msdataset for EasyCV 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9935664

    * adapt to msdataset for EasyCV
 2022-09-09 10:01:51 +08:00
cyc385202
d4759e4c24 [to #42322933] 加入space模型在banking数据集上的finetune代码 
加入space模型在banking数据集上的微调代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006792
 2022-09-08 13:45:14 +08:00
yuze.zyz
01e768503c [to #42322933] Fix random seed for trainer 
1. Fix random seed for trainer and init it at the first line of init
2. Add a regress test for fixed training
3. Change the dataset 'dureader_robust_qg' to 'DuReader_robust-QG'
4. Change some datasets from loading hf.datasets to loading msdataset.load
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10029509
 2022-09-06 15:13:14 +08:00
行嗔
5cf6910bed Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-09-05 20:48:41 +08:00
hemu.zp
3d3f9b4537 [to #42322933] fix checkpoint format 
1. 修复 palm，gpt3，mplug 模型存在的 finetune 后保存 checkpoint 与原有 checkpoint key 字段存在区别无法使用 from_pretrained 导入的问题
2. 调整 test_finetune_mplug.py 为只保存训练结束时的 checkpoint，减少 ci 耗时
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10016517
 2022-09-05 17:51:22 +08:00
bin.xue
b870e4eed5 [to #42322933] test: use custom config to reduce test time 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10011826

、
 2022-09-05 13:26:30 +08:00
yuze.zyz
a9c14e4ead [to #42322933] Support saving the best checkpoint for inference 
1. Support saving the best checkpoint for inference
2. Fix a bug that _max_iters field does not exist in trainer
3. Fix a bug that function in lambda_lr field cannot be saved to file
4. Fix a bug that save_pretrained would not be called by iterating
5. Fix a bug that interval is not passed from BestCkptHook's init
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9972765
 2022-09-05 11:07:48 +08:00
行嗔
db534fe946 add hf dataset 2022-09-04 16:08:25 +08:00
Yingda Chen
39a309b655 [to #42322933] reduce train epoch from 3 to w 2022-09-03 12:18:52 +08:00