Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-23 19:49:24 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,822 Commits 263 Branches 106 Tags
update/list_datasets
Commit Graph

1195 Commits

Author SHA1 Message Date
huizheng.hz
a1738690c9 [to #42322933]test_image_denoise_trainer 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10465138
 2022-10-25 10:08:57 +08:00
caorongyu.cry
6178f46910 [to #42322933] add ut for multi threads 
1. 修复multi thread引起的问题
2. 增加multi thread的unittest
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10502008
 2022-10-25 09:49:02 +08:00
yingda.chen
de7b6a06e9 [to #42322933] remove revision usage for face detection 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10507910

    * [to #42322933] remove revision usage for face detection
 2022-10-25 09:28:01 +08:00
行嗔
cb9a2b9d10 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-25 00:52:52 +08:00
行嗔
85a7832d57 fix a typo 2022-10-25 00:52:35 +08:00
zhangyanzhao.zyz
c4dbb69d65 [to #42322933]增加对text-ranking任务中文模型的单元测试，以方便得到官方模型打标。 
增加对text-ranking任务中文模型的单元测试，以方便得到官方模型打标。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492754
 2022-10-24 23:41:20 +08:00
yichang.zyc
35c612a642 [to #42322933]去除clip ut中的dev revision 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10507748

    * remove clip ut dev revision
 2022-10-24 23:40:38 +08:00
行嗔
46c3bdcfe8 fix a bug 2022-10-24 23:19:23 +08:00
翎航
73469b8400 fix loss&log 2022-10-24 19:44:04 +08:00
ashui.cbh
e223c1b008 [to #42322933]merge master after demo service support 
demo service 对接，修改输入接口为可调用的方式
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10502169
 2022-10-24 18:47:01 +08:00
行嗔
6975ff7d36 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-24 18:08:03 +08:00
行嗔
1682ea7dec fix local path 2022-10-24 18:07:18 +08:00
行嗔
55fb3b05a9 format finetune code, and ut case 2022-10-23 21:29:17 +08:00
caorongyu.cry
35644fa0a7 [to #42322933] change star3 to space_T_cn 
1. 合并star和star3框架
2. 修改star和star3的model type
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492793
 2022-10-23 20:25:24 +08:00
行嗔
c573625b05 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-23 11:21:54 +08:00
zhangzhicheng.zzc
182ba1768f [to #42322933]support multi tasks for part of speech 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491994
 2022-10-23 10:56:52 +08:00
行嗔
44026e0bf8 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-23 10:36:46 +08:00
yuze.zyz
707cbef013 [to #42322933]Fix bug in daily UT 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491891
 2022-10-22 23:25:18 +08:00
zhangzhicheng.zzc
2a87dee561 [to #42322933]support multi tasks-- will be failed, since configuration has not changed yet 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492024
 2022-10-22 21:09:15 +08:00
caorongyu.cry
9edfd7e50c [to #42322933] update tableqa params 
1. 增加传入table_id
2. 将result和table的结构统一
3. 默认开启is_use_sqlite
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492027
 2022-10-22 20:33:49 +08:00
shichen.fsc
1854ceeb74 [to #42322933] Fix all asr models in UT with mistake model_id 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491024
 2022-10-22 20:30:45 +08:00
zhangyanzhao.zyz
824ee8232c [to #42322933]更新语义相关性任务英文名称为text ranking，修改对应变量名和类名 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491951
 2022-10-22 17:12:48 +08:00
yichang.zyc
683ee5bfed [to #42322933]use Tasks.ocr_recognition 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10490937
 2022-10-22 17:01:03 +08:00
Yingda Chen
dee93c40e2 [to #42322933] force download dataset for portraint enhancement 2022-10-22 16:28:30 +08:00
行嗔
330a8ac68f Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-21 16:26:34 +08:00
baiguan.yt
533ab3df63 [to #42322933]update msdatasets for image-portrait-enhancement training 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10453584
 2022-10-21 14:54:24 +08:00
liugao.lg
baff7c5b64 [to #42322933]add ofa-ocr-recogniiton pipeline 
新增ofa关于日常场景文字识别的任务，主要包括：
1、新增pipeline及task名称定义；
2、新增pipeline、task、model及prepreocess核心类方法的代码逻辑；
3、其它同步修正的小细节逻辑；
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10471089
 2022-10-21 09:11:15 +08:00
翎航
9b8cfc4ece modify ofatrainer 2022-10-20 22:32:41 +08:00
行嗔
92a04b010c Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-20 19:52:30 +08:00
hemu.zp
2b49b322a2 [to #42322933] Add palm ut 
为以下三个模型补充 ut
damo/nlp_palm2.0_text-generation_chinese-large
damo/nlp_palm2.0_text-generation_commodity_chinese-base
damo/nlp_palm2.0_text-generation_weather_chinese-base
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10435599
 2022-10-20 19:50:40 +08:00
Yingda Chen
b559ea50ca Merge remote-tracking branch 'origin' into ofa/finetune 2022-10-20 17:40:03 +08:00
xiangpeng.wxp
8ec90ccbf8 [to #42322933] Add uttest for en2fr and fr2en tasks 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10467797

    * add uttest for en2fr and fr2en tasks
 2022-10-20 17:35:27 +08:00
yuze.zyz
acba1786b0 [to #42322933] Fix bug in UT daily 
1. Fix bugs in daily test
2. Fix a bug that the updating of lr is before the first time of updating of optimizer
    TODO this will still cause warnings when GA is above 1
3. Remove the judgement of mode in text-classification's preprocessor to fit the base trainer(Bug)
     Update some regression bins to fit the preprocessor
4. Update the regression tool to let outer code modify atol and rtol
5. Add the default metric for text-classification task
6. Remove the useless ckpt conversion method in bert to avoid the requirement of tf when loading modeling_bert
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10430764
 2022-10-20 15:29:34 +08:00
shichen.fsc
1483c64638 [to #42322933] Fix ASR error when resample failed, and add all asr models UT, add apply-cmvn for pytorch models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10465241
 2022-10-20 12:54:37 +08:00
wenmeng.zwm
535acaef5b [to #42322933]add test case to check xtcocotools availbility 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10462622

    * add test case to check xtcocotools availbility
 2022-10-20 12:13:19 +08:00
shouzhou.bx
01d521dd78 [to #42322933]add face 2d keypoints finetune test case 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421808

    * add face 2d keypoints & human wholebody keypoint finrtune test case
 2022-10-20 11:51:52 +08:00
yingda.chen
3cd5f73da0 [to #42322933] refactor push_model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10463992
 2022-10-20 10:28:15 +08:00
Yingda Chen
089cadab4b [to #42322933] disable unstable trainer test 2022-10-20 08:51:25 +08:00
jiaqi.sjq
87b4a52b3c Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10462681 2022-10-19 23:29:58 +08:00
行嗔
e76f5a96a3 fix comments 2022-10-19 17:34:59 +08:00
xianzhe.xxz
865397763e [to #42322933]add damoyolo model in tinynas-object-detection 
接入damyolo系列检测模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10377688
 2022-10-18 16:53:29 +08:00
行嗔
8257e28a4f Merge remote-tracking branch 'origin/master' into ofa/finetune 
# Conflicts:
#	modelscope/metrics/__init__.py
 2022-10-18 16:41:21 +08:00
shuying.shu
cb570d586c add referring video object segmentation pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10400324
 2022-10-18 16:10:10 +08:00
hemu.zp
3b1f1a0252 [to #42322933] Add GPT3 tensor parallel inference 
添加基于 Megatron-v3 的 GPT3 tensor 并行的推理代码
复用 DistributedPipeline 与 megatron-util
适用模型：1.3B/2.7B/13B 参数的 GPT-3 预训练生成模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10416721
 2022-10-18 15:58:33 +08:00
huizheng.hz
c0b546a96e [to #42322933]add subset_name when loading dataset (NAFNet image denoising) 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10427797
 2022-10-18 14:34:26 +08:00
jiaqi.sjq
2eb835aca4 [to #42322933]Add uuid to model which created by ut test 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10434107
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10434107

    * [Update] update finetune_result_upload

* [Update] rename finetune_result_upload to model_dir_upload

* Merge branch 'master' into feat/upload_ckpt

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix import error

* [Fix] fix import error

* Merge branch 'master' into feat/upload_ckpt

* [Update] changes name to upload_folder and using tempfile to save repo

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix commit

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix format

* Merge branch 'master' into feat/upload_ckpt

* [Fix] add uuid after model created from upload ut
 2022-10-18 11:12:12 +08:00
leyuan.hjy
172522d196 [to #42322933]video-object-detection init 
新增video-object-detection 算法
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10247489
 2022-10-17 20:58:23 +08:00
hemu.zp
271e2a2a99 [to #42322933] Add gpt_neo model 
1. 添加 gpt_neo 模型，因 checkpoint 归属于 Langboat 还未上传到模型库，已线下完成测试
2. 添加 text-generation task models 与 head，后续会将 gpt3，palm 等已上线文本生成模型统一为 backbone + head 结构的 task models
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10404249
 2022-10-17 20:54:29 +08:00
jiangnana.jnn
7720ae50e2 return dict values when input single sample for easycv pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10423383
 2022-10-17 20:30:42 +08:00
jiaqi.sjq
8fa385e27c [to #42322933] Add upload in hub api 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10386689
 2022-10-17 15:42:24 +08:00