Commit Graph

797 Commits

Author SHA1 Message Date
行嗔
55fb3b05a9 format finetune code, and ut case 2022-10-23 21:29:17 +08:00
行嗔
c573625b05 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-23 11:21:54 +08:00
zhangzhicheng.zzc
182ba1768f [to #42322933]support multi tasks for part of speech
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491994
2022-10-23 10:56:52 +08:00
行嗔
44026e0bf8 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-23 10:36:46 +08:00
yuze.zyz
707cbef013 [to #42322933]Fix bug in daily UT
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491891
2022-10-22 23:25:18 +08:00
zhangzhicheng.zzc
2a87dee561 [to #42322933]support multi tasks-- will be failed, since configuration has not changed yet
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492024
2022-10-22 21:09:15 +08:00
caorongyu.cry
9edfd7e50c [to #42322933] update tableqa params
1. 增加传入table_id
2. 将result和table的结构统一
3. 默认开启is_use_sqlite
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492027
2022-10-22 20:33:49 +08:00
baiguan.yt
46107e3ecf [to #42322933]converting string to int to meet the input of face-image-generation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10489981
2022-10-22 20:31:59 +08:00
shichen.fsc
1854ceeb74 [to #42322933] Fix all asr models in UT with mistake model_id
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491024
2022-10-22 20:30:45 +08:00
tingwei.gtw
e09d277fd3 [to #42322933] fix cpu inference
修复cpu推理
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10468823
2022-10-22 19:19:23 +08:00
zhangyanzhao.zyz
824ee8232c [to #42322933]更新语义相关性任务英文名称为text ranking,修改对应变量名和类名
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491951
2022-10-22 17:12:48 +08:00
yichang.zyc
683ee5bfed [to #42322933]use Tasks.ocr_recognition
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10490937
2022-10-22 17:01:03 +08:00
Yingda Chen
9bc06716c1 [to #42322933] fix typo 2022-10-22 16:30:19 +08:00
Yingda Chen
dee93c40e2 [to #42322933] force download dataset for portraint enhancement 2022-10-22 16:28:30 +08:00
yuze.zyz
f7f7eb21dc [to #42322933]Fix the logic of fast tokenizer
1. Change the logic of using fast tokenizer from mode to user arguments and tokenizer_config.json
This is to fix the problem of RANER must use fast tokenizer in some special models.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10488982
2022-10-21 22:10:40 +08:00
行嗔
330a8ac68f Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-21 16:26:34 +08:00
baiguan.yt
533ab3df63 [to #42322933]update msdatasets for image-portrait-enhancement training
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10453584
2022-10-21 14:54:24 +08:00
liugao.lg
baff7c5b64 [to #42322933]add ofa-ocr-recogniiton pipeline
新增ofa关于日常场景文字识别的任务,主要包括:
1、新增pipeline及task名称定义;
2、新增pipeline、task、model及prepreocess核心类方法的代码逻辑;
3、其它同步修正的小细节逻辑;
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10471089
2022-10-21 09:11:15 +08:00
james.wjg
c582b19115 [to #42322933]cv/video_summarization fix a code bug
修复一行错误代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10477534

    * fix a code bug
2022-10-20 21:13:19 +08:00
chaojie.mcj
9842a427ef modify headers for __init__
更改部分__init__文件的header license
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10393596
2022-10-20 21:12:47 +08:00
lee.lcy
0bc9660fcc [to #42322933] modify img_embedding type for image_reid_person
modify img_embedding type for image_reid_person
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10477972
2022-10-20 21:12:14 +08:00
行嗔
92a04b010c Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-20 19:52:30 +08:00
行嗔
733d9ab228 Merge branch 'ofa/finetune' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into ofa/finetune 2022-10-20 19:52:05 +08:00
hemu.zp
2b49b322a2 [to #42322933] Add palm ut
为以下三个模型补充 ut
damo/nlp_palm2.0_text-generation_chinese-large
damo/nlp_palm2.0_text-generation_commodity_chinese-base
damo/nlp_palm2.0_text-generation_weather_chinese-base
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10435599
2022-10-20 19:50:40 +08:00
hanyuan.chy
de6d84cb97 [to #42322933]修复pipeline串联时collate_fn异常
修复pipeline串联时collate_fn异常
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10457058
2022-10-20 19:33:06 +08:00
jiangnana.jnn
b2c5876ead [to #42322933]fix create dir when dist
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10459756
2022-10-20 19:31:53 +08:00
Yingda Chen
b559ea50ca Merge remote-tracking branch 'origin' into ofa/finetune 2022-10-20 17:40:03 +08:00
xiangpeng.wxp
8ec90ccbf8 [to #42322933] Add uttest for en2fr and fr2en tasks
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10467797

    * add uttest for en2fr and fr2en tasks
2022-10-20 17:35:27 +08:00
yuze.zyz
acba1786b0 [to #42322933] Fix bug in UT daily
1. Fix bugs in daily test
2. Fix a bug that the updating of lr is before the first time of updating of optimizer
    TODO this will still cause warnings when GA is above 1
3. Remove the judgement of mode in text-classification's preprocessor to fit the base trainer(Bug)
     Update some regression bins to fit the preprocessor
4. Update the regression tool to let outer code modify atol and rtol
5. Add the default metric for text-classification task
6. Remove the useless ckpt conversion method in bert to avoid the requirement of tf when loading modeling_bert
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10430764
2022-10-20 15:29:34 +08:00
shichen.fsc
1483c64638 [to #42322933] Fix ASR error when resample failed, and add all asr models UT, add apply-cmvn for pytorch models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10465241
2022-10-20 12:54:37 +08:00
xingguang.zxg
e7c7be6aae fix cpu error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10432300

    * fix cpu error
2022-10-20 12:51:48 +08:00
wenmeng.zwm
535acaef5b [to #42322933]add test case to check xtcocotools availbility
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10462622

    * add test case to check xtcocotools availbility
2022-10-20 12:13:19 +08:00
shouzhou.bx
01d521dd78 [to #42322933]add face 2d keypoints finetune test case
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421808

    * add face 2d keypoints & human wholebody keypoint finrtune test case
2022-10-20 11:51:52 +08:00
jiaqi.sjq
eb7bd5b825 [to #42322933]Add lock to tts's AM and model loaded since its AR part not lockfree
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10464620
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10464620
2022-10-20 11:46:50 +08:00
yingda.chen
3cd5f73da0 [to #42322933] refactor push_model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10463992
2022-10-20 10:28:15 +08:00
Yingda Chen
089cadab4b [to #42322933] disable unstable trainer test 2022-10-20 08:51:25 +08:00
jiaqi.sjq
87b4a52b3c Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10462681 2022-10-19 23:29:58 +08:00
行嗔
5b33372ba2 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-10-19 19:30:56 +08:00
行嗔
63a62c3151 fix comments 2022-10-19 17:36:01 +08:00
行嗔
e76f5a96a3 fix comments 2022-10-19 17:34:59 +08:00
Yingda Chen
63ac21147d [to #42322933] fix some logs 2022-10-19 13:24:23 +08:00
xingjun.wxj
9809d960b0 [to #42322933] Fix issue -- it's not necessary to login for loading public datasets.
修复”公开数据集需要登录才能load“的问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10448936
2022-10-19 10:09:06 +08:00
mulin.lyh
5f937b20cf [to #45549080]fix: fix pre_commit dependency importlib-metadata 5.0.0 compability issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10443005
2022-10-18 17:47:23 +08:00
xianzhe.xxz
865397763e [to #42322933]add damoyolo model in tinynas-object-detection
接入damyolo系列检测模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10377688
2022-10-18 16:53:29 +08:00
yongfei.zyf
6438c41144 [to #42322933]Support video url input processing
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10437340
2022-10-18 16:50:47 +08:00
行嗔
8257e28a4f Merge remote-tracking branch 'origin/master' into ofa/finetune
# Conflicts:
#	modelscope/metrics/__init__.py
2022-10-18 16:41:21 +08:00
行嗔
ca72f5329c commit code 2022-10-18 16:39:52 +08:00
shuying.shu
cb570d586c add referring video object segmentation pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10400324
2022-10-18 16:10:10 +08:00
hemu.zp
3b1f1a0252 [to #42322933] Add GPT3 tensor parallel inference
添加基于 Megatron-v3 的 GPT3 tensor 并行的推理代码
复用 DistributedPipeline 与 megatron-util
适用模型:1.3B/2.7B/13B 参数的 GPT-3 预训练生成模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10416721
2022-10-18 15:58:33 +08:00
huizheng.hz
c0b546a96e [to #42322933]add subset_name when loading dataset (NAFNet image denoising)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10427797
2022-10-18 14:34:26 +08:00