Commit Graph

754 Commits

Author SHA1 Message Date
yichang.zyc
683ee5bfed [to #42322933]use Tasks.ocr_recognition
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10490937
2022-10-22 17:01:03 +08:00
Yingda Chen
9bc06716c1 [to #42322933] fix typo 2022-10-22 16:30:19 +08:00
Yingda Chen
dee93c40e2 [to #42322933] force download dataset for portraint enhancement 2022-10-22 16:28:30 +08:00
yuze.zyz
f7f7eb21dc [to #42322933]Fix the logic of fast tokenizer
1. Change the logic of using fast tokenizer from mode to user arguments and tokenizer_config.json
This is to fix the problem of RANER must use fast tokenizer in some special models.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10488982
2022-10-21 22:10:40 +08:00
baiguan.yt
533ab3df63 [to #42322933]update msdatasets for image-portrait-enhancement training
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10453584
2022-10-21 14:54:24 +08:00
liugao.lg
baff7c5b64 [to #42322933]add ofa-ocr-recogniiton pipeline
新增ofa关于日常场景文字识别的任务,主要包括:
1、新增pipeline及task名称定义;
2、新增pipeline、task、model及prepreocess核心类方法的代码逻辑;
3、其它同步修正的小细节逻辑;
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10471089
2022-10-21 09:11:15 +08:00
james.wjg
c582b19115 [to #42322933]cv/video_summarization fix a code bug
修复一行错误代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10477534

    * fix a code bug
2022-10-20 21:13:19 +08:00
chaojie.mcj
9842a427ef modify headers for __init__
更改部分__init__文件的header license
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10393596
2022-10-20 21:12:47 +08:00
lee.lcy
0bc9660fcc [to #42322933] modify img_embedding type for image_reid_person
modify img_embedding type for image_reid_person
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10477972
2022-10-20 21:12:14 +08:00
hemu.zp
2b49b322a2 [to #42322933] Add palm ut
为以下三个模型补充 ut
damo/nlp_palm2.0_text-generation_chinese-large
damo/nlp_palm2.0_text-generation_commodity_chinese-base
damo/nlp_palm2.0_text-generation_weather_chinese-base
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10435599
2022-10-20 19:50:40 +08:00
hanyuan.chy
de6d84cb97 [to #42322933]修复pipeline串联时collate_fn异常
修复pipeline串联时collate_fn异常
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10457058
2022-10-20 19:33:06 +08:00
jiangnana.jnn
b2c5876ead [to #42322933]fix create dir when dist
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10459756
2022-10-20 19:31:53 +08:00
xiangpeng.wxp
8ec90ccbf8 [to #42322933] Add uttest for en2fr and fr2en tasks
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10467797

    * add uttest for en2fr and fr2en tasks
2022-10-20 17:35:27 +08:00
yuze.zyz
acba1786b0 [to #42322933] Fix bug in UT daily
1. Fix bugs in daily test
2. Fix a bug that the updating of lr is before the first time of updating of optimizer
    TODO this will still cause warnings when GA is above 1
3. Remove the judgement of mode in text-classification's preprocessor to fit the base trainer(Bug)
     Update some regression bins to fit the preprocessor
4. Update the regression tool to let outer code modify atol and rtol
5. Add the default metric for text-classification task
6. Remove the useless ckpt conversion method in bert to avoid the requirement of tf when loading modeling_bert
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10430764
2022-10-20 15:29:34 +08:00
shichen.fsc
1483c64638 [to #42322933] Fix ASR error when resample failed, and add all asr models UT, add apply-cmvn for pytorch models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10465241
2022-10-20 12:54:37 +08:00
xingguang.zxg
e7c7be6aae fix cpu error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10432300

    * fix cpu error
2022-10-20 12:51:48 +08:00
wenmeng.zwm
535acaef5b [to #42322933]add test case to check xtcocotools availbility
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10462622

    * add test case to check xtcocotools availbility
2022-10-20 12:13:19 +08:00
shouzhou.bx
01d521dd78 [to #42322933]add face 2d keypoints finetune test case
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421808

    * add face 2d keypoints & human wholebody keypoint finrtune test case
2022-10-20 11:51:52 +08:00
jiaqi.sjq
eb7bd5b825 [to #42322933]Add lock to tts's AM and model loaded since its AR part not lockfree
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10464620
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10464620
2022-10-20 11:46:50 +08:00
yingda.chen
3cd5f73da0 [to #42322933] refactor push_model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10463992
2022-10-20 10:28:15 +08:00
Yingda Chen
089cadab4b [to #42322933] disable unstable trainer test 2022-10-20 08:51:25 +08:00
jiaqi.sjq
87b4a52b3c Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10462681 2022-10-19 23:29:58 +08:00
Yingda Chen
63ac21147d [to #42322933] fix some logs 2022-10-19 13:24:23 +08:00
xingjun.wxj
9809d960b0 [to #42322933] Fix issue -- it's not necessary to login for loading public datasets.
修复”公开数据集需要登录才能load“的问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10448936
2022-10-19 10:09:06 +08:00
mulin.lyh
5f937b20cf [to #45549080]fix: fix pre_commit dependency importlib-metadata 5.0.0 compability issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10443005
2022-10-18 17:47:23 +08:00
xianzhe.xxz
865397763e [to #42322933]add damoyolo model in tinynas-object-detection
接入damyolo系列检测模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10377688
2022-10-18 16:53:29 +08:00
yongfei.zyf
6438c41144 [to #42322933]Support video url input processing
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10437340
2022-10-18 16:50:47 +08:00
shuying.shu
cb570d586c add referring video object segmentation pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10400324
2022-10-18 16:10:10 +08:00
hemu.zp
3b1f1a0252 [to #42322933] Add GPT3 tensor parallel inference
添加基于 Megatron-v3 的 GPT3 tensor 并行的推理代码
复用 DistributedPipeline 与 megatron-util
适用模型:1.3B/2.7B/13B 参数的 GPT-3 预训练生成模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10416721
2022-10-18 15:58:33 +08:00
huizheng.hz
c0b546a96e [to #42322933]add subset_name when loading dataset (NAFNet image denoising)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10427797
2022-10-18 14:34:26 +08:00
jiaqi.sjq
2eb835aca4 [to #42322933]Add uuid to model which created by ut test
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10434107
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10434107

    * [Update] update finetune_result_upload

* [Update] rename finetune_result_upload to model_dir_upload

* Merge branch 'master' into feat/upload_ckpt

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix import error

* [Fix] fix import error

* Merge branch 'master' into feat/upload_ckpt

* [Update] changes name to upload_folder and using tempfile to save repo

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix commit

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix format

* Merge branch 'master' into feat/upload_ckpt

* [Fix] add uuid after model created from upload ut
2022-10-18 11:12:12 +08:00
zhangzhicheng.zzc
e3eb01f4ce [to #42322933]update word-segmentation regression results
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10432186
2022-10-17 23:31:44 +08:00
leyuan.hjy
172522d196 [to #42322933]video-object-detection init
新增video-object-detection 算法
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10247489
2022-10-17 20:58:23 +08:00
hemu.zp
271e2a2a99 [to #42322933] Add gpt_neo model
1. 添加 gpt_neo 模型,因 checkpoint 归属于 Langboat 还未上传到模型库,已线下完成测试
2. 添加 text-generation task models 与 head,后续会将 gpt3,palm 等已上线文本生成模型统一为 backbone + head 结构的 task models
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10404249
2022-10-17 20:54:29 +08:00
mulin.lyh
ac07b719e9 [to #45546922]feat: add fasttext package
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10431169

    * [to #45546922]feat: add fasttext package
2022-10-17 20:51:58 +08:00
jiangnana.jnn
7720ae50e2 return dict values when input single sample for easycv pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10423383
2022-10-17 20:30:42 +08:00
jiaqi.sjq
8fa385e27c [to #42322933] Add upload in hub api
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10386689
2022-10-17 15:42:24 +08:00
shichen.fsc
542c4ce1b3 [to #42322933] Fix bug in KWS when setting customized keyword
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10412829
2022-10-17 14:07:05 +08:00
wendi.hwd
674e1a7878 [to #42322933]cv/cvdet_fix_outputs->master fix outputs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421413

    * fix outputs
2022-10-17 14:06:07 +08:00
wenqi.oywq
88a7599efb [to #42322933]change output channels from RGB to BGR, to consistent with demo-service
默认输出为array的,通道格式统一为BGR格式,本次修改是为了与这个格式一致
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10422508
2022-10-17 14:05:12 +08:00
wenmeng.zwm
f6e542cdcb refine pipeline input to support demo service
* image_captioninig support single image and dict input
* image_style_transfer use dict input

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10417330
2022-10-17 10:40:08 +08:00
wenmeng.zwm
4682783619 [to #44902165] bump version to 0.5.0 2022-10-15 20:34:58 +08:00
zhangzhicheng.zzc
7e7303a658 [to #42322933] remove fasttext from nlp requirements 2022-10-15 08:51:06 +08:00
caorongyu.cry
202fcdf298 [to #42322933] change tableqa output
修改output的结构,直接返回可转化成json format的结构
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10415403
2022-10-14 23:11:19 +08:00
Yingda Chen
deb847614a [to #42322933] limit espnet version 2022-10-14 21:59:52 +08:00
Yingda Chen
1c2f2055cb [to #42322933] fix generate Merge remote-tracking branch 'origin/fix_generate' 2022-10-14 18:39:52 +08:00
xingjun.wxj
1b4d5ccb9c [to #42322933]MsDataset upload and load supports directory.
上传和下载支持多文件操作
2022-10-14 18:32:38 +08:00
hemu
876058556d fix generate 2022-10-14 18:15:52 +08:00
Yingda Chen
355da866c5 [to #42322933] limit tranformers version temporarily 2022-10-14 18:07:29 +08:00
bin.xue
155856301f [to #42322933] do not check training config in pipeline()
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10407849
2022-10-14 14:00:57 +08:00