Commit Graph

741 Commits

Author SHA1 Message Date
yuze.zyz
acba1786b0 [to #42322933] Fix bug in UT daily
1. Fix bugs in daily test
2. Fix a bug that the updating of lr is before the first time of updating of optimizer
    TODO this will still cause warnings when GA is above 1
3. Remove the judgement of mode in text-classification's preprocessor to fit the base trainer(Bug)
     Update some regression bins to fit the preprocessor
4. Update the regression tool to let outer code modify atol and rtol
5. Add the default metric for text-classification task
6. Remove the useless ckpt conversion method in bert to avoid the requirement of tf when loading modeling_bert
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10430764
2022-10-20 15:29:34 +08:00
shichen.fsc
1483c64638 [to #42322933] Fix ASR error when resample failed, and add all asr models UT, add apply-cmvn for pytorch models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10465241
2022-10-20 12:54:37 +08:00
xingguang.zxg
e7c7be6aae fix cpu error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10432300

    * fix cpu error
2022-10-20 12:51:48 +08:00
wenmeng.zwm
535acaef5b [to #42322933]add test case to check xtcocotools availbility
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10462622

    * add test case to check xtcocotools availbility
2022-10-20 12:13:19 +08:00
shouzhou.bx
01d521dd78 [to #42322933]add face 2d keypoints finetune test case
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421808

    * add face 2d keypoints & human wholebody keypoint finrtune test case
2022-10-20 11:51:52 +08:00
jiaqi.sjq
eb7bd5b825 [to #42322933]Add lock to tts's AM and model loaded since its AR part not lockfree
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10464620
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10464620
2022-10-20 11:46:50 +08:00
yingda.chen
3cd5f73da0 [to #42322933] refactor push_model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10463992
2022-10-20 10:28:15 +08:00
Yingda Chen
089cadab4b [to #42322933] disable unstable trainer test 2022-10-20 08:51:25 +08:00
jiaqi.sjq
87b4a52b3c Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10462681 2022-10-19 23:29:58 +08:00
Yingda Chen
63ac21147d [to #42322933] fix some logs 2022-10-19 13:24:23 +08:00
xingjun.wxj
9809d960b0 [to #42322933] Fix issue -- it's not necessary to login for loading public datasets.
修复”公开数据集需要登录才能load“的问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10448936
2022-10-19 10:09:06 +08:00
mulin.lyh
5f937b20cf [to #45549080]fix: fix pre_commit dependency importlib-metadata 5.0.0 compability issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10443005
2022-10-18 17:47:23 +08:00
xianzhe.xxz
865397763e [to #42322933]add damoyolo model in tinynas-object-detection
接入damyolo系列检测模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10377688
2022-10-18 16:53:29 +08:00
yongfei.zyf
6438c41144 [to #42322933]Support video url input processing
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10437340
2022-10-18 16:50:47 +08:00
shuying.shu
cb570d586c add referring video object segmentation pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10400324
2022-10-18 16:10:10 +08:00
hemu.zp
3b1f1a0252 [to #42322933] Add GPT3 tensor parallel inference
添加基于 Megatron-v3 的 GPT3 tensor 并行的推理代码
复用 DistributedPipeline 与 megatron-util
适用模型:1.3B/2.7B/13B 参数的 GPT-3 预训练生成模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10416721
2022-10-18 15:58:33 +08:00
huizheng.hz
c0b546a96e [to #42322933]add subset_name when loading dataset (NAFNet image denoising)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10427797
2022-10-18 14:34:26 +08:00
jiaqi.sjq
2eb835aca4 [to #42322933]Add uuid to model which created by ut test
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10434107
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10434107

    * [Update] update finetune_result_upload

* [Update] rename finetune_result_upload to model_dir_upload

* Merge branch 'master' into feat/upload_ckpt

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix import error

* [Fix] fix import error

* Merge branch 'master' into feat/upload_ckpt

* [Update] changes name to upload_folder and using tempfile to save repo

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix commit

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix format

* Merge branch 'master' into feat/upload_ckpt

* [Fix] add uuid after model created from upload ut
2022-10-18 11:12:12 +08:00
zhangzhicheng.zzc
e3eb01f4ce [to #42322933]update word-segmentation regression results
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10432186
2022-10-17 23:31:44 +08:00
leyuan.hjy
172522d196 [to #42322933]video-object-detection init
新增video-object-detection 算法
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10247489
2022-10-17 20:58:23 +08:00
hemu.zp
271e2a2a99 [to #42322933] Add gpt_neo model
1. 添加 gpt_neo 模型,因 checkpoint 归属于 Langboat 还未上传到模型库,已线下完成测试
2. 添加 text-generation task models 与 head,后续会将 gpt3,palm 等已上线文本生成模型统一为 backbone + head 结构的 task models
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10404249
2022-10-17 20:54:29 +08:00
mulin.lyh
ac07b719e9 [to #45546922]feat: add fasttext package
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10431169

    * [to #45546922]feat: add fasttext package
2022-10-17 20:51:58 +08:00
jiangnana.jnn
7720ae50e2 return dict values when input single sample for easycv pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10423383
2022-10-17 20:30:42 +08:00
jiaqi.sjq
8fa385e27c [to #42322933] Add upload in hub api
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10386689
2022-10-17 15:42:24 +08:00
shichen.fsc
542c4ce1b3 [to #42322933] Fix bug in KWS when setting customized keyword
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10412829
2022-10-17 14:07:05 +08:00
wendi.hwd
674e1a7878 [to #42322933]cv/cvdet_fix_outputs->master fix outputs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421413

    * fix outputs
2022-10-17 14:06:07 +08:00
wenqi.oywq
88a7599efb [to #42322933]change output channels from RGB to BGR, to consistent with demo-service
默认输出为array的,通道格式统一为BGR格式,本次修改是为了与这个格式一致
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10422508
2022-10-17 14:05:12 +08:00
wenmeng.zwm
f6e542cdcb refine pipeline input to support demo service
* image_captioninig support single image and dict input
* image_style_transfer use dict input

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10417330
2022-10-17 10:40:08 +08:00
wenmeng.zwm
4682783619 [to #44902165] bump version to 0.5.0 2022-10-15 20:34:58 +08:00
zhangzhicheng.zzc
7e7303a658 [to #42322933] remove fasttext from nlp requirements 2022-10-15 08:51:06 +08:00
caorongyu.cry
202fcdf298 [to #42322933] change tableqa output
修改output的结构,直接返回可转化成json format的结构
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10415403
2022-10-14 23:11:19 +08:00
Yingda Chen
deb847614a [to #42322933] limit espnet version 2022-10-14 21:59:52 +08:00
Yingda Chen
1c2f2055cb [to #42322933] fix generate Merge remote-tracking branch 'origin/fix_generate' 2022-10-14 18:39:52 +08:00
xingjun.wxj
1b4d5ccb9c [to #42322933]MsDataset upload and load supports directory.
上传和下载支持多文件操作
2022-10-14 18:32:38 +08:00
hemu
876058556d fix generate 2022-10-14 18:15:52 +08:00
Yingda Chen
355da866c5 [to #42322933] limit tranformers version temporarily 2022-10-14 18:07:29 +08:00
bin.xue
155856301f [to #42322933] do not check training config in pipeline()
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10407849
2022-10-14 14:00:57 +08:00
wenmeng.zwm
275f8b4323 Revert "[to #45071449] fix setup error "
This reverts commit a26e6e3869.
2022-10-14 13:55:09 +08:00
huizheng.hz
c5c14ad60a [to #42322933]fix psnr/ssim metrics for NAFNet (image denoise)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10403246
2022-10-13 22:25:57 +08:00
bin.xue
6818ffdc8e [to #42322933] feat: optimize ANS metric value
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10399100
2022-10-13 19:42:19 +08:00
mulin.lyh
5bdb8fb78b [to #45451935]fix: add create model detail log for create failed.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10382795
2022-10-13 18:30:06 +08:00
zhangzhicheng.zzc
383452b0a4 [to #45452180] python 3.10.x compatible
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10394282

    * python 3.10.x compatible
2022-10-13 17:16:17 +08:00
zhangzhicheng.zzc
14e52b308a fix token classification bugs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10385225

    * fix token classification bugs
2022-10-13 14:41:26 +08:00
hanyuan.chy
2d50c812df [to #42322933] support finetune on cv/hand_2d_keypoints
添加2d手部关键点检测finetune功能
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10371710
2022-10-13 13:48:11 +08:00
zhangzhicheng.zzc
0eb823b764 [to #42322933] support t5_with_translation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10383770

    * T5 support translate
2022-10-13 10:52:40 +08:00
jiangnana.jnn
f63d7f18f1 [to #42322933]remove sleep in train_loop
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9910419
2022-10-13 10:39:56 +08:00
jiaqi.sjq
144ffee2cf [to #42322933] Add explict model id in tts UT
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10371244
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10371244
2022-10-13 10:16:07 +08:00
bin.xue
3863efc14d [to #42322933] add far field KWS trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10275823
2022-10-13 10:15:33 +08:00
yuxiang.tyx
2989492bc0 [to #42322933]更新face_detection_scrfd模型并支持finetune, 新增card_detection模型
1. 调整face_detection的文件层级(scrfd与其余新增face_detection方法平级);
2. 增加极大脸/旋转脸的检测方法,更新了新模型;
3. 支持读入数据集并finetune和eval;
4. 新增card_detection模型,支持读入datasethub数据集并finetune
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10244540
2022-10-12 19:58:50 +08:00
shouzhou.bx
4cb5f8a2cd [to #42322933] add human whole body model and image object detection auto model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10319306
2022-10-12 19:53:14 +08:00