Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 04:29:22 +01:00
Code Issues Packages Projects Releases Wiki Activity
746 Commits 263 Branches 106 Tags
0bc9660fccdaaf45947d0f97c59bbeb10283f176
Commit Graph

449 Commits

Author SHA1 Message Date
hemu.zp
2b49b322a2 [to #42322933] Add palm ut 
为以下三个模型补充 ut
damo/nlp_palm2.0_text-generation_chinese-large
damo/nlp_palm2.0_text-generation_commodity_chinese-base
damo/nlp_palm2.0_text-generation_weather_chinese-base
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10435599
 2022-10-20 19:50:40 +08:00
xiangpeng.wxp
8ec90ccbf8 [to #42322933] Add uttest for en2fr and fr2en tasks 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10467797

    * add uttest for en2fr and fr2en tasks
 2022-10-20 17:35:27 +08:00
yuze.zyz
acba1786b0 [to #42322933] Fix bug in UT daily 
1. Fix bugs in daily test
2. Fix a bug that the updating of lr is before the first time of updating of optimizer
    TODO this will still cause warnings when GA is above 1
3. Remove the judgement of mode in text-classification's preprocessor to fit the base trainer(Bug)
     Update some regression bins to fit the preprocessor
4. Update the regression tool to let outer code modify atol and rtol
5. Add the default metric for text-classification task
6. Remove the useless ckpt conversion method in bert to avoid the requirement of tf when loading modeling_bert
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10430764
 2022-10-20 15:29:34 +08:00
shichen.fsc
1483c64638 [to #42322933] Fix ASR error when resample failed, and add all asr models UT, add apply-cmvn for pytorch models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10465241
 2022-10-20 12:54:37 +08:00
wenmeng.zwm
535acaef5b [to #42322933]add test case to check xtcocotools availbility 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10462622

    * add test case to check xtcocotools availbility
 2022-10-20 12:13:19 +08:00
shouzhou.bx
01d521dd78 [to #42322933]add face 2d keypoints finetune test case 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421808

    * add face 2d keypoints & human wholebody keypoint finrtune test case
 2022-10-20 11:51:52 +08:00
yingda.chen
3cd5f73da0 [to #42322933] refactor push_model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10463992
 2022-10-20 10:28:15 +08:00
Yingda Chen
089cadab4b [to #42322933] disable unstable trainer test 2022-10-20 08:51:25 +08:00
jiaqi.sjq
87b4a52b3c Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10462681 2022-10-19 23:29:58 +08:00
xianzhe.xxz
865397763e [to #42322933]add damoyolo model in tinynas-object-detection 
接入damyolo系列检测模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10377688
 2022-10-18 16:53:29 +08:00
shuying.shu
cb570d586c add referring video object segmentation pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10400324
 2022-10-18 16:10:10 +08:00
hemu.zp
3b1f1a0252 [to #42322933] Add GPT3 tensor parallel inference 
添加基于 Megatron-v3 的 GPT3 tensor 并行的推理代码
复用 DistributedPipeline 与 megatron-util
适用模型：1.3B/2.7B/13B 参数的 GPT-3 预训练生成模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10416721
 2022-10-18 15:58:33 +08:00
huizheng.hz
c0b546a96e [to #42322933]add subset_name when loading dataset (NAFNet image denoising) 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10427797
 2022-10-18 14:34:26 +08:00
jiaqi.sjq
2eb835aca4 [to #42322933]Add uuid to model which created by ut test 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10434107
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10434107

    * [Update] update finetune_result_upload

* [Update] rename finetune_result_upload to model_dir_upload

* Merge branch 'master' into feat/upload_ckpt

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix import error

* [Fix] fix import error

* Merge branch 'master' into feat/upload_ckpt

* [Update] changes name to upload_folder and using tempfile to save repo

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix commit

* Merge branch 'master' into feat/upload_ckpt

* [Fix] fix format

* Merge branch 'master' into feat/upload_ckpt

* [Fix] add uuid after model created from upload ut
 2022-10-18 11:12:12 +08:00
leyuan.hjy
172522d196 [to #42322933]video-object-detection init 
新增video-object-detection 算法
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10247489
 2022-10-17 20:58:23 +08:00
hemu.zp
271e2a2a99 [to #42322933] Add gpt_neo model 
1. 添加 gpt_neo 模型，因 checkpoint 归属于 Langboat 还未上传到模型库，已线下完成测试
2. 添加 text-generation task models 与 head，后续会将 gpt3，palm 等已上线文本生成模型统一为 backbone + head 结构的 task models
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10404249
 2022-10-17 20:54:29 +08:00
jiangnana.jnn
7720ae50e2 return dict values when input single sample for easycv pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10423383
 2022-10-17 20:30:42 +08:00
jiaqi.sjq
8fa385e27c [to #42322933] Add upload in hub api 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10386689
 2022-10-17 15:42:24 +08:00
shichen.fsc
542c4ce1b3 [to #42322933] Fix bug in KWS when setting customized keyword 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10412829
 2022-10-17 14:07:05 +08:00
wendi.hwd
674e1a7878 [to #42322933]cv/cvdet_fix_outputs->master fix outputs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421413

    * fix outputs
 2022-10-17 14:06:07 +08:00
wenqi.oywq
88a7599efb [to #42322933]change output channels from RGB to BGR, to consistent with demo-service 
默认输出为array的，通道格式统一为BGR格式，本次修改是为了与这个格式一致
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10422508
 2022-10-17 14:05:12 +08:00
wenmeng.zwm
f6e542cdcb refine pipeline input to support demo service 
* image_captioninig support single image and dict input
* image_style_transfer use dict input

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10417330
 2022-10-17 10:40:08 +08:00
caorongyu.cry
202fcdf298 [to #42322933] change tableqa output 
修改output的结构，直接返回可转化成json format的结构
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10415403
 2022-10-14 23:11:19 +08:00
xingjun.wxj
1b4d5ccb9c [to #42322933]MsDataset upload and load supports directory. 
上传和下载支持多文件操作
 2022-10-14 18:32:38 +08:00
hanyuan.chy
2d50c812df [to #42322933] support finetune on cv/hand_2d_keypoints 
添加2d手部关键点检测finetune功能
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10371710
 2022-10-13 13:48:11 +08:00
zhangzhicheng.zzc
0eb823b764 [to #42322933] support t5_with_translation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10383770

    * T5 support translate
 2022-10-13 10:52:40 +08:00
jiaqi.sjq
144ffee2cf [to #42322933] Add explict model id in tts UT 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10371244
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10371244
 2022-10-13 10:16:07 +08:00
bin.xue
3863efc14d [to #42322933] add far field KWS trainer 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10275823
 2022-10-13 10:15:33 +08:00
yuxiang.tyx
2989492bc0 [to #42322933]更新face_detection_scrfd模型并支持finetune, 新增card_detection模型 
1. 调整face_detection的文件层级(scrfd与其余新增face_detection方法平级);
2. 增加极大脸/旋转脸的检测方法，更新了新模型；
3. 支持读入数据集并finetune和eval；
4. 新增card_detection模型，支持读入datasethub数据集并finetune
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10244540
 2022-10-12 19:58:50 +08:00
shouzhou.bx
4cb5f8a2cd [to #42322933] add human whole body model and image object detection auto model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10319306
 2022-10-12 19:53:14 +08:00
caorongyu.cry
7145990054 [to #42322933] reivse model problem and remove history sql for demo 
相比于master上的tableqa，做出了如下修复：
1. 修复了schema linking中的问题。
2. 同时设置了有history sql和没有history sql的两种输入
3. 增加了sqlite执行逻辑，可以返回sql执行结果
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10365114
 2022-10-12 15:18:35 +08:00
huizheng.hz
922f4c589b [to #42322933]图像去噪using msdataset to load dataset 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10338265
 2022-10-11 22:46:30 +08:00
bin.xue
0d97f8959d [to #42322933] test: unify kws pipeline input type to AUDIO 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10362437
 2022-10-11 22:24:19 +08:00
ashui.cbh
69da8f91ac [to #42322933]suport image inpainting 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10111615
 2022-10-11 20:49:13 +08:00
james.wjg
4c99363804 [to #42322933]video summarization 添加 license & header; 修改 output for demo service 
video summarization:
1. 添加 license & header; 
2. 修改 output for demo service
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10260946
 2022-10-11 17:24:46 +08:00
jiaqi.sjq
65be443e98 [to #41669377] Add more models to test in tts UT 
Link https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10360754#tab=detail
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10360754
 2022-10-11 17:22:58 +08:00
zhangzhicheng.zzc
e240edea7e [to #42322933]t5 bug fixex 2022-10-11 17:20:11 +08:00
hanyuan.chy
67d6fa001d [to #42322933] unify keys forbody_3d_keypoints 
统一关键点检测输出key的名字
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10359335
 2022-10-11 17:17:51 +08:00
laiyin.lyc
09d2296f36 [to #44847108] add sparsity hook (pst algorithm) 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10198228

    * [to #44847108] add sparsity hook (pst algorithm)
 2022-10-11 16:05:20 +08:00
ryan.yy
ff69439c4f [to #42322933]add image_body_reshaping code 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10217723

    * add image_body_reshaping code
 2022-10-10 17:42:41 +08:00
moyu.wk
42896de709 [to #42322933]add pipelines for APE\QE\Domain Classifications 
Add pipelines for the following new models:
- [Multilingual Quality Estimation](https://modelscope.cn/models/damo/nlp_translation_quality_estimation_multilingual/summary)
- [Automatic Post-Editing (En-De)](https://modelscope.cn/models/damo/nlp_automatic_post_editing_for_translation_en2de/summary)
- [Domain classification (Zh)](https://modelscope.cn/models/damo/nlp_domain_classification_chinese/summary)
- [Style classification (Zh)](https://modelscope.cn/models/damo/nlp_style_classification_chinese/summary)
- [Style classification (En)](https://modelscope.cn/models/damo/nlp_style_classification_english/summary)
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10315370
 2022-10-10 11:36:39 +08:00
wenmeng.zwm
65bea053af [to #44902165] feat: Add input signature for pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10233235

* add input definition for pipeline


* support multiple input format for single pipeline


*  change param for body_3d_keypoints
 2022-10-09 18:59:07 +08:00
tingwei.gtw
a079ab922f [to #42322933] add product-segmentation pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10252583
 2022-10-01 21:46:40 +08:00
tingwei.gtw
5343c899fb [to #42322933] add face-emotion pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10202117
 2022-10-01 18:35:42 +08:00
hanyuan.chy
7f468acca3 [to #42322933]style(license): add license + render result poses with video 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10263904
 2022-10-01 18:34:23 +08:00
tingwei.gtw
4199af337e [to #42322933] add face-human-hand detection model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10260332
 2022-10-01 15:57:12 +08:00
lllcho.lc
9fa761d7a6 [to #42322933] add PST action recognition model 
Add patch shift transformer model for action recognition task.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10282964
 2022-10-01 11:10:36 +08:00
chaojie.mcj
0e52a20d28 [to #42322933]update license 
以下算法进行了header变更：
modelscope.models.cv.cmdssl_video_embedding
modelscope.models.cv.action_recognition 
modelscope.models.cv.animal_recognition
modelscope.models.multi_modal.multi_stage_diffusion
modelscope.models.multi_modal.gemm

modelscope.pipelines.cv.live_category_pipeline
modelscope.pipelines.cv.video_category_pipeline
modelscope.models.cv.image_to_image_translation
modelscope.models.cv.image_to_image_generation

modelscope.models.cv.video_inpainting
modelscope.models.multi_modal.diffusion
modelscope.models.multi_modal.team
modelscope.models.cv.shop_segmentation
modelscope.models.cv.text_driven_segmentation
modelscope.models.cv.action_recognition 


modelscope.models.cv.face_emotion
modelscope.models.cv.hand_static
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10268474
 2022-09-28 14:30:37 +08:00
Yingda Chen
11b33164c3 [to #42322933] disable t5 test temporarily 2022-09-28 09:26:44 +08:00
zhangzhicheng.zzc
d721fabb34 [to #42322933]bert with sequence classification / token classification/ fill mask refactor 
1.新增支持原始bert模型（非easynlp的 backbone prefix版本）
2.支持bert的在sequence classification/fill mask /token classification上的backbone head形式
3.统一了sequence classification几个任务的pipeline到一个类
4.fill mask 支持backbone head形式
5.token classification的几个子任务（ner，word seg， part of speech）的preprocessor 统一到了一起TokenClassificationPreprocessor
6. sequence classification的几个子任务（single classification， pair classification）的preprocessor 统一到了一起SequenceClassificationPreprocessor
7. 改动register中 cls的group_key 赋值位置，之前的group_key在多个decorators的情况下，会被覆盖，obj_cls的group_key信息不正确
8. 基于backbone head形式将 原本group_key和 module同名的情况尝试做调整，如下在modelscope/pipelines/nlp/sequence_classification_pipeline.py 中 
原本
 @PIPELINES.register_module(
    Tasks.sentiment_classification, module_name=Pipelines.sentiment_classification)
改成
@PIPELINES.register_module(
    Tasks.text_classification, module_name=Pipelines.sentiment_classification)
相应的configuration.json也有改动，这样的改动更符合任务和pipline（子任务）的关系。
8. 其他相应改动为支持上述功能
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10041463
 2022-09-27 23:08:33 +08:00