Commit Graph

752 Commits

Author SHA1 Message Date
ada.drx
7298bd2bb4 mgeo fix finetune for rerank test case and reduce UT time
* reduce UT time 
* fix finetune for rerank test case

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11563740
2023-02-07 02:55:33 +00:00
shuying.shu
f3f4332105 add ddpm-segmentation pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11467103
2023-02-07 02:03:02 +00:00
mulin.lyh
b2fbbce4c1 [to #47645858]fix: diff based ci ignore modelscope/utils/constant.py modelscope/metainfo.py
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11559303

    * [to #47645858]fix: diff based ci ignore modelscope/utils/constant.py modelscope/metainfo.py

* test ignore metainfo.py file
2023-02-06 12:37:33 +00:00
dawei.fdw
310e9c7dbf add plug mental model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11549696

* add plug mental model code

* add test pipeline and fix annotation format bugs
2023-02-06 10:57:20 +00:00
mulin.lyh
e54694690f [to #46993990]feat: run ci cases base on code diff to reduct ci test time 2023-02-06 08:00:19 +00:00
kangxiaoyang.kxy
db2f203e5d add video-colorization pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11501772
2023-02-06 06:37:19 +00:00
xiangpeng.wxp
cff63fb79b [to #42322933] add en2ru and ru2en pipeline ut v4
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11549835

    * add en2ru and ru2en pipeline ut v4
2023-02-06 05:26:55 +00:00
shichen.fsc
8fb2632e26 kws fix the result of length not correct
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11515961
2023-02-06 03:42:01 +00:00
wendi.hwd
0d3976920d support image demoireing
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11494900
2023-02-06 02:03:01 +00:00
xingjun.wxj
f5745d869d [to #42322933] modify test_level of UT test_to_ms_dataset to avoid connection timeout issue 2023-02-05 12:20:19 +00:00
zhangzhicheng.zzc
e20a72be07 remove function level imports index
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11537482
2023-02-04 10:26:00 +00:00
mulin.lyh
9734a732dd temp skip tests/pipelines/test_realtime_object_detection.py 2023-02-03 10:02:20 +08:00
ly261666
35b4134195 [to #42322933] add face recognition ir model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11472325
2023-02-02 13:18:06 +00:00
mulin.lyh
50a1d3908c fix delete model revision 2023-02-02 18:55:51 +08:00
xiangpeng.wxp
8e06def4ca [to #42322933] fix indice error and support batch inference for nlp_csanmt_translation_en2zh
* support batch inference
* fix indice error and add en2ru ut
* fix indice error and add en-ru ut

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11512405
2023-02-02 04:07:38 +00:00
lllcho.lc
64abee6417 [to #42322933] add new motion-generation model
新增运动生成模型,根据文本描述,生成人体的运动数据
2023-02-01 09:48:58 +00:00
tanfan.zjh
5f0e99996a 新增模型测试用例
新增模型测试用例
1. 多轮对话改写模型:damo/nlp_mt5_dialogue-rewriting_chinese-base
2. 多语言FAQ模型:damo/nlp_faq-question-answering_multilingual-base
3. fact-checking模型:damo/nlp_structbert_fact-checking_chinese-base
4. 电商领域文本相似度模型:damo/nlp_structbert_sentence-similarity_chinese-retail-base

均不涉及sdk更新,仅新增模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11477190
2023-01-31 10:10:59 +00:00
ly261666
2026f8393e [to #42322933] add face recognition face mask model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11472495
2023-01-31 09:55:07 +00:00
pengteng.spt
e502e89c61 Split training and evaluating code for nearfield kws trainer
* fix judgement of fa case for certain keywords in det
 * split code so that train and evaluate can be single used
 * fix pre-commit errors

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11453810
2023-01-31 09:43:19 +00:00
wanyu.wy
0c778c9a5a [to #42322933] Fix bugs for UniTE
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11482837
2023-01-31 02:20:55 +00:00
huizheng.hz
e7fec36a46 change test image for image deblur
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11444794
2023-01-16 13:25:40 +00:00
mxf164419
01f0c747c7 add easyrobust-models for image classification
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11372821
2023-01-16 10:02:34 +00:00
qianmu.ywh
df0c3bebc5 video depth estimation support cpu mode
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11442862
2023-01-16 09:54:45 +00:00
shouzhou.bx
f6c884b5ec [to #42322933][BUG FIX]bug fix for hand detect ft
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11439551
2023-01-16 05:07:25 +00:00
ly103369
52e443556f change output oftask text to image to list of images
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11437035

* stablediffusion io format

* text2img task format to output_imgs and numpy list

* other text2img io format
2023-01-15 13:30:10 +00:00
klayzhang.zb
515ec5bfe0 [to #42322933][FIX] fix batch postprocessor bug
1. 修复batch处理带来的postprocessor的错误
2. 修复SDK中preprocessor base.py中cfg的bug。
3. 新增max_length

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11435946
2023-01-14 14:30:18 +00:00
xingjun.wxj
196489a2c2 [to #42322933] fix test issues
1. support the form of '/to/path/abc.csv' in MsDataset.load() function
2. fix the compatibility issue of datasets
3. modify the resumable cache path for oss utils
4. add UT cases
2023-01-13 14:57:16 +00:00
bin.xue
854c1e6cbf [to #42322933] bugfix: separation.evaluate() failed
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11426908
2023-01-13 09:19:31 +00:00
zhangzhicheng.zzc
241c675f60 Revert "[to #47017903] add file io with lock "
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11426323

This reverts commit 075eb1eddb.
2023-01-13 06:38:57 +00:00
ly261666
93da112af6 [to #42322933] Add RTS face recognition ood model
1. Add RTS face recognition ood model
2. fix ast parse failed when constant str is paased to register_moduel

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10788393
2023-01-13 02:09:26 +00:00
shimin.ysm
f7930c23a0 add cv/image-defrcn-fewshot-detection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11364804

* add model defrcn-fewshot-detection

* add requirements check
2023-01-12 12:48:38 +00:00
baiguan.yt
8cd79a4fea add hires gpen model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11185733
2023-01-12 18:01:23 +08:00
ada.drx
2309596161 add mgeo finetune and pipeline
MGeo is a multi-modal multi-task geographic language model.
We support 5 pipeline tasks and 1 pretrained model MGeo on maas.
In the same time, we propose GeoGLUE, a geographic evaluation benchmark. MGeo can be finetuned on GeoGLUE tasks.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11273012


* add prov city dist feature to gis encoder

* finish mgeo fintune and pipeline

* text classification add token type id

* to_device support ModelOutput class

* update token classification model lable mask logic
2023-01-12 17:55:14 +08:00
jiangyu.xzy
c8c1b7f1a8 add asr finetune & change inference
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11403205

* support asr new models & vad-punc models
2023-01-12 16:01:54 +08:00
mulin.lyh
0ee11704db temp test_automatic_speech_recognition.py 2023-01-12 16:00:14 +08:00
zjh271224
8ea29a1df4 add quadtree_image_matching
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11199857

 * init quadtree code
 * quadtree attention image matching can run in modelscope pipeline
 * jit build quadtree attention
 * update license info
2023-01-12 15:56:51 +08:00
zhangzhicheng.zzc
075eb1eddb [to #47017903] add file io with lock
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11402082
2023-01-12 13:22:47 +08:00
hemu.zp
06296c1819 [to #42322933] Fix evaluation oom
Add merge method for all metrics, parallel metrics can be merged when using data parallel. No longer save all data in the evaluation process to avoid oom.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11399082
2023-01-12 13:02:54 +08:00
xianzhe.xxz
393aa01e2b 支持DAMO-YOLO系列模型的Finetune功能。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11249980

* add tinynas-detection trainer, evaluater and dataloader.

* add timmer and general torch dist tools.

* replace loguru with modelscope standard logger.

* merge duplicate tinynas-detection model files.

* add compatibility of json config files.
2023-01-12 11:08:17 +08:00
ly261666
66f7134db8 [to #42322933] Add FLRGB Face Liveness RGB Model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11264617
2023-01-12 10:05:56 +08:00
klayzhang.zb
f9a01acecf [to #42322933] text-error-correction support batch inference
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11398895
2023-01-12 09:33:56 +08:00
bin.xue
78f812dbb6 [to #42322933] add speech separation finetune
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11379892
2023-01-12 07:02:46 +08:00
jiangyu.xzy
3989b8da32 asr inference: support new models, punctuation, vad, sv
asr推理支持新模型,以及支持标点后处理、端点检测、说话人确认
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11366442

    * support asr new models & vad-punc models

* fix conflict

* fix format

* Merge branch 'master' into asr/asr_inference

* add punc pipeline

* add punc model

* add sv infer

* fix format

* Merge branch 'master' into asr/asr_inference

* fix sv pipeline

* remove useless comments

* fix asr_test

* fix format

* fix output format

* change test level of models which would be removed later.
2023-01-11 23:28:14 +08:00
gongbiao.gb
5debc88edf add vop retrieval
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11302991
2023-01-11 22:22:12 +08:00
huizheng.hz
466200f355 NAFNet Image Deblurring pipeline and finetune support
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11300932

* fix psnr/ssim metrics for NAFNet (image denoise)

* add subset_name when loading dataset (NAFNet image denoising)
2023-01-11 22:18:03 +08:00
pangda
ae5caf584a [to #42322933] add UT for adaseq span-based ner pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11398124
2023-01-11 22:13:03 +08:00
hemu.zp
a277b343af [to #42322933] Add beam search and pair finetune for GPT-3
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11397726

* test finetune weather

* support ppl and generation metrics
2023-01-11 22:04:11 +08:00
ly103369
0e54e80b23 add Damo Chinese Stable Diffusion and fix bugs in DiffusersPipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11386214

* chinese sd & fix sdwrapper

* impl preprocess and postprocess in DiffusersPipeline

* add accelerate requirements
2023-01-11 21:49:58 +08:00
zhangzhicheng.zzc
b1b65c2597 add megatron bert 2023-01-11 21:45:42 +08:00
shenweichao.swc
1f9d6e51f6 [to #42322933] Add panovit-layout-estimation-pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11234460
2023-01-11 20:43:09 +08:00