Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 12:39:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,281 Commits 263 Branches 106 Tags
3eda77aa4f7336c674844e7df56d028879cefdb5
Commit Graph

1281 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
pangda
3eda77aa4f [to #42322933] re-place import torchaudio to avoid unnecessary requirements in framework 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11499744
 2023-01-31 11:33:15 +00:00
tanfan.zjh
5f0e99996a 新增模型测试用例 
新增模型测试用例
1. 多轮对话改写模型：damo/nlp_mt5_dialogue-rewriting_chinese-base
2. 多语言FAQ模型：damo/nlp_faq-question-answering_multilingual-base
3. fact-checking模型：damo/nlp_structbert_fact-checking_chinese-base
4. 电商领域文本相似度模型：damo/nlp_structbert_sentence-similarity_chinese-retail-base

均不涉及sdk更新，仅新增模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11477190
 2023-01-31 10:10:59 +00:00
ly261666
2026f8393e [to #42322933] add face recognition face mask model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11472495
 2023-01-31 09:55:07 +00:00
pengteng.spt
e502e89c61 Split training and evaluating code for nearfield kws trainer 
* fix judgement of fa case for certain keywords in det
 * split code so that train and evaluate can be single used
 * fix pre-commit errors

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11453810
 2023-01-31 09:43:19 +00:00
Yingda Chen
af62b3e9ad limit pyarrow version 2023-01-31 11:35:09 +08:00
wanyu.wy
0c778c9a5a [to #42322933] Fix bugs for UniTE 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11482837
 2023-01-31 02:20:55 +00:00
yingda.chen
2e029a1eda update requirment and fix some typos 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11479462
 2023-01-31 01:23:56 +00:00
ly103369
14afbfd39a Compatible with diffusers0.12.1 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11479564
 2023-01-29 14:47:48 +00:00
xingjun.wxj
5a01eca834 [to #42322933] fix datasets version incompatible issue 
最近release的datasets==2.9.0版本在IterableDataset等类和方法上，与老版本(<=2.8.0)不兼容；修改requirements将其版本限制在2.7.0~2.8.0

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11476999

* fix datasets==2.8.0 and datasets==2.9.0 incompatible issue
 2023-01-29 11:13:09 +00:00
huizheng.hz
e7fec36a46 change test image for image deblur 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11444794
 2023-01-16 13:25:40 +00:00
mxf164419
01f0c747c7 add easyrobust-models for image classification 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11372821
 2023-01-16 10:02:34 +00:00
qianmu.ywh
df0c3bebc5 video depth estimation support cpu mode 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11442862
 2023-01-16 09:54:45 +00:00
jiangyu.xzy
78d9952ee3 asr inference add output_dir when called 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11444628
 2023-01-16 09:50:06 +00:00
shouzhou.bx
f6c884b5ec [to #42322933][BUG FIX]bug fix for hand detect ft 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11439551
 2023-01-16 05:07:25 +00:00
wenmeng.zwm
da62734a31 fix logger call 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11437009
 2023-01-16 01:32:34 +00:00
ly103369
52e443556f change output oftask text to image to list of images 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11437035

* stablediffusion io format

* text2img task format to output_imgs and numpy list

* other text2img io format
 2023-01-15 13:30:10 +00:00
jiangyu.xzy
b557753f7e asr backward compatibility tensorflow inference fix 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11436927
 2023-01-15 10:24:02 +00:00
wenmeng.zwm
fdce271af0 remove unnecessary files 2023-01-15 11:56:36 +08:00
klayzhang.zb
515ec5bfe0 [to #42322933][FIX] fix batch postprocessor bug 
1. 修复batch处理带来的postprocessor的错误
2. 修复SDK中preprocessor base.py中cfg的bug。
3. 新增max_length

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11435946
 2023-01-14 14:30:18 +00:00
zhangzhicheng.zzc
30dace6e43 add zhconv to nlp requirements 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11435768
 2023-01-14 08:13:35 +00:00
xingjun.wxj
196489a2c2 [to #42322933] fix test issues 
1. support the form of '/to/path/abc.csv' in MsDataset.load() function
2. fix the compatibility issue of datasets
3. modify the resumable cache path for oss utils
4. add UT cases
 2023-01-13 14:57:16 +00:00
jiangyu.xzy
742ad4b355 sv inference & asr trainer: add new inputs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11424993

* add sv_inference for speaker embedding extraction

* add raw inputs support for speaker_verification

* add train meta_params
 2023-01-13 13:52:52 +00:00
zhangzhicheng.zzc
883bbd0164 fix file dir creation error with native method 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11433444
 2023-01-13 13:52:09 +00:00
wenmeng.zwm
5efa472f3d mv mmcls preprocessor to single file to avoid necessary requirement for mmcv and mmcls 
remove mmcls preprocessor form image.py to avoid require mmcv and mmcls when using common preprocessor in image.py

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11429491
 2023-01-13 10:10:13 +00:00
zhangzhicheng.zzc
3bd47bf87e [ to #47017903 ]file directory create error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11429035
 2023-01-13 10:09:41 +00:00
bin.xue
854c1e6cbf [to #42322933] bugfix: separation.evaluate() failed 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11426908
 2023-01-13 09:19:31 +00:00
zhangzhicheng.zzc
241c675f60 Revert "[to #47017903] add file io with lock " 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11426323

This reverts commit 075eb1eddb.
 2023-01-13 06:38:57 +00:00
mulin.lyh
0a3c2ea99c trainer counter only request one time 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11423454
 2023-01-13 06:31:58 +00:00
hemu.zp
9b353fd10e [to #42322933] add requirements rouge 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11422746
 2023-01-13 02:31:56 +00:00
ly261666
93da112af6 [to #42322933] Add RTS face recognition ood model 
1. Add RTS face recognition ood model
2. fix ast parse failed when constant str is paased to register_moduel

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10788393
 2023-01-13 02:09:26 +00:00
ni.chongjia
9baa236d85 modify itn pipeline for return dict 
修改了itn 推理pipeline的返回值, 按照上一个commit, 定义了output key 再outputs.py
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11421065

    * modify inverse_text_processing_pipeline.py

* modify itn pipeline

* define output key in outputs.py
 2023-01-12 14:34:22 +00:00
shimin.ysm
f7930c23a0 add cv/image-defrcn-fewshot-detection 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11364804

* add model defrcn-fewshot-detection

* add requirements check
 2023-01-12 12:48:38 +00:00
baiguan.yt
8cd79a4fea add hires gpen model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11185733
 2023-01-12 18:01:23 +08:00
ada.drx
2309596161 add mgeo finetune and pipeline 
MGeo is a multi-modal multi-task geographic language model.
We support 5 pipeline tasks and 1 pretrained model MGeo on maas.
In the same time, we propose GeoGLUE, a geographic evaluation benchmark. MGeo can be finetuned on GeoGLUE tasks.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11273012


* add prov city dist feature to gis encoder

* finish mgeo fintune and pipeline

* text classification add token type id

* to_device support ModelOutput class

* update token classification model lable mask logic
 2023-01-12 17:55:14 +08:00
wenmeng.zwm
f8b7de20b7 bump version to 1.2.0 2023-01-12 17:27:07 +08:00
jiangyu.xzy
c8c1b7f1a8 add asr finetune & change inference 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11403205

* support asr new models & vad-punc models
 2023-01-12 16:01:54 +08:00
mulin.lyh
0ee11704db temp test_automatic_speech_recognition.py 2023-01-12 16:00:14 +08:00
zjh271224
8ea29a1df4 add quadtree_image_matching 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11199857

 * init quadtree code
 * quadtree attention image matching can run in modelscope pipeline
 * jit build quadtree attention
 * update license info
 2023-01-12 15:56:51 +08:00
zhangzhicheng.zzc
075eb1eddb [to #47017903] add file io with lock 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11402082
 2023-01-12 13:22:47 +08:00
hemu.zp
06296c1819 [to #42322933] Fix evaluation oom 
Add merge method for all metrics, parallel metrics can be merged when using data parallel. No longer save all data in the evaluation process to avoid oom.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11399082
 2023-01-12 13:02:54 +08:00
xianzhe.xxz
393aa01e2b 支持DAMO-YOLO系列模型的Finetune功能。 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11249980

* add tinynas-detection trainer, evaluater and dataloader.

* add timmer and general torch dist tools.

* replace loguru with modelscope standard logger.

* merge duplicate tinynas-detection model files.

* add compatibility of json config files.
 2023-01-12 11:08:17 +08:00
mulin.lyh
f540e5f571 [to #47239563]feat: add local model file check 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11321065
 2023-01-12 10:06:12 +08:00
ly261666
66f7134db8 [to #42322933] Add FLRGB Face Liveness RGB Model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11264617
 2023-01-12 10:05:56 +08:00
klayzhang.zb
f9a01acecf [to #42322933] text-error-correction support batch inference 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11398895
 2023-01-12 09:33:56 +08:00
bin.xue
78f812dbb6 [to #42322933] add speech separation finetune 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11379892
 2023-01-12 07:02:46 +08:00
jiangyu.xzy
3989b8da32 asr inference: support new models, punctuation, vad, sv 
asr推理支持新模型，以及支持标点后处理、端点检测、说话人确认
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11366442

    * support asr new models & vad-punc models

* fix conflict

* fix format

* Merge branch 'master' into asr/asr_inference

* add punc pipeline

* add punc model

* add sv infer

* fix format

* Merge branch 'master' into asr/asr_inference

* fix sv pipeline

* remove useless comments

* fix asr_test

* fix format

* fix output format

* change test level of models which would be removed later.
 2023-01-11 23:28:14 +08:00
gongbiao.gb
5debc88edf add vop retrieval 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11302991
 2023-01-11 22:22:12 +08:00
huizheng.hz
466200f355 NAFNet Image Deblurring pipeline and finetune support 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11300932

* fix psnr/ssim metrics for NAFNet (image denoise)

* add subset_name when loading dataset (NAFNet image denoising)
 2023-01-11 22:18:03 +08:00
pangda
ae5caf584a [to #42322933] add UT for adaseq span-based ner pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11398124
 2023-01-11 22:13:03 +08:00
hemu.zp
a277b343af [to #42322933] Add beam search and pair finetune for GPT-3 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11397726

* test finetune weather

* support ppl and generation metrics
 2023-01-11 22:04:11 +08:00