Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 20:49:37 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,471 Commits 263 Branches 106 Tags
8c39eefeff778a6c53c9cc3cdad37da100eda2c5
Commit Graph

833 Commits

Author SHA1 Message Date
hemu.zp
ceeb85f10f [to #42322933] Support multi-machine data and tensor parallel finetuning 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11682479
 2023-02-28 18:47:17 +08:00
myf272609
51cf0b16a8 [to #42322933] add fintune support for cartoon task 
人像卡通化模型增加训练支持

 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11675597

* add fintune support for cartoon
 2023-02-28 17:01:34 +08:00
yuze.zyz
7181e667f6 Refactor hooks 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11651547
 2023-02-28 13:51:01 +08:00
zhicheng.sc
d11fff0c0a add ControlNet for controllable image generation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11697239

* add ControlNet for scribble2image

* update code comments

* support scribble input

* update scribble input for demo service

* support all models of ControlNet

* add requirements

* fix code style bug

* update model id
 2023-02-28 13:39:12 +08:00
lee.lcy
a0877216a4 fix(damoyolo): fix FileNotFoundError when using trainer.evaluate() && add work_dir and exp_name to kwargs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11793714

    * fix(damoyolo): fix FileNotFoundError when using trainer.evaluate() && add work_dir and exp_name to kwargs

* style(damoyolo): add code annotation to ImageDetectionDamoyoloTrainer
 2023-02-27 19:26:12 +08:00
wenmeng.zwm
6a13557c19 Merge branch 'master-github' into merge_master_github_0224 2023-02-24 11:16:35 +08:00
klayzhang.zb
4ca52a0934 [to #42322933] fix for text error correction: generate <unk> when input contains upper letter 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11762322

* [fix] fix: generate <unk> when input contains upper letter

* compatible new fairseq version
 2023-02-24 09:45:28 +08:00
zhk1425734486
99d2177bb0 landing AI: tbs image detection pull request (#84) 
https://modelscope.cn/models/landingAI/LD_CytoBrainCerv/summary

兰丁宫颈细胞AI辅助诊断模型

Co-authored-by: QZStudio <1643006760@qq.com>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
 2023-02-22 20:25:37 +08:00
zhangzhicheng.zzc
3e4ee5958a [to #47939677] load only backbone with weights 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11679242

* load backbone with weights directly
 2023-02-21 22:41:14 +08:00
mulin.lyh
386be89f3d [to #47947101]fix: fix diff based case not process deleted file 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11729541
 2023-02-21 20:50:03 +08:00
wenmeng.zwm
6599d2c7cd skip test_image_structured_model_probing 2023-02-21 12:08:22 +08:00
wenmeng.zwm
ef615d48af skip test_image_structured_model_probing 2023-02-21 12:07:28 +08:00
wenmeng.zwm
285208912b add command line tool 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11661608

* add command line tool

* add unittest

* change absolute import to relative import for test case

* mv test_util to package
 2023-02-20 21:21:54 +08:00
xingzhang.rxz
1ae4782c83 add langident codes 
语种识别模型完成开发
模型地址：https://www.modelscope.cn/models/damo/nlp_language_identification-classification-base/summary

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11652333
 2023-02-17 15:21:33 +08:00
wenmeng zhou
3ca68bf22f remove profiling log (#113) 
UT test by default does not run profiling
 2023-02-17 12:01:54 +08:00
shuying.shu
615c443020 [to #42322933] add test condition for GPU availablity 
damo/cv_diffusion_image-segmentation不支持cpu环境测试

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11689517
 2023-02-16 11:13:53 +00:00
ryan.yy
a0c020cf34 [to #42322933] nerf model test add gpu constraint 2023-02-14 11:47:49 +00:00
wenqi.oywq
7499370569 [to #42322933] Fix the bug that image_color_enhance_pipeline cannot run in CPU environment 
adaint need to compile CUDA extension, so remove releated import from pipeline

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11660260
 2023-02-14 11:31:00 +00:00
fubang.zfb
4b29f28a04 siamese uie supports string-type schema input 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11655620
 2023-02-14 08:36:46 +00:00
fubang.zfb
e7cb55d4a6 Add SiameseUIE general information extraction model and pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11641614
 2023-02-14 03:56:29 +00:00
yuze.zyz
90af43f749 [to #47563396]Fix bug: two ckpt hooks save in the same dir 
1. Support two checkpoint hooks saving final checkpoints in two difference folders
2. Remove the check of checkpoint hooks
3. Fix a incorrect modification in UT
4. Fix bug: Checkpoint.load_checkpoint has been moved out
5. Add UT for new style configuration
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11630170
 2023-02-13 16:54:02 +00:00
wenmeng.zwm
82f10f73aa [to #42322933] fix: pipeline base potential bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11645650

* test batched inference and no auto collate logic
 2023-02-13 13:49:42 +00:00
ashui.cbh
e7c5c116c5 [to #42322933] add test condition for GPU availablity 2023-02-13 11:50:30 +00:00
fuhaomin.fhm
2fced1c06f [to #42322933] Doc2Bot documentation with retrieval rerank, generation 2023-02-12 03:09:33 +00:00
zhicheng.sc
5b3ce816a5 sd2-inpainting: change output to numpy array in bgr order 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11629631
 2023-02-10 14:26:09 +00:00
haolan.xhl
e537f9df1d [to #42322933] add vqa-degradation 
add new model for image_quality_assessment_degradation
 2023-02-10 11:59:59 +00:00
ly261666
2c8f9801a2 [to #42322933] add content check model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11473049
 2023-02-10 08:18:26 +00:00
wk258730
05a407da7f add pipelines for en2zh-imt and zh2en-imt 
*[ 交互式机器翻译-英中-通用领域-large](https://modelscope.cn/models/damo/nlp_imt_translation_en2zh/summary)
*[ 交互式机器翻译-中英-通用领域-large](https://modelscope.cn/models/damo/nlp_imt_translation_zh2en/summary)

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11593182
 2023-02-10 08:13:18 +00:00
hejunjie.hjj
6fc15926a3 [to #42322933] add single and multiple human parsing models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11508413
 2023-02-10 08:01:23 +00:00
wenmeng.zwm
677e49eaf3 update api doc 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11582587
 2023-02-10 07:48:11 +00:00
shimin.ysm
9b0e302a66 refine cv_image_defrcn trainer to avoid failed 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11622570
 2023-02-10 07:10:59 +00:00
wenqi.oywq
6c5eb3bab3 Add AdaInt model 
新增加 adaint 模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11588338


* 复用image color enhance pipeline

* mv cuda extension to ops

* 修改adaint模型初始化方式，去掉封装
 2023-02-10 06:48:22 +00:00
zhangzhicheng.zzc
f88b03ab72 [to #47307896] update backbone-head 
The original backbone-head abstraction was not articheted well enough, the input and output parameters of backbone and head were in the form of **kwargs, which was implicit and might cause confustion. Therefore, the following adjustments were made:
原有backbone head抽象程度不够深，backbone 以及head输入输出参数为**kwargs，比较晦涩，同时很多功能无法支持扩展，因此做了如下调整：

1. Divide the basic model based on the structure to: encoder-only model, decoder-only model, single stage model, two stage model, etc., . Now, the encoder-only model was accomplished, while others are under design
2. Derive the structed task-models from the basic model structure above: a single structed task-model is mainly used to parse the backbone/head cfg, in order to apply the correct backbone or head components, some models might adjust the forward method from the basic model
3. Add the initialization parameters, input and output parameters to head class and backbone class, in order to reduce the understanding cost.
4. Remove the original nncrf class and chang it to backbone-head form with the lstm backbone and crf head.
5. Support  `model = Model.from_pretrained('bert-based-fill-mask', task='text-classification')`, this method could correctly load the backbone even when the task is different from the original one in configuration.
6. Support loading the model through the transformer's automodel, in the case of quickly integrating the backbone model without coding
7. Unifiy the original task classes in each nlp model and the structed task-model classes, the structed task-model are largely reduce the redundant codes in the original task classed. Still under refactor
8. Support load model configuration from hf transformers config.json, if the model related configuration is missing. Only suppport NLP models
 2023-02-10 06:46:47 +00:00
qize.yqz
5e88cfe693 add open vocabulary detection 
添加了开放词汇目标检测任务和模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11548569
 2023-02-10 06:37:51 +00:00
yuze.zyz
ca1321f53f Support trainer prediction and fix some bugs 
1. Support trainer prediction
2. Fix bug in text classification metric
3. Move load checkpoint out of checkpointhook
4. Fix bug in train progressing (inner_iter variable not correct)

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11560269
 2023-02-10 06:19:37 +00:00
zhangyanzhao.zyz
e6c05a2931 sentence-embedding support finetune 
sentence-embedding模型支持finetune

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11537009
 2023-02-10 06:07:38 +00:00
zhongning.hzn
27304e38b0 Add bad image detection model and pipeline 
坏帧检测bad_image_detecting模型CR 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11580680
 2023-02-10 05:33:57 +00:00
hemu.zp
82482b3e96 update training args 
Based on feat/0131/nlp_args branch, the original code review: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11408570

Support for running finetuning from the command line with training args, Compatible with the configuration optimization.
 2023-02-10 05:32:21 +00:00
yuze.zyz
4dca4773db Support csanmt exporting and refactor some code 
1. Support csanmt exporting to savedmodel format
2. Create a new base class for text-ranking preprocessors, and move some parameters of mgeo_ranking_preprocessor to init method
3. Avoid Model & Preprocessor classes coupled with pytorch
4. Regression test supports comparing only model output
5. Support zero-shot exporting to onnx and torchscript

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11522461
 2023-02-10 05:15:04 +00:00
jiangyu.xzy
9f1b767ecd asr训练dataset & 单独vad模型推理 & 多模型组合的asr推理 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11610526

* add asr dataset

* sv num_workers 0

* add vad pipeline

* add flexible vad/punc/lm model inputs
 2023-02-10 05:09:00 +00:00
xixing.tj
b5e881148a add ocr detection new model and pipeline for dbnet 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11574897
 2023-02-10 05:02:59 +00:00
ly261666
b4ad0e49fb [to #42322933] add face quality assessment model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11473023
 2023-02-10 04:59:08 +00:00
ljh263654
29e47e5030 add video deinterlace model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11508847


* add video deinterlace model

* resolve conflict for video deinterlace

* fix CR problems
 2023-02-10 02:15:49 +00:00
mulin.lyh
c0a92403c8 Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib 2023-02-10 10:14:36 +08:00
mulin.lyh
fd7fd38da0 fix failed case 2023-02-10 10:14:24 +08:00
lingxi.yz
2d55e0f2ff [to #42322933] add abnormal detection models 
添加了针对长尾/小目标问题解决的异常视觉检测模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11536379
 2023-02-10 02:13:33 +00:00
hanyuan.chy
6da3be3047 Add HDFormer for 3d pose estimation of body 
新增HDFormer 3D人体姿态估计模型 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11576328

* add hdformer

* rm redundent pipeline

* add license

* add test case
 2023-02-10 02:13:09 +00:00
yuanzhi.zyz
0894b1ea71 add ocr_recognition crnnnetwork 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11569972

 * add crnnnetwork

* add reviews

* fix conflict
 2023-02-10 02:11:59 +00:00
wenqi.oywq
da417655f2 新增deeplpf和debanding模型 
1. 新增加 image_debanding 模型
2. 新增加 deeplpf_image_color_enhance 模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11579722
 2023-02-09 13:08:50 +00:00
xianhui.lxh
b9ed767bbb [to #42322933] add ecbsr model for mobile image super-resolution 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11561999

* add mobile super-resolution pipeline and ecbsr model

* fix format error
 2023-02-09 12:59:05 +00:00