Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-24 12:09:22 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,825 Commits 263 Branches 106 Tags
fix/patch_dynamic_module
Commit Graph

1197 Commits

Author SHA1 Message Date
bin.xue
b4c90d8160 [to #42322933] feat: add dingding denoise model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11731594

* feat: add dingding denoise

* refactor: delete duplicated unidfsmn class

* refactor: delete empty lines

* refactor: make some methods inline

* style: add license and optimize imports

* style: comments style
 2023-03-07 21:55:10 +08:00
xuanjie.wxb
ebb50d7887 add maoe unit test 2023-03-07 15:24:37 +08:00
pangda
798aa93cba [to #42322933] add onnx/torchscript exporter for token classification models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11895085
 2023-03-07 14:12:23 +08:00
wendi.hwd
99fa2fe909 update license and revert support camouflaged-detection from latest master 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11892922

    * update license and revert support camouflaged-detection from latest master
 2023-03-07 11:41:10 +08:00
shichen.fsc
04f63ec71f [to #42322933] add new kws models in UT and update requirements/audio_kws.txt 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11830273

* [Add] add new models for kws UT

* [Update] update requirements

* pre-commit
 2023-03-06 23:14:45 +08:00
wenmeng zhou
86f71f279f Merge pull request #156 from modelscope/merge_master_internal_0302 
Merge master internal 0302
 2023-03-03 10:32:42 +08:00
fubang.zfb
dfd1058d45 siamese uie finetune support 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11706625
 2023-03-02 20:14:31 +08:00
chenxujun
20b3a679e7 Fix some words (#141) 2023-03-02 11:06:56 +08:00
wenmeng.zwm
77ff1d94d6 Revert "Add single-camera depth estimation model bts" 
This reverts commit feb4123327.
 2023-03-02 10:56:24 +08:00
wenmeng.zwm
f2f48dd305 Revert "support camouflaged-detection " 
This reverts commit ff55bd9436.
 2023-03-02 10:52:36 +08:00
ashui.cbh
329231fe9d ImagePaintbyexamplePipeline demo service 支持 
修改pipeline输出格式为numpy array 供demo service使用

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11841517
 2023-03-01 20:34:24 +08:00
xingjun.wxj
99e58c6ea3 [to #42322933] fix some feedback issues 
1. Fix the conflict between local path and remote dataset name in the form of dataset_name='namespace/dataset_name' in MsDataset.load() function.
2. Modify the obj_key.startswith value in get_split_objects_map function to adapt to dir name 'xxx/' format.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11820290

* fix the conflict between local path and namespace/dataset_name of the dataset_name

* fix function: get_split_objects_map

* add UT for loading local csv file

* add new test case for test_load_local_csv function
 2023-03-01 20:13:31 +08:00
ryan.yy
4197f72124 nerf重建加速模型 加入trainer训练模块 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11794296
 2023-03-01 12:05:57 +08:00
yuxiang.tyx
09a178d171 support onnx export for SCRFD model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11826666
 2023-03-01 10:02:49 +08:00
hemu.zp
ceeb85f10f [to #42322933] Support multi-machine data and tensor parallel finetuning 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11682479
 2023-02-28 18:47:17 +08:00
myf272609
51cf0b16a8 [to #42322933] add fintune support for cartoon task 
人像卡通化模型增加训练支持

 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11675597

* add fintune support for cartoon
 2023-02-28 17:01:34 +08:00
yuze.zyz
7181e667f6 Refactor hooks 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11651547
 2023-02-28 13:51:01 +08:00
zhicheng.sc
d11fff0c0a add ControlNet for controllable image generation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11697239

* add ControlNet for scribble2image

* update code comments

* support scribble input

* update scribble input for demo service

* support all models of ControlNet

* add requirements

* fix code style bug

* update model id
 2023-02-28 13:39:12 +08:00
lee.lcy
a0877216a4 fix(damoyolo): fix FileNotFoundError when using trainer.evaluate() && add work_dir and exp_name to kwargs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11793714

    * fix(damoyolo): fix FileNotFoundError when using trainer.evaluate() && add work_dir and exp_name to kwargs

* style(damoyolo): add code annotation to ImageDetectionDamoyoloTrainer
 2023-02-27 19:26:12 +08:00
wenmeng.zwm
6a13557c19 Merge branch 'master-github' into merge_master_github_0224 2023-02-24 11:16:35 +08:00
klayzhang.zb
4ca52a0934 [to #42322933] fix for text error correction: generate <unk> when input contains upper letter 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11762322

* [fix] fix: generate <unk> when input contains upper letter

* compatible new fairseq version
 2023-02-24 09:45:28 +08:00
zhk1425734486
99d2177bb0 landing AI: tbs image detection pull request (#84) 
https://modelscope.cn/models/landingAI/LD_CytoBrainCerv/summary

兰丁宫颈细胞AI辅助诊断模型

Co-authored-by: QZStudio <1643006760@qq.com>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
 2023-02-22 20:25:37 +08:00
zhangzhicheng.zzc
3e4ee5958a [to #47939677] load only backbone with weights 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11679242

* load backbone with weights directly
 2023-02-21 22:41:14 +08:00
mulin.lyh
386be89f3d [to #47947101]fix: fix diff based case not process deleted file 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11729541
 2023-02-21 20:50:03 +08:00
wenmeng.zwm
6599d2c7cd skip test_image_structured_model_probing 2023-02-21 12:08:22 +08:00
wenmeng.zwm
ef615d48af skip test_image_structured_model_probing 2023-02-21 12:07:28 +08:00
wenmeng.zwm
285208912b add command line tool 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11661608

* add command line tool

* add unittest

* change absolute import to relative import for test case

* mv test_util to package
 2023-02-20 21:21:54 +08:00
xingzhang.rxz
1ae4782c83 add langident codes 
语种识别模型完成开发
模型地址：https://www.modelscope.cn/models/damo/nlp_language_identification-classification-base/summary

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11652333
 2023-02-17 15:21:33 +08:00
wenmeng zhou
3ca68bf22f remove profiling log (#113) 
UT test by default does not run profiling
 2023-02-17 12:01:54 +08:00
shuying.shu
615c443020 [to #42322933] add test condition for GPU availablity 
damo/cv_diffusion_image-segmentation不支持cpu环境测试

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11689517
 2023-02-16 11:13:53 +00:00
ryan.yy
a0c020cf34 [to #42322933] nerf model test add gpu constraint 2023-02-14 11:47:49 +00:00
wenqi.oywq
7499370569 [to #42322933] Fix the bug that image_color_enhance_pipeline cannot run in CPU environment 
adaint need to compile CUDA extension, so remove releated import from pipeline

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11660260
 2023-02-14 11:31:00 +00:00
fubang.zfb
4b29f28a04 siamese uie supports string-type schema input 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11655620
 2023-02-14 08:36:46 +00:00
fubang.zfb
e7cb55d4a6 Add SiameseUIE general information extraction model and pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11641614
 2023-02-14 03:56:29 +00:00
yuze.zyz
90af43f749 [to #47563396]Fix bug: two ckpt hooks save in the same dir 
1. Support two checkpoint hooks saving final checkpoints in two difference folders
2. Remove the check of checkpoint hooks
3. Fix a incorrect modification in UT
4. Fix bug: Checkpoint.load_checkpoint has been moved out
5. Add UT for new style configuration
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11630170
 2023-02-13 16:54:02 +00:00
wenmeng.zwm
82f10f73aa [to #42322933] fix: pipeline base potential bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11645650

* test batched inference and no auto collate logic
 2023-02-13 13:49:42 +00:00
ashui.cbh
e7c5c116c5 [to #42322933] add test condition for GPU availablity 2023-02-13 11:50:30 +00:00
fuhaomin.fhm
2fced1c06f [to #42322933] Doc2Bot documentation with retrieval rerank, generation 2023-02-12 03:09:33 +00:00
zhicheng.sc
5b3ce816a5 sd2-inpainting: change output to numpy array in bgr order 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11629631
 2023-02-10 14:26:09 +00:00
haolan.xhl
e537f9df1d [to #42322933] add vqa-degradation 
add new model for image_quality_assessment_degradation
 2023-02-10 11:59:59 +00:00
ly261666
2c8f9801a2 [to #42322933] add content check model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11473049
 2023-02-10 08:18:26 +00:00
wk258730
05a407da7f add pipelines for en2zh-imt and zh2en-imt 
*[ 交互式机器翻译-英中-通用领域-large](https://modelscope.cn/models/damo/nlp_imt_translation_en2zh/summary)
*[ 交互式机器翻译-中英-通用领域-large](https://modelscope.cn/models/damo/nlp_imt_translation_zh2en/summary)

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11593182
 2023-02-10 08:13:18 +00:00
hejunjie.hjj
6fc15926a3 [to #42322933] add single and multiple human parsing models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11508413
 2023-02-10 08:01:23 +00:00
wenmeng.zwm
677e49eaf3 update api doc 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11582587
 2023-02-10 07:48:11 +00:00
shimin.ysm
9b0e302a66 refine cv_image_defrcn trainer to avoid failed 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11622570
 2023-02-10 07:10:59 +00:00
wenqi.oywq
6c5eb3bab3 Add AdaInt model 
新增加 adaint 模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11588338


* 复用image color enhance pipeline

* mv cuda extension to ops

* 修改adaint模型初始化方式，去掉封装
 2023-02-10 06:48:22 +00:00
zhangzhicheng.zzc
f88b03ab72 [to #47307896] update backbone-head 
The original backbone-head abstraction was not articheted well enough, the input and output parameters of backbone and head were in the form of **kwargs, which was implicit and might cause confustion. Therefore, the following adjustments were made:
原有backbone head抽象程度不够深，backbone 以及head输入输出参数为**kwargs，比较晦涩，同时很多功能无法支持扩展，因此做了如下调整：

1. Divide the basic model based on the structure to: encoder-only model, decoder-only model, single stage model, two stage model, etc., . Now, the encoder-only model was accomplished, while others are under design
2. Derive the structed task-models from the basic model structure above: a single structed task-model is mainly used to parse the backbone/head cfg, in order to apply the correct backbone or head components, some models might adjust the forward method from the basic model
3. Add the initialization parameters, input and output parameters to head class and backbone class, in order to reduce the understanding cost.
4. Remove the original nncrf class and chang it to backbone-head form with the lstm backbone and crf head.
5. Support  `model = Model.from_pretrained('bert-based-fill-mask', task='text-classification')`, this method could correctly load the backbone even when the task is different from the original one in configuration.
6. Support loading the model through the transformer's automodel, in the case of quickly integrating the backbone model without coding
7. Unifiy the original task classes in each nlp model and the structed task-model classes, the structed task-model are largely reduce the redundant codes in the original task classed. Still under refactor
8. Support load model configuration from hf transformers config.json, if the model related configuration is missing. Only suppport NLP models
 2023-02-10 06:46:47 +00:00
qize.yqz
5e88cfe693 add open vocabulary detection 
添加了开放词汇目标检测任务和模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11548569
 2023-02-10 06:37:51 +00:00
yuze.zyz
ca1321f53f Support trainer prediction and fix some bugs 
1. Support trainer prediction
2. Fix bug in text classification metric
3. Move load checkpoint out of checkpointhook
4. Fix bug in train progressing (inner_iter variable not correct)

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11560269
 2023-02-10 06:19:37 +00:00
zhangyanzhao.zyz
e6c05a2931 sentence-embedding support finetune 
sentence-embedding模型支持finetune

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11537009
 2023-02-10 06:07:38 +00:00