Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-24 20:19:51 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,582 Commits 267 Branches 107 Tags
feat/plugin_for_trainer
Commit Graph

626 Commits

Author SHA1 Message Date
Zhicheng Zhang
92acca0629 Feat/plugin update (#241) 
* reload pkg resources after installed

* add version test in order to install correct version

* install only uninstalled package from requirements

* support get module name from distribution

* bug fixed

---------

Co-authored-by: Zhicheng Zhang <zhangzhicheng.zzc@alibaba-inc.com>
 2023-03-30 09:00:49 +08:00
tastelikefeet
d3cec46655 Fix faq tests (#217) 2023-03-20 21:16:57 +08:00
james.wjg
1ce28bc4f9 cv/video_instance_segmentation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11891175
 2023-03-10 10:04:03 +08:00
hemu.zp
429cfee826 Support run text generation pipeline with args 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11937122
 2023-03-10 09:48:10 +08:00
xingjun.wxj
e02a260c93 Refactor the task_datasets module 
Refactor the task_datasets module:

1. Add new module modelscope.msdatasets.dataset_cls.custom_datasets.
2. Add new function: modelscope.msdatasets.ms_dataset.MsDataset.to_custom_dataset().
2. Add calling to_custom_dataset() func in MsDataset.load() to adapt new custom_datasets module.
3. Refactor the pipeline for loading custom dataset: 
	1) Only use MsDataset.load() function to load the custom datasets.
	2) Combine MsDataset.load() with class EpochBasedTrainer.
4. Add new entry func for building datasets in EpochBasedTrainer: see modelscope.trainers.trainer.EpochBasedTrainer.build_dataset()
5. Add new func to build the custom dataset from model configuration, see: modelscope.trainers.trainer.EpochBasedTrainer.build_dataset_from_cfg()
6. Add new registry function for building custom datasets, see: modelscope.msdatasets.dataset_cls.custom_datasets.builder.build_custom_dataset()
7. Refine the class SiameseUIETrainer to adapt the new custom_datasets module.
8. Add class TorchCustomDataset as a superclass for custom datasets classes.
9. To move modules/classes/functions:
	1) Move module msdatasets.audio to custom_datasets
	2) Move module msdatasets.cv to custom_datasets
	3) Move module bad_image_detecting to custom_datasets
	4) Move module damoyolo to custom_datasets
	5) Move module face_2d_keypoints to custom_datasets
	6) Move module hand_2d_keypoints to custom_datasets
	7) Move module human_wholebody_keypoint to custom_datasets
	8) Move module image_classification to custom_datasets
	9) Move module image_inpainting to custom_datasets
	10) Move module image_portrait_enhancement to custom_datasets
	11) Move module image_quality_assessment_degradation to custom_datasets
	12) Move module image_quality_assmessment_mos to custom_datasets
	13) Move class LanguageGuidedVideoSummarizationDataset to custom_datasets
	14) Move class MGeoRankingDataset to custom_datasets
	15) Move module movie_scene_segmentation custom_datasets
	16) Move module object_detection to custom_datasets
	17) Move module referring_video_object_segmentation to custom_datasets
	18) Move module sidd_image_denoising to custom_datasets
	19) Move module video_frame_interpolation to custom_datasets
	20) Move module video_stabilization to custom_datasets
	21) Move module video_super_resolution to custom_datasets
	22) Move class GoproImageDeblurringDataset to custom_datasets
	23) Move class EasyCVBaseDataset to custom_datasets
	24) Move class ImageInstanceSegmentationCocoDataset to custom_datasets
	25) Move class RedsImageDeblurringDataset to custom_datasets
	26) Move class TextRankingDataset to custom_datasets
	27) Move class VecoDataset to custom_datasets
	28) Move class VideoSummarizationDataset to custom_datasets
10. To delete modules/functions/classes:
	1) Del module task_datasets
	2) Del to_task_dataset() in EpochBasedTrainer
	3) Del build_dataset() in EpochBasedTrainer and renew a same name function.
11. Rename class Datasets to CustomDatasets in metainfo.py

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11872747
 2023-03-10 09:03:32 +08:00
yanwen.pyl
fc7daea9c2 add soonet for video temporal grounding 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11810444
 2023-03-10 09:02:39 +08:00
zhangzhicheng.zzc
8a19e9645d [to #47860410]plugin with cli tool 
1. 支持 plugin方式接入外部 repo、github repo，本地repo，并进行外部插件管理
2. 支持allow_remote方式接入modelhub repo，该类型属于model 范畴不做额外插件管理
3. 支持cli 安装plugin相关

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11775456
 2023-03-09 23:07:13 +08:00
jinmao.yk
4078abf488 add human reconstruction task 
单图人体重建任务 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11778199

 * add human reconstruction task
 2023-03-09 21:58:48 +08:00
dave.ma
f493e33720 vidt模型代码评审 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11873585

* vidt_v0
 2023-03-09 21:52:18 +08:00
yinyueqin.yyq
b5fe11fea0 upload disco guided diffusion 
把https://huggingface.co/IDEA-CCNL/Taiyi-Diffusion-532M-Cyberpunk-Chinese和https://huggingface.co/IDEA-CCNL/Taiyi-Diffusion-532M-Nature-Chinese迁移到MaaS-lib上。该project基于disco diffusion+guided diffusion。

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11818412

* upload disco guided diffusion
 2023-03-09 21:45:33 +08:00
yuze.zyz
a0bc5549a1 trainer support parallel_groups 
Design doc: https://yuque.alibaba-inc.com/suluyan.sly/yh1rvu/yx0owblyebpa2b3l?singleDoc#flU3s

1. Add parallel_group field in trainer to support DP, TP, PP.
2. Move the construction of common hooks(except optimizer/lrscheduler hook) to trainer's init method to support after_init stage.
	after_init is to support DP, TP, PP's initializing
         https://aone.alibaba-inc.com/v2/workitem#viewIdentifier=1c46ee8637e0c978f115b6f7&openWorkitemIdentifier=48099986
3. Add before_eval/after_eval stage to support model wrapping.
	to solve the order problem of apex amp & ddp wrapping.
         https://aone.alibaba-inc.com/v2/workitem#viewIdentifier=1c46ee8637e0c978f115b6f7&openWorkitemIdentifier=48099986
4. Exporter supports lazy importing.
	https://aone.alibaba-inc.com/v2/workitem#viewIdentifier=1c46ee8637e0c978f115b6f7&openWorkitemIdentifier=48122780
5. Fold all megatron imports to megatron hook.
         https://aone.alibaba-inc.com/v2/workitem#viewIdentifier=1c46ee8637e0c978f115b6f7&openWorkitemIdentifier=48099986
6. Add compile method to TorchModel ,Pipeline,Trainer to support torch2.0
	https://aone.alibaba-inc.com/v2/workitem#viewIdentifier=1c46ee8637e0c978f115b6f7&openWorkitemIdentifier=46869415
7. Fix bug: Lrscheduler builder does not support torch2.0
8. Add callbacks for trainer
	https://aone.alibaba-inc.com/v2/workitem#viewIdentifier=1c46ee8637e0c978f115b6f7&openWorkitemIdentifier=48210342
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11849932
 2023-03-09 21:33:35 +08:00
yuanzhi.zyz
2ce41d4974 add ocr_reco_crnntrain 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11824395
 2023-03-09 21:14:09 +08:00
yuze.zyz
a2bed42fe1 fix a CI case 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11940845
 2023-03-09 19:55:22 +08:00
mulin.lyh
62f769877f [to #48291018]fix: fix data releate case failed bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11925637
 2023-03-09 15:18:50 +08:00
feiyu.gfy
f534fd3ae0 add lore lineness table recognition 
读光无线表格识别（lineless-table-recognition）

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11772358
 2023-03-09 15:09:53 +08:00
ru.he
9307b071b7 Add the code for PEER model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11873170
 2023-03-09 01:26:27 +08:00
qize.yqz
0efc892196 add smoke and fire detection model using damoyolo 
新增垂域目标检测模型-基于DAMO_YOLO的烟火检测模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11880693
 2023-03-09 01:25:06 +08:00
lingchen.zlm
a5b9d3378f [to #42322933] add generative multimodal embedding model RLEG 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11867878

* add generative multimodal embedding model RLEG

* remove useless import in rleg model
 2023-03-09 01:17:58 +08:00
gongbiao.gb
13752fa0c0 add vop_se for text video retrival 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11719262
 2023-03-09 01:14:47 +08:00
lanjinpeng.ljp
a10e59c8f3 add ProContEXT model for video single object tracking 
支持ProContEXT视频单目标跟踪-通用领域模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11904797
 2023-03-09 01:12:58 +08:00
lee.lcy
621539f6b6 [to #42322933] add video streaming perception models longshortnet 
add video streaming perception models longshortnet

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11908652
 2023-03-09 01:09:40 +08:00
shimin.ysm
dc53c42cea image depth estimation BTS model code license solve 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11920166
 2023-03-09 00:58:18 +08:00
wangjiuniu.wjn
0ca0a8c134 add text-to-video-synthesis 
文本生成视频（text-to-video-synthesis）代码

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11767775
 2023-03-09 00:57:43 +08:00
wangmeng.xwm
a17598b13d add MAN for image-quality-assessment 
add MAN model for image-quality-assessment

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11890708

* add MAN for image-quality-assessment

* update and fix bugs in init file
 2023-03-09 00:44:55 +08:00
bin.xue
de67aa28e6 [to #42322933] feat: optimize kws pipeline and training conf 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11897822
 2023-03-09 00:37:51 +08:00
mulin.lyh
a8365bb17f [to #48269383]fix: onnx protobuf version conflict 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11924445
 2023-03-08 21:58:43 +08:00
zeyinzi.jzyz
bf3a2b6c09 support vision efficient tuning finetune 
## 查看改动点 ↓↓↓
### vision efficient tuning finetune
- Model模块改造成适配训练的
- Model模块在支持训练同时向下兼容之前发布的modecard
- Pipline兼容modelcard加载的preprocessor或直接定义的
- 添加 ImageClassificationPreprocessor （非mmcv版本）
- 添加 VisionEfficientTuningTrainer
- ~~添加 opencv_transforms==0.0.6~~ (以源代码引入必要)

### Modelcard
- test pipeline和trainer合并到一起
- 新增3个模型的test
- 新增demo service

### 公共组件
- ms_dataset.py: fix warning, [UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or xxx]
- preprocessor添加common：ToNumpy、Rename、Identity
- preprocessor common对于dict进行key判断再取值。
- ~~修复learning rate在iter级别变化的逻辑。~~ （本次不做了）
- ~~修复非dist状态下train data没有进行shuffle的bug。~~ (Master已有人改了)
- 修复训练时调用util中非cv包的异常 zhconv。

### 其他
- 为防止新引入的preprocessor模块在config中被原代码加载，导致在其他人做CI时会报错；所以暂时没有添加新的tag，等CR完成后，会进行打tag再rerun CI。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11762108

* support vision efficient tuning finetune

* update test case

* update shuffle on IterableDataset

* update bitfit & sidetuning

* compatible with base trainer
 2023-03-08 16:42:23 +08:00
xingjun.wxj
8298a3c31d add force redownload for nerf dataset in ut 
add force redownload for nerf dataset in ut

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11915271
 2023-03-08 16:23:58 +08:00
bin.xue
b4c90d8160 [to #42322933] feat: add dingding denoise model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11731594

* feat: add dingding denoise

* refactor: delete duplicated unidfsmn class

* refactor: delete empty lines

* refactor: make some methods inline

* style: add license and optimize imports

* style: comments style
 2023-03-07 21:55:10 +08:00
xuanjie.wxb
ebb50d7887 add maoe unit test 2023-03-07 15:24:37 +08:00
wendi.hwd
99fa2fe909 update license and revert support camouflaged-detection from latest master 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11892922

    * update license and revert support camouflaged-detection from latest master
 2023-03-07 11:41:10 +08:00
shichen.fsc
04f63ec71f [to #42322933] add new kws models in UT and update requirements/audio_kws.txt 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11830273

* [Add] add new models for kws UT

* [Update] update requirements

* pre-commit
 2023-03-06 23:14:45 +08:00
fubang.zfb
dfd1058d45 siamese uie finetune support 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11706625
 2023-03-02 20:14:31 +08:00
wenmeng.zwm
77ff1d94d6 Revert "Add single-camera depth estimation model bts" 
This reverts commit feb4123327.
 2023-03-02 10:56:24 +08:00
wenmeng.zwm
f2f48dd305 Revert "support camouflaged-detection " 
This reverts commit ff55bd9436.
 2023-03-02 10:52:36 +08:00
ashui.cbh
329231fe9d ImagePaintbyexamplePipeline demo service 支持 
修改pipeline输出格式为numpy array 供demo service使用

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11841517
 2023-03-01 20:34:24 +08:00
ryan.yy
4197f72124 nerf重建加速模型 加入trainer训练模块 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11794296
 2023-03-01 12:05:57 +08:00
zhicheng.sc
d11fff0c0a add ControlNet for controllable image generation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11697239

* add ControlNet for scribble2image

* update code comments

* support scribble input

* update scribble input for demo service

* support all models of ControlNet

* add requirements

* fix code style bug

* update model id
 2023-02-28 13:39:12 +08:00
wenmeng.zwm
6a13557c19 Merge branch 'master-github' into merge_master_github_0224 2023-02-24 11:16:35 +08:00
klayzhang.zb
4ca52a0934 [to #42322933] fix for text error correction: generate <unk> when input contains upper letter 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11762322

* [fix] fix: generate <unk> when input contains upper letter

* compatible new fairseq version
 2023-02-24 09:45:28 +08:00
zhk1425734486
99d2177bb0 landing AI: tbs image detection pull request (#84) 
https://modelscope.cn/models/landingAI/LD_CytoBrainCerv/summary

兰丁宫颈细胞AI辅助诊断模型

Co-authored-by: QZStudio <1643006760@qq.com>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
 2023-02-22 20:25:37 +08:00
wenmeng.zwm
6599d2c7cd skip test_image_structured_model_probing 2023-02-21 12:08:22 +08:00
wenmeng.zwm
ef615d48af skip test_image_structured_model_probing 2023-02-21 12:07:28 +08:00
xingzhang.rxz
1ae4782c83 add langident codes 
语种识别模型完成开发
模型地址：https://www.modelscope.cn/models/damo/nlp_language_identification-classification-base/summary

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11652333
 2023-02-17 15:21:33 +08:00
shuying.shu
615c443020 [to #42322933] add test condition for GPU availablity 
damo/cv_diffusion_image-segmentation不支持cpu环境测试

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11689517
 2023-02-16 11:13:53 +00:00
ryan.yy
a0c020cf34 [to #42322933] nerf model test add gpu constraint 2023-02-14 11:47:49 +00:00
wenqi.oywq
7499370569 [to #42322933] Fix the bug that image_color_enhance_pipeline cannot run in CPU environment 
adaint need to compile CUDA extension, so remove releated import from pipeline

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11660260
 2023-02-14 11:31:00 +00:00
fubang.zfb
4b29f28a04 siamese uie supports string-type schema input 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11655620
 2023-02-14 08:36:46 +00:00
fubang.zfb
e7cb55d4a6 Add SiameseUIE general information extraction model and pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11641614
 2023-02-14 03:56:29 +00:00
wenmeng.zwm
82f10f73aa [to #42322933] fix: pipeline base potential bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11645650

* test batched inference and no auto collate logic
 2023-02-13 13:49:42 +00:00