Commit Graph

10 Commits

Author SHA1 Message Date
liuyhwangyh
82ee20f447 fix issue #845 (#861)
* fix #845

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-05-23 20:34:52 +08:00
liuyhwangyh
3d442b5c7e damo to iic rename (#736)
* add version time

* fix list model none issue

* damo to iic

* rmove unused import

* fix preprocess issue

* fix revison None bug

* fix bug

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-01-29 09:38:23 +08:00
mulin.lyh
4ac59e29b0 refactor ci to analyze file dependency
import分析不需要实际import文件,通过静态扫描,得到文件中定义的符号,在分析import时找到import的符号所在的文件,从而建立起关联。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14281794
* refactor ci

* fix typo

* fix bug

* test

* add indirect import name resolve

* remove test code
2023-10-13 14:11:30 +08:00
mulin.lyh
de2d7cbc69 fix select case error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13889257
* fix select case error
2023-09-04 11:16:28 +08:00
liuyhwangyh
75a14a36ba get github diff files (#446)
* get github diff files

* add github environment

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2023-08-10 16:22:37 +08:00
xingjun.wxj
e02a260c93 Refactor the task_datasets module
Refactor the task_datasets module:

1. Add new module modelscope.msdatasets.dataset_cls.custom_datasets.
2. Add new function: modelscope.msdatasets.ms_dataset.MsDataset.to_custom_dataset().
2. Add calling to_custom_dataset() func in MsDataset.load() to adapt new custom_datasets module.
3. Refactor the pipeline for loading custom dataset: 
	1) Only use MsDataset.load() function to load the custom datasets.
	2) Combine MsDataset.load() with class EpochBasedTrainer.
4. Add new entry func for building datasets in EpochBasedTrainer: see modelscope.trainers.trainer.EpochBasedTrainer.build_dataset()
5. Add new func to build the custom dataset from model configuration, see: modelscope.trainers.trainer.EpochBasedTrainer.build_dataset_from_cfg()
6. Add new registry function for building custom datasets, see: modelscope.msdatasets.dataset_cls.custom_datasets.builder.build_custom_dataset()
7. Refine the class SiameseUIETrainer to adapt the new custom_datasets module.
8. Add class TorchCustomDataset as a superclass for custom datasets classes.
9. To move modules/classes/functions:
	1) Move module msdatasets.audio to custom_datasets
	2) Move module msdatasets.cv to custom_datasets
	3) Move module bad_image_detecting to custom_datasets
	4) Move module damoyolo to custom_datasets
	5) Move module face_2d_keypoints to custom_datasets
	6) Move module hand_2d_keypoints to custom_datasets
	7) Move module human_wholebody_keypoint to custom_datasets
	8) Move module image_classification to custom_datasets
	9) Move module image_inpainting to custom_datasets
	10) Move module image_portrait_enhancement to custom_datasets
	11) Move module image_quality_assessment_degradation to custom_datasets
	12) Move module image_quality_assmessment_mos to custom_datasets
	13) Move class LanguageGuidedVideoSummarizationDataset to custom_datasets
	14) Move class MGeoRankingDataset to custom_datasets
	15) Move module movie_scene_segmentation custom_datasets
	16) Move module object_detection to custom_datasets
	17) Move module referring_video_object_segmentation to custom_datasets
	18) Move module sidd_image_denoising to custom_datasets
	19) Move module video_frame_interpolation to custom_datasets
	20) Move module video_stabilization to custom_datasets
	21) Move module video_super_resolution to custom_datasets
	22) Move class GoproImageDeblurringDataset to custom_datasets
	23) Move class EasyCVBaseDataset to custom_datasets
	24) Move class ImageInstanceSegmentationCocoDataset to custom_datasets
	25) Move class RedsImageDeblurringDataset to custom_datasets
	26) Move class TextRankingDataset to custom_datasets
	27) Move class VecoDataset to custom_datasets
	28) Move class VideoSummarizationDataset to custom_datasets
10. To delete modules/functions/classes:
	1) Del module task_datasets
	2) Del to_task_dataset() in EpochBasedTrainer
	3) Del build_dataset() in EpochBasedTrainer and renew a same name function.
11. Rename class Datasets to CustomDatasets in metainfo.py

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11872747
2023-03-10 09:03:32 +08:00
mulin.lyh
386be89f3d [to #47947101]fix: fix diff based case not process deleted file
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11729541
2023-02-21 20:50:03 +08:00
mulin.lyh
71f832da35 [to #47671666]fix: diff based ci optimize
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11574741

    * [to #47671666]fix: diff based ci optimize
2023-02-07 10:45:52 +00:00
mulin.lyh
b2fbbce4c1 [to #47645858]fix: diff based ci ignore modelscope/utils/constant.py modelscope/metainfo.py
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11559303

    * [to #47645858]fix: diff based ci ignore modelscope/utils/constant.py modelscope/metainfo.py

* test ignore metainfo.py file
2023-02-06 12:37:33 +00:00
mulin.lyh
e54694690f [to #46993990]feat: run ci cases base on code diff to reduct ci test time 2023-02-06 08:00:19 +00:00