Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 12:39:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,147 Commits 263 Branches 106 Tags
ed28b849eb9d2cb520c42226e66102da7f219176
Commit Graph

654 Commits

Author SHA1 Message Date
lee.lcy
ed28b849eb [to #42322933] add domain specific object detection models 
添加垂类目标检测模型。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11265502
 2022-12-30 14:19:16 +08:00
hejunjie.hjj
d560291525 [to #42322933] add maskdino model (1230) 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11187240
 2022-12-30 07:43:57 +08:00
wenmeng.zwm
b8ec677739 add training args support and image classification fintune example 
design doc: https://yuque.antfin.com/pai/rwqgvl/khy4uw5dgi39s6ke

usage:
```python

    from modelscope.trainers.training_args import (ArgAttr, MSArgumentParser,
                                               training_args)


    training_args.topk = ArgAttr(cfg_node_name=['train.evaluation.metric_options.topk',
                                                'evaluation.metric_options.topk'],
                                 default=(1,), help='evaluation using topk, tuple format, eg (1,), (1,5)')
    training_args.train_data = ArgAttr(type=str, default='tany0699/cats_and_dogs', help='train dataset')
    training_args.validation_data = ArgAttr(type=str, default='tany0699/cats_and_dogs', help='validation dataset')
    training_args.model_id = ArgAttr(type=str, default='damo/cv_vit-base_image-classification_ImageNet-labels', help='model name')

    parser = MSArgumentParser(training_args)
    cfg_dict = parser.get_cfg_dict()
    args = parser.args
    
    train_dataset = create_dataset(args.train_data, split='train')
    val_dataset = create_dataset(args.validation_data, split='validation')

    def cfg_modify_fn(cfg):
        cfg.merge_from_dict(cfg_dict)
        return cfg

    kwargs = dict(
        model=args.model_id,          # model id
        train_dataset=train_dataset,  # training dataset
        eval_dataset=val_dataset,     # validation dataset
        cfg_modify_fn=cfg_modify_fn     # callback to modify configuration
    )

    trainer = build_trainer(name=Trainers.image_classification, default_args=kwargs)
    # start to train
    trainer.train()
```
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11225071
 2022-12-30 07:35:15 +08:00
hemu.zp
fd0099c92d [to #42322933] Refactor megatron-util 
Rename import lib 'megatron' to 'megatron_util' and add error message for users when import failed.

Use initialize_megatron as a unified initialization entry in megatron-util, which can accept configuration input of ConfigDict in MaaS-lib.

Wrap the initialization process into the utils/megatron_utils.py file, add default parameters for the existing large model to be compatible with the uploaded configuration file.

The version of megatron_cfg currently supports v3 (default), v1 and moe.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11231840
 2022-12-29 15:01:45 +08:00
ly261666
6583e6f398 [to #42322933] Add FLIR Face Liveness Model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11250177
 2022-12-29 14:55:51 +08:00
pengteng.spt
cddebf567f add kws nearfield finetune 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11179425

* add kws nearfield finetune

* work on rank-0 only if evaluating

* split kaldi relevant code into runtime utils

* add evaluate but not files checking

* test evaluate on cpu

* add default value for cmvn_file
 2022-12-29 10:14:41 +08:00
dadong.gxd
42557b0867 add cv_pointnet2_sceneflow-estimation_general 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11201880
 2022-12-29 08:09:57 +08:00
yeqinghao.yqh
f7a7504782 Add HiTeA model for VideoQA and Caption (12.30) 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11201652
 2022-12-29 08:06:34 +08:00
hemu.zp
f58060b140 [to #42322933] add GPT-2 model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11194200
 2022-12-29 07:59:40 +08:00
lee.lcy
e8a354d226 [to #42322933] add real-time human detection model 
add real-time human detection model
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11191113
 2022-12-29 07:58:45 +08:00
yichang.zyc
0c79b57fcc support batch infer 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11170755
 2022-12-28 12:17:36 +08:00
qianmu.ywh
59b7f411b8 add video depth estimation pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11189483
 2022-12-28 06:34:02 +08:00
wjq264216
e57424eaf0 [to #42322933] Add ocr-detection-vlpt-pipeline to maas lib 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11213036
 2022-12-28 06:26:15 +08:00
huizheng.hz
cb9f1bfb8d 1230-video-super-resolution 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11090960
 2022-12-28 06:18:50 +08:00
wenmeng.zwm
4ee2ad3617 skip unifold ut due to MMseqs2 api error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11218838
 2022-12-26 22:37:45 +08:00
wenmeng.zwm
a01e29ceb0 fix check video type cv2.VideoCapture and add unittest 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11181951
 2022-12-26 09:59:59 +08:00
shuying.shu
048207d79b fix memory leak bug in eval 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11195714
 2022-12-25 08:40:19 +08:00
jiaqi.sjq
147da4b3d9 [to #41669377] tts pipeline change infer result to wav 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11191925
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11191925
 2022-12-24 09:36:02 +08:00
Yingda Chen
c4d116ab53 disable keyword spotting test 2022-12-22 09:49:37 -08:00
hannah.yh
b36bb72869 add image skychange 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10947701
 2022-12-21 17:40:46 +08:00
hooks.hl
0d205c8322 add support for cv_rdevos_video-object-segmentation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11066863
 2022-12-21 07:37:27 +08:00
jiaqi.sjq
8896087034 [to #42322933] support kantts infer and finetune 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11111331#tab=detail
 2022-12-20 10:45:34 +08:00
caorongyu.cry
b992bf278c add bi model 
1. 更新模型文件，支持BI能力
2. 更新代码，支持BI能力
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11115454
 2022-12-20 01:51:00 +08:00
jerry.lp
906fa673b4 add gpt-moe model for modelscope finetune 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11085918
 2022-12-17 05:52:57 +08:00
shouzhou.bx
95ede6378e [to #42322933] 1230: add hand detection 2022-12-16 13:24:02 +08:00
wenmeng.zwm
a1688f5775 enhance interface standard and refactor card_detection and face detection pipeline 
1. build preprocessor for pipeline automatically if preprocessor is configed in configuration.json
2. refactor scrfd_detect.py as a standard cv model code
3. refacotr card_detection_pipeline  face_detection_pipeline as standard pipeline code

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11057557
 2022-12-15 14:31:50 +08:00
yuanzheng.yuanzhen
93f2c52303 fix multimer input for science/protein_structure 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10608748
 2022-12-13 14:18:39 +08:00
wenmeng.zwm
c8dcdd93da broadcase metric values across all workers for distribution 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10980488
 2022-12-08 10:22:47 +08:00
wanggui.hwg
3ce1866224 [to #42322933] Fix bugs for UniTE 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11011725
 2022-12-07 17:23:52 +08:00
shiyi.zxh
c3a494e46d [to #42322933] 
enable finetune of ofa-mmspeech 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10981972
 2022-12-06 20:58:49 +08:00
xuanjie.wxb
a3a942352e support prompt ner 
修改preprocessor增加对prompt模型的支持。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10972542
 2022-12-06 10:39:37 +08:00
ly261666
ed23d460d5 [to #42322933] Add facial landmark confidence model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10780109
 2022-12-05 21:07:35 +08:00
ly261666
262f738460 [to #42322933] add FairFace face attribute model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10726376
 2022-12-05 17:20:48 +08:00
ly261666
9d43823f36 [to #42322933] add TinyMogFace face detector 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10792564
 2022-12-05 12:01:26 +08:00
baiguan.yt
ce0480f7ed update image-portait-enhancement trainer 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10717891
 2022-12-05 11:43:52 +08:00
hemu.zp
941dbe75cf [to #42322933] Add GPT-3 tensor parallel finetuning 
Add GPT-3 tensor parallel finetuning, adjust some distributed codes to make tensor and data parallel compatible.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10949507
 2022-12-05 10:01:32 +08:00
pangda
54d219e90b [to #42322933] add UT for NER&EL models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10897188
 2022-12-04 15:53:32 +08:00
hemu.zp
346da3d489 [to #42322933] Add mplug pretrained model 
Add pre-trained models for mplug finetuning.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10963691
 2022-12-04 15:27:50 +08:00
ly261666
492aa98d9a [to #42322933] Add face mask model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10897202

    * [to #42322933] 新增ArcFace人脸识别模型
 2022-12-04 15:25:27 +08:00
dingkun.ldk
000976836f 1130中文分词/词性标注新增LSTM轻量化模型 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10931263
 2022-12-03 13:15:33 +08:00
yichang.zyc
90034236ab ofa asr support url 2022-12-03 08:49:11 +08:00
jinmao.yk
d84a1df65a add video human matting task code 
add video human matting task code
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10839854
 2022-12-02 19:44:01 +08:00
wanggui.hwg
e8608df930 Add support for UniTE 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10909489
 2022-12-02 18:15:02 +08:00
ly119399
2f17daa23f [to #42322933] reduce the GPU usage of dialog trianer 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10955485
 2022-12-02 17:32:26 +08:00
wenmeng.zwm
c9a6b887a2 add tensorboard hook for visualization 
1. add tensorboard hook to default config
2. add image visualization support to tensorboard hook and trainer
3. move evaluation logic out of single_gpu_test and multi_gpu_test to make prediction results available for further processing such as result saving and visualization.

visualization results are as follows:
![image.png](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/29212/38448470860386707/image.png)
![image.png](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/29212/38437794200606734/image.png)
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10894813
 2022-12-02 15:13:24 +08:00
ziyuan.tw
31316b8d29 add nextvit-small_image-classification_Dailylife-labels model 
支持1130新上线模.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10886253
 2022-12-02 14:46:49 +08:00
ly119399
5ae1e08db6 [to #42322933] fix bug of tableQA on gpu 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10943053
 2022-12-02 10:38:30 +08:00
zhangzhicheng.zzc
a318f27247 [to #42322933] speed up the ast indexing during editing 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10907357
 2022-12-02 10:06:24 +08:00
yuze.zyz
0e4766f41d Fix bugs in testlevel1 & 2 
1. Fix: ws regression failed.
2. Fix: label2id missing in text_classification_pipeline when preprocessor is passed in through args.
3. Fix: remove obsolete imports
4. Fix: incomplete modification
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10936431
 2022-12-01 21:16:55 +08:00
rujiao.lrj
9d8eb5b0b3 support license plate detection 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10917315
 2022-12-01 19:48:06 +08:00