Commit Graph

866 Commits

Author SHA1 Message Date
yuze.zyz
a2bed42fe1 fix a CI case
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11940845
2023-03-09 19:55:22 +08:00
lllcho.lc
3e70ecfb37 add action detection finetune
添加action-detection模型finetune支持

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11873651
2023-03-09 16:54:19 +08:00
mulin.lyh
62f769877f [to #48291018]fix: fix data releate case failed bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11925637
2023-03-09 15:18:50 +08:00
xixing.tj
46799325c8 add ocr_detection_db training module
新增ocr_detection dbnet训练代码

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11892455
2023-03-09 15:11:27 +08:00
feiyu.gfy
f534fd3ae0 add lore lineness table recognition
读光无线表格识别(lineless-table-recognition)

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11772358
2023-03-09 15:09:53 +08:00
ru.he
9307b071b7 Add the code for PEER model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11873170
2023-03-09 01:26:27 +08:00
qize.yqz
0efc892196 add smoke and fire detection model using damoyolo
新增垂域目标检测模型-基于DAMO_YOLO的烟火检测模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11880693
2023-03-09 01:25:06 +08:00
lingchen.zlm
a5b9d3378f [to #42322933] add generative multimodal embedding model RLEG
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11867878

* add generative multimodal embedding model RLEG

* remove useless import in rleg model
2023-03-09 01:17:58 +08:00
gongbiao.gb
13752fa0c0 add vop_se for text video retrival
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11719262
2023-03-09 01:14:47 +08:00
lanjinpeng.ljp
a10e59c8f3 add ProContEXT model for video single object tracking
支持ProContEXT视频单目标跟踪-通用领域模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11904797
2023-03-09 01:12:58 +08:00
lee.lcy
621539f6b6 [to #42322933] add video streaming perception models longshortnet
add video streaming perception models longshortnet

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11908652
2023-03-09 01:09:40 +08:00
shimin.ysm
dc53c42cea image depth estimation BTS model code license solve
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11920166
2023-03-09 00:58:18 +08:00
wangjiuniu.wjn
0ca0a8c134 add text-to-video-synthesis
文本生成视频(text-to-video-synthesis)代码

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11767775
2023-03-09 00:57:43 +08:00
wangmeng.xwm
a17598b13d add MAN for image-quality-assessment
add MAN model for image-quality-assessment

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11890708

* add MAN for image-quality-assessment

* update and fix bugs in init file
2023-03-09 00:44:55 +08:00
bin.xue
de67aa28e6 [to #42322933] feat: optimize kws pipeline and training conf
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11897822
2023-03-09 00:37:51 +08:00
liugao.lg
c28fd09d42 add more cli tools
提供独立repo库快速接入modelscope的小工具,模板创建,模型上传,一键导入、版本管理等命令

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11757517
2023-03-09 00:17:11 +08:00
mulin.lyh
a8365bb17f [to #48269383]fix: onnx protobuf version conflict
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11924445
2023-03-08 21:58:43 +08:00
zeyinzi.jzyz
bf3a2b6c09 support vision efficient tuning finetune
## 查看改动点 ↓↓↓
### vision efficient tuning finetune
- Model模块改造成适配训练的
- Model模块在支持训练同时向下兼容之前发布的modecard
- Pipline兼容modelcard加载的preprocessor或直接定义的
- 添加 ImageClassificationPreprocessor (非mmcv版本)
- 添加 VisionEfficientTuningTrainer
- ~~添加 opencv_transforms==0.0.6~~ (以源代码引入必要)

### Modelcard
- test pipeline和trainer合并到一起
- 新增3个模型的test
- 新增demo service

### 公共组件
- ms_dataset.py: fix warning, [UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or xxx]
- preprocessor添加common:ToNumpy、Rename、Identity
- preprocessor common对于dict进行key判断再取值。
- ~~修复learning rate在iter级别变化的逻辑。~~ (本次不做了)
- ~~修复非dist状态下train data没有进行shuffle的bug。~~ (Master已有人改了)
- 修复训练时调用util中非cv包的异常 zhconv。

### 其他
- 为防止新引入的preprocessor模块在config中被原代码加载,导致在其他人做CI时会报错;所以暂时没有添加新的tag,等CR完成后,会进行打tag再rerun CI。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11762108

* support vision efficient tuning finetune

* update test case

* update shuffle on IterableDataset

* update bitfit & sidetuning

* compatible with base trainer
2023-03-08 16:42:23 +08:00
xingjun.wxj
8298a3c31d add force redownload for nerf dataset in ut
add force redownload for nerf dataset in ut

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11915271
2023-03-08 16:23:58 +08:00
mulin.lyh
e993438f86 [to #48269383]fix: onnx protobuf version conflict
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11914565

    * [to #48269383]fix: onnx protobuf version conflict
2023-03-08 14:49:22 +08:00
xianzhe.xxz
691443257c add onnx exporter for damoyolo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11889858
2023-03-07 23:01:03 +08:00
bin.xue
b4c90d8160 [to #42322933] feat: add dingding denoise model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11731594

* feat: add dingding denoise

* refactor: delete duplicated unidfsmn class

* refactor: delete empty lines

* refactor: make some methods inline

* style: add license and optimize imports

* style: comments style
2023-03-07 21:55:10 +08:00
xuanjie.wxb
ebb50d7887 add maoe unit test 2023-03-07 15:24:37 +08:00
pangda
798aa93cba [to #42322933] add onnx/torchscript exporter for token classification models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11895085
2023-03-07 14:12:23 +08:00
wendi.hwd
99fa2fe909 update license and revert support camouflaged-detection from latest master
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11892922

    * update license and revert support camouflaged-detection from latest master
2023-03-07 11:41:10 +08:00
shichen.fsc
04f63ec71f [to #42322933] add new kws models in UT and update requirements/audio_kws.txt
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11830273

* [Add] add new models for kws UT

* [Update] update requirements

* pre-commit
2023-03-06 23:14:45 +08:00
fubang.zfb
dfd1058d45 siamese uie finetune support
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11706625
2023-03-02 20:14:31 +08:00
wenmeng.zwm
77ff1d94d6 Revert "Add single-camera depth estimation model bts"
This reverts commit feb4123327.
2023-03-02 10:56:24 +08:00
wenmeng.zwm
f2f48dd305 Revert "support camouflaged-detection "
This reverts commit ff55bd9436.
2023-03-02 10:52:36 +08:00
ashui.cbh
329231fe9d ImagePaintbyexamplePipeline demo service 支持
修改pipeline输出格式为numpy array 供demo service使用

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11841517
2023-03-01 20:34:24 +08:00
xingjun.wxj
99e58c6ea3 [to #42322933] fix some feedback issues
1. Fix the conflict between local path and remote dataset name in the form of dataset_name='namespace/dataset_name' in MsDataset.load() function.
2. Modify the obj_key.startswith value in get_split_objects_map function to adapt to dir name 'xxx/' format.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11820290

* fix the conflict between local path and namespace/dataset_name of the dataset_name

* fix function: get_split_objects_map

* add UT for loading local csv file

* add new test case for test_load_local_csv function
2023-03-01 20:13:31 +08:00
ryan.yy
4197f72124 nerf重建加速模型 加入trainer训练模块
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11794296
2023-03-01 12:05:57 +08:00
yuxiang.tyx
09a178d171 support onnx export for SCRFD model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11826666
2023-03-01 10:02:49 +08:00
hemu.zp
ceeb85f10f [to #42322933] Support multi-machine data and tensor parallel finetuning
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11682479
2023-02-28 18:47:17 +08:00
myf272609
51cf0b16a8 [to #42322933] add fintune support for cartoon task
人像卡通化模型增加训练支持

 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11675597

* add fintune support for cartoon
2023-02-28 17:01:34 +08:00
yuze.zyz
7181e667f6 Refactor hooks
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11651547
2023-02-28 13:51:01 +08:00
zhicheng.sc
d11fff0c0a add ControlNet for controllable image generation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11697239

* add ControlNet for scribble2image

* update code comments

* support scribble input

* update scribble input for demo service

* support all models of ControlNet

* add requirements

* fix code style bug

* update model id
2023-02-28 13:39:12 +08:00
lee.lcy
a0877216a4 fix(damoyolo): fix FileNotFoundError when using trainer.evaluate() && add work_dir and exp_name to kwargs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11793714

    * fix(damoyolo): fix FileNotFoundError when using trainer.evaluate() && add work_dir and exp_name to kwargs

* style(damoyolo): add code annotation to ImageDetectionDamoyoloTrainer
2023-02-27 19:26:12 +08:00
wenmeng.zwm
6a13557c19 Merge branch 'master-github' into merge_master_github_0224 2023-02-24 11:16:35 +08:00
klayzhang.zb
4ca52a0934 [to #42322933] fix for text error correction: generate <unk> when input contains upper letter
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11762322

* [fix] fix: generate <unk> when input contains upper letter

* compatible new fairseq version
2023-02-24 09:45:28 +08:00
zhk1425734486
99d2177bb0 landing AI: tbs image detection pull request (#84)
https://modelscope.cn/models/landingAI/LD_CytoBrainCerv/summary

兰丁宫颈细胞AI辅助诊断模型

Co-authored-by: QZStudio <1643006760@qq.com>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2023-02-22 20:25:37 +08:00
zhangzhicheng.zzc
3e4ee5958a [to #47939677] load only backbone with weights
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11679242

* load backbone with weights directly
2023-02-21 22:41:14 +08:00
mulin.lyh
386be89f3d [to #47947101]fix: fix diff based case not process deleted file
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11729541
2023-02-21 20:50:03 +08:00
wenmeng.zwm
6599d2c7cd skip test_image_structured_model_probing 2023-02-21 12:08:22 +08:00
wenmeng.zwm
ef615d48af skip test_image_structured_model_probing 2023-02-21 12:07:28 +08:00
wenmeng.zwm
285208912b add command line tool
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11661608

* add command line tool

* add unittest

* change absolute import to relative import for test case

* mv test_util to package
2023-02-20 21:21:54 +08:00
xingzhang.rxz
1ae4782c83 add langident codes
语种识别模型完成开发
模型地址:https://www.modelscope.cn/models/damo/nlp_language_identification-classification-base/summary

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11652333
2023-02-17 15:21:33 +08:00
wenmeng zhou
3ca68bf22f remove profiling log (#113)
UT test by default does not run profiling
2023-02-17 12:01:54 +08:00
shuying.shu
615c443020 [to #42322933] add test condition for GPU availablity
damo/cv_diffusion_image-segmentation不支持cpu环境测试

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11689517
2023-02-16 11:13:53 +00:00
ryan.yy
a0c020cf34 [to #42322933] nerf model test add gpu constraint 2023-02-14 11:47:49 +00:00