Commit Graph

818 Commits

Author SHA1 Message Date
shuying.shu
615c443020 [to #42322933] add test condition for GPU availablity
damo/cv_diffusion_image-segmentation不支持cpu环境测试

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11689517
2023-02-16 11:13:53 +00:00
ryan.yy
a0c020cf34 [to #42322933] nerf model test add gpu constraint 2023-02-14 11:47:49 +00:00
wenqi.oywq
7499370569 [to #42322933] Fix the bug that image_color_enhance_pipeline cannot run in CPU environment
adaint need to compile CUDA extension, so remove releated import from pipeline

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11660260
2023-02-14 11:31:00 +00:00
fubang.zfb
4b29f28a04 siamese uie supports string-type schema input
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11655620
2023-02-14 08:36:46 +00:00
fubang.zfb
e7cb55d4a6 Add SiameseUIE general information extraction model and pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11641614
2023-02-14 03:56:29 +00:00
yuze.zyz
90af43f749 [to #47563396]Fix bug: two ckpt hooks save in the same dir
1. Support two checkpoint hooks saving final checkpoints in two difference folders
2. Remove the check of checkpoint hooks
3. Fix a incorrect modification in UT
4. Fix bug: Checkpoint.load_checkpoint has been moved out
5. Add UT for new style configuration
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11630170
2023-02-13 16:54:02 +00:00
wenmeng.zwm
82f10f73aa [to #42322933] fix: pipeline base potential bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11645650

* test batched inference and no auto collate logic
2023-02-13 13:49:42 +00:00
ashui.cbh
e7c5c116c5 [to #42322933] add test condition for GPU availablity 2023-02-13 11:50:30 +00:00
fuhaomin.fhm
2fced1c06f [to #42322933] Doc2Bot documentation with retrieval rerank, generation 2023-02-12 03:09:33 +00:00
zhicheng.sc
5b3ce816a5 sd2-inpainting: change output to numpy array in bgr order
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11629631
2023-02-10 14:26:09 +00:00
haolan.xhl
e537f9df1d [to #42322933] add vqa-degradation
add new model for image_quality_assessment_degradation
2023-02-10 11:59:59 +00:00
ly261666
2c8f9801a2 [to #42322933] add content check model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11473049
2023-02-10 08:18:26 +00:00
wk258730
05a407da7f add pipelines for en2zh-imt and zh2en-imt
*[ 交互式机器翻译-英中-通用领域-large](https://modelscope.cn/models/damo/nlp_imt_translation_en2zh/summary)
*[ 交互式机器翻译-中英-通用领域-large](https://modelscope.cn/models/damo/nlp_imt_translation_zh2en/summary)

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11593182
2023-02-10 08:13:18 +00:00
hejunjie.hjj
6fc15926a3 [to #42322933] add single and multiple human parsing models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11508413
2023-02-10 08:01:23 +00:00
wenmeng.zwm
677e49eaf3 update api doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11582587
2023-02-10 07:48:11 +00:00
shimin.ysm
9b0e302a66 refine cv_image_defrcn trainer to avoid failed
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11622570
2023-02-10 07:10:59 +00:00
wenqi.oywq
6c5eb3bab3 Add AdaInt model
新增加 adaint 模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11588338


* 复用image color enhance pipeline

* mv cuda extension to ops

* 修改adaint模型初始化方式,去掉封装
2023-02-10 06:48:22 +00:00
zhangzhicheng.zzc
f88b03ab72 [to #47307896] update backbone-head
The original backbone-head abstraction was not articheted well enough, the input and output parameters of backbone and head were in the form of **kwargs, which was implicit and might cause confustion. Therefore, the following adjustments were made:
原有backbone head抽象程度不够深,backbone 以及head输入输出参数为**kwargs,比较晦涩,同时很多功能无法支持扩展,因此做了如下调整:

1. Divide the basic model based on the structure to: encoder-only model, decoder-only model, single stage model, two stage model, etc., . Now, the encoder-only model was accomplished, while others are under design
2. Derive the structed task-models from the basic model structure above: a single structed task-model is mainly used to parse the backbone/head cfg, in order to apply the correct backbone or head components, some models might adjust the forward method from the basic model
3. Add the initialization parameters, input and output parameters to head class and backbone class, in order to reduce the understanding cost.
4. Remove the original nncrf class and chang it to backbone-head form with the lstm backbone and crf head.
5. Support  `model = Model.from_pretrained('bert-based-fill-mask', task='text-classification')`, this method could correctly load the backbone even when the task is different from the original one in configuration.
6. Support loading the model through the transformer's automodel, in the case of quickly integrating the backbone model without coding
7. Unifiy the original task classes in each nlp model and the structed task-model classes, the structed task-model are largely reduce the redundant codes in the original task classed. Still under refactor
8. Support load model configuration from hf transformers config.json, if the model related configuration is missing. Only suppport NLP models
2023-02-10 06:46:47 +00:00
qize.yqz
5e88cfe693 add open vocabulary detection
添加了开放词汇目标检测任务和模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11548569
2023-02-10 06:37:51 +00:00
yuze.zyz
ca1321f53f Support trainer prediction and fix some bugs
1. Support trainer prediction
2. Fix bug in text classification metric
3. Move load checkpoint out of checkpointhook
4. Fix bug in train progressing (inner_iter variable not correct)

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11560269
2023-02-10 06:19:37 +00:00
zhangyanzhao.zyz
e6c05a2931 sentence-embedding support finetune
sentence-embedding模型支持finetune

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11537009
2023-02-10 06:07:38 +00:00
zhongning.hzn
27304e38b0 Add bad image detection model and pipeline
坏帧检测bad_image_detecting模型CR 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11580680
2023-02-10 05:33:57 +00:00
hemu.zp
82482b3e96 update training args
Based on feat/0131/nlp_args branch, the original code review: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11408570

Support for running finetuning from the command line with training args, Compatible with the configuration optimization.
2023-02-10 05:32:21 +00:00
yuze.zyz
4dca4773db Support csanmt exporting and refactor some code
1. Support csanmt exporting to savedmodel format
2. Create a new base class for text-ranking preprocessors, and move some parameters of mgeo_ranking_preprocessor to init method
3. Avoid Model & Preprocessor classes coupled with pytorch
4. Regression test supports comparing only model output
5. Support zero-shot exporting to onnx and torchscript

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11522461
2023-02-10 05:15:04 +00:00
jiangyu.xzy
9f1b767ecd asr训练dataset & 单独vad模型推理 & 多模型组合的asr推理
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11610526

* add asr dataset

* sv num_workers 0

* add vad pipeline

* add flexible vad/punc/lm model inputs
2023-02-10 05:09:00 +00:00
xixing.tj
b5e881148a add ocr detection new model and pipeline for dbnet
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11574897
2023-02-10 05:02:59 +00:00
ly261666
b4ad0e49fb [to #42322933] add face quality assessment model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11473023
2023-02-10 04:59:08 +00:00
ljh263654
29e47e5030 add video deinterlace model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11508847


* add video deinterlace model

* resolve conflict for video deinterlace

* fix CR problems
2023-02-10 02:15:49 +00:00
mulin.lyh
c0a92403c8 Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib 2023-02-10 10:14:36 +08:00
mulin.lyh
fd7fd38da0 fix failed case 2023-02-10 10:14:24 +08:00
lingxi.yz
2d55e0f2ff [to #42322933] add abnormal detection models
添加了针对长尾/小目标问题解决的异常视觉检测模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11536379
2023-02-10 02:13:33 +00:00
hanyuan.chy
6da3be3047 Add HDFormer for 3d pose estimation of body
新增HDFormer 3D人体姿态估计模型 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11576328

* add hdformer

* rm redundent pipeline

* add license

* add test case
2023-02-10 02:13:09 +00:00
yuanzhi.zyz
0894b1ea71 add ocr_recognition crnnnetwork
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11569972

 * add crnnnetwork

* add reviews

* fix conflict
2023-02-10 02:11:59 +00:00
wenqi.oywq
da417655f2 新增deeplpf和debanding模型
1. 新增加 image_debanding 模型
2. 新增加 deeplpf_image_color_enhance 模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11579722
2023-02-09 13:08:50 +00:00
xianhui.lxh
b9ed767bbb [to #42322933] add ecbsr model for mobile image super-resolution
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11561999

* add mobile super-resolution pipeline and ecbsr model

* fix format error
2023-02-09 12:59:05 +00:00
xianhui.lxh
9619c5fc83 [to #42322933] 2.10 add msrresnetlite model for video super-resolution
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11500523

    * add msrresnetlite model for video super-resolution

* Merge branch 'master' into dev/cv_msrresnet_video-super-resolution_lite

* fix doc string of msrresnet

* merge master

* merge msrresnet_lite model

* merge master
2023-02-09 11:16:18 +00:00
liaojie.laj
82ae63b9e7 improve video frame interpolation pipeline
更新实用版插帧模型,支持任意帧率转换

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11553883
2023-02-09 10:45:32 +00:00
shimin.ysm
2535866443 cv/image-fewshot-detection-defrcn support finetune and evaluation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11486763

* defrcn完善评估功能,支持coco格式

* 修改格式问题

* 优化模型加载

* 优化训练测试脚本

* 修复推理时依赖数据集的问题

* 指定模型版本

* 指定model revision

* review意见修改
2023-02-09 10:43:08 +00:00
maojialiang.mjl
3cb3e61ff7 add yolopv2 model cv_yolopv2_image_driving_perception
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11548442
2023-02-09 10:31:38 +00:00
ly261666
5d489f6cdf [to #42322933] add face liveness xc model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11471896
2023-02-09 10:29:55 +00:00
ashui.cbh
10d1b3217c support paint-by-example model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11561235

    * add paint-by-example

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* format check

* format check

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* revise

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* revision according to CR reviews

* new

* revise model

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* feat: Fix conflict, auto commit by WebIDE
2023-02-09 10:23:02 +00:00
ljl191782
259bfb64c6 [to #42322933] add universal_matting pipeline
上线通用抠图模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11505692
2023-02-09 10:13:32 +00:00
tjf141457
8d8618a65b multi-modal/gridvlp: add multi-modal_gridvlp_classification_chinese-base-ecom-cate
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11436832
2023-02-09 09:45:36 +00:00
lanjinpeng.ljp
cffc1ba0e5 support DINO detection using EasyCV
支持DINO高精度目标检测模型

 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11518805
2023-02-09 09:39:08 +00:00
tongmu.wh
2d2918873f add speech speaker verification pipeline
添加单人说话人确认推理,包括相应的pipeline和model

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11426989
2023-02-09 09:26:42 +00:00
ryan.yy
2741a207fd add nerf-recon model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11546752
2023-02-09 09:05:35 +00:00
leyuan.hjy
2684111bd7 Real-time object detection finetune support using easycv
实时目标检测finetune easycv支持 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11554870

* add finetune support 

* implementation of trainer and pipeline switched to easycv

* remove old yolox code
2023-02-09 08:45:05 +00:00
zhangzhicheng.zzc
5c73ee9f6f skip ast update test
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11609057
2023-02-09 08:36:44 +00:00
shimin.ysm
feb4123327 Add single-camera depth estimation model bts
单目深度估计模型bts 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11533885
2023-02-09 08:35:29 +00:00
tanfan.zjh
bb174351b3 refactor faq model and add MGIMN model
FAQ模型代码重构+新增FAQ MGIMN模型 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11595371
2023-02-09 08:29:19 +00:00