Commit Graph

1409 Commits

Author SHA1 Message Date
jiangyu.xzy
422ebd1385 [to #42322933] fix sv infer 2023-02-15 06:00:20 +00:00
fubang.zfb
fafb9cadfd change output of siamese_uie to dict
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11666360
2023-02-15 04:18:21 +00:00
yuxiang.tyx
2738f659cf fix: Petr3D support cpu inference with different mmcv version
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11663463

* support cpu inference with different mmcv version
2023-02-14 14:49:47 +00:00
zhangzhicheng.zzc
57670f1e64 [to #47818884] add default preprocessor for taskmodels 2023-02-14 11:50:40 +00:00
ryan.yy
a0c020cf34 [to #42322933] nerf model test add gpu constraint 2023-02-14 11:47:49 +00:00
wenqi.oywq
7499370569 [to #42322933] Fix the bug that image_color_enhance_pipeline cannot run in CPU environment
adaint need to compile CUDA extension, so remove releated import from pipeline

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11660260
2023-02-14 11:31:00 +00:00
james.wjg
295ec86d4e [to #42322933] 视频全景分割 修复一个测试bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11660389
2023-02-14 10:28:01 +00:00
wucong.lyb
5fe9d0682e support multi audio types
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11657396

    * support multi audio format

* SUPPORT_AUDIO_TYPE_SETS add .
2023-02-14 08:42:19 +00:00
fubang.zfb
4b29f28a04 siamese uie supports string-type schema input
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11655620
2023-02-14 08:36:46 +00:00
maojialiang.mjl
2b8236e6d0 [to #42322933] convert output boxes from tensor to numpy according to demo-service rules
[to #42322933] convert output boxes from tensor to numpy according to demo-service rules

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11654774
2023-02-14 08:35:11 +00:00
fubang.zfb
e7cb55d4a6 Add SiameseUIE general information extraction model and pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11641614
2023-02-14 03:56:29 +00:00
yuze.zyz
90af43f749 [to #47563396]Fix bug: two ckpt hooks save in the same dir
1. Support two checkpoint hooks saving final checkpoints in two difference folders
2. Remove the check of checkpoint hooks
3. Fix a incorrect modification in UT
4. Fix bug: Checkpoint.load_checkpoint has been moved out
5. Add UT for new style configuration
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11630170
2023-02-13 16:54:02 +00:00
wenmeng.zwm
82f10f73aa [to #42322933] fix: pipeline base potential bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11645650

* test batched inference and no auto collate logic
2023-02-13 13:49:42 +00:00
ashui.cbh
e7c5c116c5 [to #42322933] add test condition for GPU availablity 2023-02-13 11:50:30 +00:00
wucong.lyb
1b300b2f3e [to #42322933] fix bugs: audio fs, asr & sv demo services 2023-02-13 11:46:32 +00:00
hemu.zp
9c88fb22a4 [to #42322933] fix gpt3 unexpected spaces 2023-02-13 09:50:48 +00:00
haolan.xhl
c86d9a091c vqa_degradation:modify output format from tensor to python number
算法output格式tensor->tensor.item()

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11638852
2023-02-13 07:43:08 +00:00
yuxiang.tyx
0fb84f8565 [to #42322933] change mmdet3d from 1.0.0a0 to 1.0.0a1, remove numba version restriction 2023-02-13 03:43:14 +00:00
fuhaomin.fhm
2fced1c06f [to #42322933] Doc2Bot documentation with retrieval rerank, generation 2023-02-12 03:09:33 +00:00
shuying.shu
c43bdb2ad8 [to #42322933] remove mpi4py dependence for ddpm-segmentation 2023-02-12 01:34:22 +00:00
zhangzhicheng.zzc
4215e67ba2 [to #42322933] remove requirements of mpi4py 2023-02-11 06:13:25 +00:00
Zhicheng Zhang
9c208fe4ad bump version to 1.3.0 2023-02-11 11:00:56 +08:00
zhangzhicheng.zzc
f761140a97 [to #42322933] without setting in config, textranking's num_labels default as 1
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11629915

    * without setting, textranking's num_labels default as 1
2023-02-11 01:04:47 +00:00
wenmeng.zwm
5770476881 Merge branch master-merge-github20230210 into master
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11629498
2023-02-10 22:27:30 +08:00
zhicheng.sc
5b3ce816a5 sd2-inpainting: change output to numpy array in bgr order
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11629631
2023-02-10 14:26:09 +00:00
Zhicheng Zhang
8cde397946 fix lint check 2023-02-10 20:46:22 +08:00
Zhicheng Zhang
4776396fc0 merge with github master 2023-02-10 20:30:18 +08:00
zhangzhicheng.zzc
d964b49d37 [to #47755712] remove pytorch-lightning version constrain 2023-02-10 12:20:30 +00:00
mulin.lyh
7378f94455 [to #47749867] modify audio install command 2023-02-10 12:04:08 +00:00
haolan.xhl
e537f9df1d [to #42322933] add vqa-degradation
add new model for image_quality_assessment_degradation
2023-02-10 11:59:59 +00:00
yuxiang.tyx
03354e4d84 update mmdet3d version
mmdet3d版本从1.0.0rc6改为1.0.0rc6damo,移除networkx版本限制,避免maaslib冲突

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11621702
2023-02-10 09:29:25 +00:00
ly261666
2c8f9801a2 [to #42322933] add content check model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11473049
2023-02-10 08:18:26 +00:00
wk258730
05a407da7f add pipelines for en2zh-imt and zh2en-imt
*[ 交互式机器翻译-英中-通用领域-large](https://modelscope.cn/models/damo/nlp_imt_translation_en2zh/summary)
*[ 交互式机器翻译-中英-通用领域-large](https://modelscope.cn/models/damo/nlp_imt_translation_zh2en/summary)

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11593182
2023-02-10 08:13:18 +00:00
hejunjie.hjj
6fc15926a3 [to #42322933] add single and multiple human parsing models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11508413
2023-02-10 08:01:23 +00:00
wenmeng.zwm
677e49eaf3 update api doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11582587
2023-02-10 07:48:11 +00:00
shimin.ysm
9b0e302a66 refine cv_image_defrcn trainer to avoid failed
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11622570
2023-02-10 07:10:59 +00:00
wenqi.oywq
6c5eb3bab3 Add AdaInt model
新增加 adaint 模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11588338


* 复用image color enhance pipeline

* mv cuda extension to ops

* 修改adaint模型初始化方式,去掉封装
2023-02-10 06:48:22 +00:00
zhangzhicheng.zzc
f88b03ab72 [to #47307896] update backbone-head
The original backbone-head abstraction was not articheted well enough, the input and output parameters of backbone and head were in the form of **kwargs, which was implicit and might cause confustion. Therefore, the following adjustments were made:
原有backbone head抽象程度不够深,backbone 以及head输入输出参数为**kwargs,比较晦涩,同时很多功能无法支持扩展,因此做了如下调整:

1. Divide the basic model based on the structure to: encoder-only model, decoder-only model, single stage model, two stage model, etc., . Now, the encoder-only model was accomplished, while others are under design
2. Derive the structed task-models from the basic model structure above: a single structed task-model is mainly used to parse the backbone/head cfg, in order to apply the correct backbone or head components, some models might adjust the forward method from the basic model
3. Add the initialization parameters, input and output parameters to head class and backbone class, in order to reduce the understanding cost.
4. Remove the original nncrf class and chang it to backbone-head form with the lstm backbone and crf head.
5. Support  `model = Model.from_pretrained('bert-based-fill-mask', task='text-classification')`, this method could correctly load the backbone even when the task is different from the original one in configuration.
6. Support loading the model through the transformer's automodel, in the case of quickly integrating the backbone model without coding
7. Unifiy the original task classes in each nlp model and the structed task-model classes, the structed task-model are largely reduce the redundant codes in the original task classed. Still under refactor
8. Support load model configuration from hf transformers config.json, if the model related configuration is missing. Only suppport NLP models
2023-02-10 06:46:47 +00:00
qize.yqz
5e88cfe693 add open vocabulary detection
添加了开放词汇目标检测任务和模型

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11548569
2023-02-10 06:37:51 +00:00
yuze.zyz
ca1321f53f Support trainer prediction and fix some bugs
1. Support trainer prediction
2. Fix bug in text classification metric
3. Move load checkpoint out of checkpointhook
4. Fix bug in train progressing (inner_iter variable not correct)

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11560269
2023-02-10 06:19:37 +00:00
zhangyanzhao.zyz
e6c05a2931 sentence-embedding support finetune
sentence-embedding模型支持finetune

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11537009
2023-02-10 06:07:38 +00:00
xiangpeng.wxp
e252113294 fix numpy tensor error for csanmt
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11621108
2023-02-10 06:06:35 +00:00
zhongning.hzn
27304e38b0 Add bad image detection model and pipeline
坏帧检测bad_image_detecting模型CR 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11580680
2023-02-10 05:33:57 +00:00
hemu.zp
82482b3e96 update training args
Based on feat/0131/nlp_args branch, the original code review: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11408570

Support for running finetuning from the command line with training args, Compatible with the configuration optimization.
2023-02-10 05:32:21 +00:00
yuze.zyz
4dca4773db Support csanmt exporting and refactor some code
1. Support csanmt exporting to savedmodel format
2. Create a new base class for text-ranking preprocessors, and move some parameters of mgeo_ranking_preprocessor to init method
3. Avoid Model & Preprocessor classes coupled with pytorch
4. Regression test supports comparing only model output
5. Support zero-shot exporting to onnx and torchscript

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11522461
2023-02-10 05:15:04 +00:00
jiangyu.xzy
9f1b767ecd asr训练dataset & 单独vad模型推理 & 多模型组合的asr推理
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11610526

* add asr dataset

* sv num_workers 0

* add vad pipeline

* add flexible vad/punc/lm model inputs
2023-02-10 05:09:00 +00:00
xixing.tj
b5e881148a add ocr detection new model and pipeline for dbnet
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11574897
2023-02-10 05:02:59 +00:00
ly261666
b4ad0e49fb [to #42322933] add face quality assessment model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11473023
2023-02-10 04:59:08 +00:00
zhicheng.sc
55d8d1b67c sd-inpainting: pass prompt in kwargs & reduce GPU usage
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11616099

* pass prompt in kwargs
2023-02-10 02:16:21 +00:00
ljh263654
29e47e5030 add video deinterlace model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11508847


* add video deinterlace model

* resolve conflict for video deinterlace

* fix CR problems
2023-02-10 02:15:49 +00:00