Commit Graph

700 Commits

Author SHA1 Message Date
jiangyu.xzy
3989b8da32 asr inference: support new models, punctuation, vad, sv
asr推理支持新模型,以及支持标点后处理、端点检测、说话人确认
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11366442

    * support asr new models & vad-punc models

* fix conflict

* fix format

* Merge branch 'master' into asr/asr_inference

* add punc pipeline

* add punc model

* add sv infer

* fix format

* Merge branch 'master' into asr/asr_inference

* fix sv pipeline

* remove useless comments

* fix asr_test

* fix format

* fix output format

* change test level of models which would be removed later.
2023-01-11 23:28:14 +08:00
gongbiao.gb
5debc88edf add vop retrieval
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11302991
2023-01-11 22:22:12 +08:00
huizheng.hz
466200f355 NAFNet Image Deblurring pipeline and finetune support
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11300932

* fix psnr/ssim metrics for NAFNet (image denoise)

* add subset_name when loading dataset (NAFNet image denoising)
2023-01-11 22:18:03 +08:00
pangda
ae5caf584a [to #42322933] add UT for adaseq span-based ner pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11398124
2023-01-11 22:13:03 +08:00
ly103369
0e54e80b23 add Damo Chinese Stable Diffusion and fix bugs in DiffusersPipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11386214

* chinese sd & fix sdwrapper

* impl preprocess and postprocess in DiffusersPipeline

* add accelerate requirements
2023-01-11 21:49:58 +08:00
zhangzhicheng.zzc
b1b65c2597 add megatron bert 2023-01-11 21:45:42 +08:00
shenweichao.swc
1f9d6e51f6 [to #42322933] Add panovit-layout-estimation-pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11234460
2023-01-11 20:43:09 +08:00
fengyutong.fyt
1e5df96b46 [to #42322933] Add vision middleware to maas lib 2023-01-11 15:16:22 +08:00
shengzhe.sz
9667548d9e add panorama_depth_estimation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11366392

* add panorama_depth_estimation: pipeline, model, test

* modelhub:https://modelscope.cn/models/damo/cv_unifuse_panorama-depth-estimation/summary
2023-01-11 10:23:24 +08:00
guangpan.cd
03cce308c7 Integrate StabeDiffusionPipeline from diffusers into MaaS-lib
Integrate `StabeDiffusionPipeline` from [`diffusers`](https://github.com/huggingface/diffusers/blob/main/src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion.py) into MaaS-lib.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11344883
2023-01-10 13:54:52 +08:00
maojialiang.mjl
73066fe04c [to #42322933] Add cv-bnext-image-classification-pipeline to maas lib
add binary quantization classification to maas lib
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11257734
2023-01-10 07:42:24 +08:00
liaojie.laj
fcf6e6431f submit video frame interpolation model
增加视频插帧模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11188339
2023-01-10 06:57:19 +08:00
ryan.yy
c77213d919 图像换脸模型上MaaS
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11347556
2023-01-10 05:45:55 +08:00
huizheng.hz
340a14a456 save a video with h264 vcodec for video_super_resolution pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11327516
2023-01-09 22:23:55 +08:00
yuze.zyz
672a4ba107 Refactor tinynas objectdetection & img-classification
Refactor tinynas model & pipeline:
1. Move preprocess method out of model to image.py
2. Pipeline calls the model.__call__ method instead of inference method
3. Remove some obsolete code
4. Add a default preprocessor to preprocessor.py instead of change config in modelhub.
5. Standardize the return value of model

Refactor general image classification pipeline:
1. Change the preprocessor build method of ofa to avoid dependencies between multi-modal and cv.
2. Move preprocess method out of pipeline to image.py
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11185418
2023-01-09 21:33:42 +08:00
zhicheng.sc
2cb89609f0 Add video stabilization model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11204574

* add video stabilization model
2023-01-09 21:23:26 +08:00
jiaqi.sjq
453ff1dae3 [to #42322933] support byte input feature and refine fp implementations
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11338137
2023-01-09 20:56:52 +08:00
yichang.zyc
d78fe495ee add structure tasks: sudoku & text2sql
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11314581
2023-01-09 15:53:49 +08:00
chong.zhang
f56742b9af add new asr model_id: speech_UniASR_asr_2pass-pt-16k-common-vocab1617-tensorflow1-offline, speech_UniASR_asr_2pass-pt-16k-com...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11311291
2023-01-09 09:32:37 +08:00
hemu.zp
871b345e79 [to #42322933] GPT-3 model supports batch input
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11322820
2023-01-09 09:31:44 +08:00
lanjinpeng.ljp
b2a78b5ad0 支持视频多目标跟踪模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11249098
2023-01-09 07:11:15 +08:00
zhangyanzhao.zyz
8f5dc7aea4 文本向量pipeline支持仅输入source sentences; 新增medical/ecom领域语义相关性/文本向量表示模型UT。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11283935
2023-01-09 07:02:56 +08:00
wenmeng.zwm
68534bf554 Revert "skip unifold ut due to MMseqs2 api error"
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11334131
2023-01-09 06:56:30 +08:00
ziyuan.tw
9552a8533e add ConvNeXt model
增加ConvNeXt模型和修复代码bug:模型需要输入BGR格式图像,但读取图片代码默认输出为RGB格式,造成归一化预处理错误,模型精度下降。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11192762
2023-01-09 06:56:05 +08:00
mulin.lyh
aa541468d1 temp skip tests/pipelines/test_video_depth_estimation.py for download demo_kitti.gif failed 2023-01-08 10:28:35 +08:00
xuangen.hlh
db654dab5b fix error of 'unexpected keyword argument device_id'
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11347364
2023-01-07 03:25:54 +08:00
ni.chongjia
ac53ce3e36 modify format of itn_pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11257394

    * dev for asr itn inference pipeline

* add task interface

* add pipeline input

* add modemodelscope/pipelines/audio/itn_inference_pipeline.py

* add modelscope/pipelines/audio/itn_inference_pipeline.py

* modelscope/pipelines/audio/itn_inference_pipeline.py

* update modelscope/pipelines/audio/itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* remove itn.py

* modify some names

* add modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn

* add tests/pipelines/test_inverse_text_processing.py

* modify asr_inference_pipeline.py for the original files

* modify format

* add commits files

* Merge remote-tracking branch 'origin' into remotes/origin/asr/itn_nichongjia

* Merge remote-tracking branch 'origin' into remotes/origin/asr/itn_nichongjia

* modify the pipelines

* Merge branch 'master' into remotes/origin/asr/itn_nichongjia

* [to #47031187]fix: hub test suites can not parallel 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11276872

    * [to #47031187]fix: hub test suites can not parallel

* google style docs and selected file generator 

ref: https://yuque.alibaba-inc.com/pai/rwqgvl/go8sc8tqzeqqfmsz
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11150212

    * google style docs and selected file generator

* merge

* Merge remote-tracking branch 'origin' into remotes/origin/asr/itn_nichongjia

* Merge branch 'master' into remotes/origin/asr/itn_nichongjia

* add requirements for fun_text_processing
2023-01-05 16:36:17 +08:00
kangxiaoyang.kxy
2260dd45fa 1230-image-colorization
submit new algorithm for image colorization and corresponding pipeline.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11179627
2023-01-05 15:02:49 +08:00
kaisong.sks
2d68c6772a 用户满意度分析推理
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11235766

    * add

* add

* Merge remote-tracking branch 'origin' into nlp_user-satisfaction-estimation

* add

* add

* add

* Merge branch 'master' into nlp_user-satisfaction-estimation

* add

* Merge branch 'master' into nlp_user-satisfaction-estimation

* add

* add

* Merge branch 'master' into nlp_user-satisfaction-estimation

* Merge branch 'master' into nlp_user-satisfaction-estimation

* Merge branch 'master' into nlp_user-satisfaction-estimation

* Merge remote-tracking branch 'origin' into nlp_user-satisfaction-estimation

* add

* Merge branch 'master' into nlp_user-satisfaction-estimation
2023-01-05 10:58:36 +08:00
changxu.ccx
60bd40742a [to #42322933] Add vldoc to maas lib
Test
```python
python tests/pipelines/test_document_vl_embedding.py
```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11199555
2023-01-04 19:11:30 +08:00
pangda
2dbc93a931 [to #42322933] add UT for chunking model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11289061
2023-01-04 04:41:00 +08:00
bin.xue
0fdf37312f [to #42322933] feat:add speech separation pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11255740
2023-01-03 13:18:44 +08:00
dadong.gxd
01c498cd14 add cv_casmvs_multi-view-depth-esimation_general
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11204285
2023-01-03 08:24:41 +08:00
shouzhou.bx
4698051fa5 update task of hand detect
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11271647
2023-01-02 12:14:49 +08:00
james.wjg
a12ef720a6 全景分割easycv接入支持finetune(mask2former-r50)- 12.30
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11179263
2023-01-02 11:27:11 +08:00
lee.lcy
ed28b849eb [to #42322933] add domain specific object detection models
添加垂类目标检测模型。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11265502
2022-12-30 14:19:16 +08:00
hejunjie.hjj
d560291525 [to #42322933] add maskdino model (1230)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11187240
2022-12-30 07:43:57 +08:00
hemu.zp
fd0099c92d [to #42322933] Refactor megatron-util
Rename import lib 'megatron' to 'megatron_util' and add error message for users when import failed.

Use initialize_megatron as a unified initialization entry in megatron-util, which can accept configuration input of ConfigDict in MaaS-lib.

Wrap the initialization process into the utils/megatron_utils.py file, add default parameters for the existing large model to be compatible with the uploaded configuration file.

The version of megatron_cfg currently supports v3 (default), v1 and moe.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11231840
2022-12-29 15:01:45 +08:00
ly261666
6583e6f398 [to #42322933] Add FLIR Face Liveness Model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11250177
2022-12-29 14:55:51 +08:00
pengteng.spt
cddebf567f add kws nearfield finetune
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11179425

* add kws nearfield finetune

* work on rank-0 only if evaluating

* split kaldi relevant code into runtime utils

* add evaluate but not files checking

* test evaluate on cpu

* add default value for cmvn_file
2022-12-29 10:14:41 +08:00
dadong.gxd
42557b0867 add cv_pointnet2_sceneflow-estimation_general
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11201880
2022-12-29 08:09:57 +08:00
yeqinghao.yqh
f7a7504782 Add HiTeA model for VideoQA and Caption (12.30)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11201652
2022-12-29 08:06:34 +08:00
hemu.zp
f58060b140 [to #42322933] add GPT-2 model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11194200
2022-12-29 07:59:40 +08:00
lee.lcy
e8a354d226 [to #42322933] add real-time human detection model
add real-time human detection model
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11191113
2022-12-29 07:58:45 +08:00
yichang.zyc
0c79b57fcc support batch infer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11170755
2022-12-28 12:17:36 +08:00
qianmu.ywh
59b7f411b8 add video depth estimation pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11189483
2022-12-28 06:34:02 +08:00
wjq264216
e57424eaf0 [to #42322933] Add ocr-detection-vlpt-pipeline to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11213036
2022-12-28 06:26:15 +08:00
huizheng.hz
cb9f1bfb8d 1230-video-super-resolution
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11090960
2022-12-28 06:18:50 +08:00
wenmeng.zwm
4ee2ad3617 skip unifold ut due to MMseqs2 api error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11218838
2022-12-26 22:37:45 +08:00
wenmeng.zwm
a01e29ceb0 fix check video type cv2.VideoCapture and add unittest
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11181951
2022-12-26 09:59:59 +08:00