Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 12:39:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,478 Commits 263 Branches 106 Tags
dfd1058d4550d595ba736fce9d87dfe2fe148961
Commit Graph

177 Commits

Author SHA1 Message Date
yuxiang.tyx
09a178d171 support onnx export for SCRFD model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11826666
 2023-03-01 10:02:49 +08:00
jiangyu.xzy
9f655da220 add speaker diarization pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11808124

* add speaker diarization pipeline
 2023-02-28 16:19:30 +08:00
zhicheng.sc
d11fff0c0a add ControlNet for controllable image generation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11697239

* add ControlNet for scribble2image

* update code comments

* support scribble input

* update scribble input for demo service

* support all models of ControlNet

* add requirements

* fix code style bug

* update model id
 2023-02-28 13:39:12 +08:00
jiangyu.xzy
0697f969a1 asr infer change vad/lm/punc input logic 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11747596

* change vad/punc/lm model input logic

* asr infer extra kwargs

* fix format

* new funasr version
 2023-02-22 21:05:58 +08:00
wucong.lyb
1b300b2f3e [to #42322933] fix bugs: audio fs, asr & sv demo services 2023-02-13 11:46:32 +00:00
yuxiang.tyx
0fb84f8565 [to #42322933] change mmdet3d from 1.0.0a0 to 1.0.0a1, remove numba version restriction 2023-02-13 03:43:14 +00:00
zhangzhicheng.zzc
d964b49d37 [to #47755712] remove pytorch-lightning version constrain 2023-02-10 12:20:30 +00:00
mulin.lyh
7378f94455 [to #47749867] modify audio install command 2023-02-10 12:04:08 +00:00
yuxiang.tyx
03354e4d84 update mmdet3d version 
mmdet3d版本从1.0.0rc6改为1.0.0rc6damo，移除networkx版本限制，避免maaslib冲突

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11621702
 2023-02-10 09:29:25 +00:00
zhicheng.sc
55d8d1b67c sd-inpainting: pass prompt in kwargs & reduce GPU usage 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11616099

* pass prompt in kwargs
 2023-02-10 02:16:21 +00:00
ashui.cbh
10d1b3217c support paint-by-example model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11561235

    * add paint-by-example

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* format check

* format check

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* revise

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* revision according to CR reviews

* new

* revise model

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* feat: Fix conflict, auto commit by WebIDE
 2023-02-09 10:23:02 +00:00
ryan.yy
2741a207fd add nerf-recon model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11546752
 2023-02-09 09:05:35 +00:00
yuxiang.tyx
a8f717dd13 add object_detection3d_depe model 
新增3D目标检测模型DEPE

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11549127
 2023-02-09 06:16:11 +00:00
zhicheng.sc
eba66f1fd1 [0210] Add stable diffusion model for image inpainting 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11583801
 2023-02-09 04:35:34 +00:00
ly119399
fb61f36e45 [to #47599009] remove text2sql_lgesql from nlp requirements 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11539904
 2023-02-08 11:56:53 +00:00
biwen.lbw
c8d4e755fd add face_reconstruction model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11527525
 2023-02-08 09:24:54 +00:00
bin.xue
1d2b7e8634 [to #42322933] separate audio requirements 2023-02-07 02:52:01 +00:00
shuying.shu
f3f4332105 add ddpm-segmentation pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11467103
 2023-02-07 02:03:02 +00:00
wucong.lyb
e95a32deda add args for asr_infer_pipeline, punc_pipeline, sv_pipeline & modify funasr version 
add args for asr_infer_pipeline, punc_pipeline, sv_pipeline
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11547617

    * modify pipeline args

* fix output_dir

* fix sv ValueError

* fix outputs

* code style

* add args for asr_infer_pipeline, punc_pipeline, sv_pipeline & modify funasr version

* fix kwargs and add param_dict for asr_inference_pipeline

* modify code comments
 2023-02-06 14:53:42 +00:00
mulin.lyh
e54694690f [to #46993990]feat: run ci cases base on code diff to reduct ci test time 2023-02-06 08:00:19 +00:00
lllcho.lc
64abee6417 [to #42322933] add new motion-generation model 
新增运动生成模型，根据文本描述，生成人体的运动数据
 2023-02-01 09:48:58 +00:00
Yingda Chen
af62b3e9ad limit pyarrow version 2023-01-31 11:35:09 +08:00
yingda.chen
2e029a1eda update requirment and fix some typos 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11479462
 2023-01-31 01:23:56 +00:00
xingjun.wxj
5a01eca834 [to #42322933] fix datasets version incompatible issue 
最近release的datasets==2.9.0版本在IterableDataset等类和方法上，与老版本(<=2.8.0)不兼容；修改requirements将其版本限制在2.7.0~2.8.0

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11476999

* fix datasets==2.8.0 and datasets==2.9.0 incompatible issue
 2023-01-29 11:13:09 +00:00
mxf164419
01f0c747c7 add easyrobust-models for image classification 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11372821
 2023-01-16 10:02:34 +00:00
zhangzhicheng.zzc
30dace6e43 add zhconv to nlp requirements 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11435768
 2023-01-14 08:13:35 +00:00
jiangyu.xzy
742ad4b355 sv inference & asr trainer: add new inputs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11424993

* add sv_inference for speaker embedding extraction

* add raw inputs support for speaker_verification

* add train meta_params
 2023-01-13 13:52:52 +00:00
hemu.zp
9b353fd10e [to #42322933] add requirements rouge 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11422746
 2023-01-13 02:31:56 +00:00
bin.xue
78f812dbb6 [to #42322933] add speech separation finetune 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11379892
 2023-01-12 07:02:46 +08:00
jiangyu.xzy
3989b8da32 asr inference: support new models, punctuation, vad, sv 
asr推理支持新模型，以及支持标点后处理、端点检测、说话人确认
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11366442

    * support asr new models & vad-punc models

* fix conflict

* fix format

* Merge branch 'master' into asr/asr_inference

* add punc pipeline

* add punc model

* add sv infer

* fix format

* Merge branch 'master' into asr/asr_inference

* fix sv pipeline

* remove useless comments

* fix asr_test

* fix format

* fix output format

* change test level of models which would be removed later.
 2023-01-11 23:28:14 +08:00
gongbiao.gb
5debc88edf add vop retrieval 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11302991
 2023-01-11 22:22:12 +08:00
ly103369
0e54e80b23 add Damo Chinese Stable Diffusion and fix bugs in DiffusersPipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11386214

* chinese sd & fix sdwrapper

* impl preprocess and postprocess in DiffusersPipeline

* add accelerate requirements
 2023-01-11 21:49:58 +08:00
guangpan.cd
03cce308c7 Integrate StabeDiffusionPipeline from diffusers into MaaS-lib 
Integrate `StabeDiffusionPipeline` from [`diffusers`](https://github.com/huggingface/diffusers/blob/main/src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion.py) into MaaS-lib.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11344883
 2023-01-10 13:54:52 +08:00
xingjun.wxj
43edddd31f [to #42322933] msdataset module refactor and add 1230 features 
1. 优化本地数据集加载链路  
2. local与remote解耦，无网络环境下也可以使用SDK  
3. 升级hf datasets及其相关依赖到最新版(2.7.0+)
4. 解决元数据感知不到数据文件变更的问题  
5. 系统分层设计
6. 本地缓存管理问题  
7. 优化error log输出信息  
8. 支持streaming load	
* a. 支持数据文件为zip格式的streaming
* b. 支持Image/Text/Audio/Biodata等格式数据集的iter
* c. 兼容训练数据在meta中的历史数据集的streaming load
* d. 支持数据文件为文件夹格式的streaming load

9. finetune任务串接进一步规范
* a. 避免出现to_hf_dataset这种使用，将常用的tf相关的func封装起来  
* b. 去掉了跟hf混用的一些逻辑，统一包装到MsDataset里面

10. 超大数据集场景优化
* a. list oss objects: 直接拉取meta中的csv mapping，不需要做 list_oss_objects的api调用（前述提交已实现）
* b. 优化sts过期加载问题（前述提交已实现）

11. 支持dataset_name格式为：namespace/dataset_name的输入方式

参考Aone链接： https://aone.alibaba-inc.com/v2/project/1162242/task/46262894
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11264406
 2023-01-10 07:01:34 +08:00
jiaqi.sjq
453ff1dae3 [to #42322933] support byte input feature and refine fp implementations 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11338137
 2023-01-09 20:56:52 +08:00
yichang.zyc
d78fe495ee add structure tasks: sudoku & text2sql 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11314581
 2023-01-09 15:53:49 +08:00
lanjinpeng.ljp
b2a78b5ad0 支持视频多目标跟踪模型 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11249098
 2023-01-09 07:11:15 +08:00
ni.chongjia
ac53ce3e36 modify format of itn_pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11257394

    * dev for asr itn inference pipeline

* add task interface

* add pipeline input

* add modemodelscope/pipelines/audio/itn_inference_pipeline.py

* add modelscope/pipelines/audio/itn_inference_pipeline.py

* modelscope/pipelines/audio/itn_inference_pipeline.py

* update modelscope/pipelines/audio/itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* remove itn.py

* modify some names

* add modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn

* add tests/pipelines/test_inverse_text_processing.py

* modify asr_inference_pipeline.py for the original files

* modify format

* add commits files

* Merge remote-tracking branch 'origin' into remotes/origin/asr/itn_nichongjia

* Merge remote-tracking branch 'origin' into remotes/origin/asr/itn_nichongjia

* modify the pipelines

* Merge branch 'master' into remotes/origin/asr/itn_nichongjia

* [to #47031187]fix: hub test suites can not parallel 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11276872

    * [to #47031187]fix: hub test suites can not parallel

* google style docs and selected file generator 

ref: https://yuque.alibaba-inc.com/pai/rwqgvl/go8sc8tqzeqqfmsz
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11150212

    * google style docs and selected file generator

* merge

* Merge remote-tracking branch 'origin' into remotes/origin/asr/itn_nichongjia

* Merge branch 'master' into remotes/origin/asr/itn_nichongjia

* add requirements for fun_text_processing
 2023-01-05 16:36:17 +08:00
mulin.lyh
ab07dc5b5a google style docs and selected file generator 
ref: https://yuque.alibaba-inc.com/pai/rwqgvl/go8sc8tqzeqqfmsz
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11150212

    * google style docs and selected file generator
 2023-01-03 16:27:29 +08:00
bin.xue
0fdf37312f [to #42322933] feat:add speech separation pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11255740
 2023-01-03 13:18:44 +08:00
james.wjg
a12ef720a6 全景分割easycv接入支持finetune（mask2former-r50）- 12.30 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11179263
 2023-01-02 11:27:11 +08:00
hemu.zp
fd0099c92d [to #42322933] Refactor megatron-util 
Rename import lib 'megatron' to 'megatron_util' and add error message for users when import failed.

Use initialize_megatron as a unified initialization entry in megatron-util, which can accept configuration input of ConfigDict in MaaS-lib.

Wrap the initialization process into the utils/megatron_utils.py file, add default parameters for the existing large model to be compatible with the uploaded configuration file.

The version of megatron_cfg currently supports v3 (default), v1 and moe.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11231840
 2022-12-29 15:01:45 +08:00
dadong.gxd
42557b0867 add cv_pointnet2_sceneflow-estimation_general 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11201880
 2022-12-29 08:09:57 +08:00
jiaqi.sjq
8896087034 [to #42322933] support kantts infer and finetune 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11111331#tab=detail
 2022-12-20 10:45:34 +08:00
wenmeng.zwm
070ec00720 remove opencv-python from framework requirements and remove easynlp from nlp default requirements 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11119626
 2022-12-16 14:27:23 +08:00
wenmeng.zwm
e2bf864f63 update audio requirements to use funasr>=0.1.4 2022-12-07 11:37:38 +08:00
wenmeng.zwm
4dd99b8f6e Revert "move opencv dependency from framwork to cv " 
This reverts commit e970a6eb43.
 2022-11-30 18:29:03 +08:00
jiangyu.xzy
9bfc77c178 support asr new models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10919277

* support new asr paraformer model

* support asr conformer model
 2022-11-30 17:08:35 +08:00
yichang.zyc
ebb9636179 fix 不必要的init和优化vqa的preprocessor 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10868091
 2022-11-28 23:12:23 +08:00
shiyi.zxh
b386a4ee50 adapt to different wav input 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10886461
 2022-11-28 17:48:10 +08:00