Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 20:49:37 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,418 Commits 263 Branches 106 Tags
350e76d296c9ea22fc0769dfeead02c5cd81eaaf
Commit Graph

173 Commits

Author SHA1 Message Date
wucong.lyb
1b300b2f3e [to #42322933] fix bugs: audio fs, asr & sv demo services 2023-02-13 11:46:32 +00:00
yuxiang.tyx
0fb84f8565 [to #42322933] change mmdet3d from 1.0.0a0 to 1.0.0a1, remove numba version restriction 2023-02-13 03:43:14 +00:00
zhangzhicheng.zzc
d964b49d37 [to #47755712] remove pytorch-lightning version constrain 2023-02-10 12:20:30 +00:00
mulin.lyh
7378f94455 [to #47749867] modify audio install command 2023-02-10 12:04:08 +00:00
yuxiang.tyx
03354e4d84 update mmdet3d version 
mmdet3d版本从1.0.0rc6改为1.0.0rc6damo，移除networkx版本限制，避免maaslib冲突

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11621702
 2023-02-10 09:29:25 +00:00
zhicheng.sc
55d8d1b67c sd-inpainting: pass prompt in kwargs & reduce GPU usage 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11616099

* pass prompt in kwargs
 2023-02-10 02:16:21 +00:00
ashui.cbh
10d1b3217c support paint-by-example model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11561235

    * add paint-by-example

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* format check

* format check

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* revise

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* revision according to CR reviews

* new

* revise model

* Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib

* feat: Fix conflict, auto commit by WebIDE
 2023-02-09 10:23:02 +00:00
ryan.yy
2741a207fd add nerf-recon model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11546752
 2023-02-09 09:05:35 +00:00
yuxiang.tyx
a8f717dd13 add object_detection3d_depe model 
新增3D目标检测模型DEPE

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11549127
 2023-02-09 06:16:11 +00:00
zhicheng.sc
eba66f1fd1 [0210] Add stable diffusion model for image inpainting 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11583801
 2023-02-09 04:35:34 +00:00
ly119399
fb61f36e45 [to #47599009] remove text2sql_lgesql from nlp requirements 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11539904
 2023-02-08 11:56:53 +00:00
biwen.lbw
c8d4e755fd add face_reconstruction model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11527525
 2023-02-08 09:24:54 +00:00
bin.xue
1d2b7e8634 [to #42322933] separate audio requirements 2023-02-07 02:52:01 +00:00
shuying.shu
f3f4332105 add ddpm-segmentation pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11467103
 2023-02-07 02:03:02 +00:00
wucong.lyb
e95a32deda add args for asr_infer_pipeline, punc_pipeline, sv_pipeline & modify funasr version 
add args for asr_infer_pipeline, punc_pipeline, sv_pipeline
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11547617

    * modify pipeline args

* fix output_dir

* fix sv ValueError

* fix outputs

* code style

* add args for asr_infer_pipeline, punc_pipeline, sv_pipeline & modify funasr version

* fix kwargs and add param_dict for asr_inference_pipeline

* modify code comments
 2023-02-06 14:53:42 +00:00
mulin.lyh
e54694690f [to #46993990]feat: run ci cases base on code diff to reduct ci test time 2023-02-06 08:00:19 +00:00
lllcho.lc
64abee6417 [to #42322933] add new motion-generation model 
新增运动生成模型，根据文本描述，生成人体的运动数据
 2023-02-01 09:48:58 +00:00
Yingda Chen
af62b3e9ad limit pyarrow version 2023-01-31 11:35:09 +08:00
yingda.chen
2e029a1eda update requirment and fix some typos 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11479462
 2023-01-31 01:23:56 +00:00
xingjun.wxj
5a01eca834 [to #42322933] fix datasets version incompatible issue 
最近release的datasets==2.9.0版本在IterableDataset等类和方法上，与老版本(<=2.8.0)不兼容；修改requirements将其版本限制在2.7.0~2.8.0

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11476999

* fix datasets==2.8.0 and datasets==2.9.0 incompatible issue
 2023-01-29 11:13:09 +00:00
mxf164419
01f0c747c7 add easyrobust-models for image classification 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11372821
 2023-01-16 10:02:34 +00:00
zhangzhicheng.zzc
30dace6e43 add zhconv to nlp requirements 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11435768
 2023-01-14 08:13:35 +00:00
jiangyu.xzy
742ad4b355 sv inference & asr trainer: add new inputs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11424993

* add sv_inference for speaker embedding extraction

* add raw inputs support for speaker_verification

* add train meta_params
 2023-01-13 13:52:52 +00:00
hemu.zp
9b353fd10e [to #42322933] add requirements rouge 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11422746
 2023-01-13 02:31:56 +00:00
bin.xue
78f812dbb6 [to #42322933] add speech separation finetune 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11379892
 2023-01-12 07:02:46 +08:00
jiangyu.xzy
3989b8da32 asr inference: support new models, punctuation, vad, sv 
asr推理支持新模型，以及支持标点后处理、端点检测、说话人确认
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11366442

    * support asr new models & vad-punc models

* fix conflict

* fix format

* Merge branch 'master' into asr/asr_inference

* add punc pipeline

* add punc model

* add sv infer

* fix format

* Merge branch 'master' into asr/asr_inference

* fix sv pipeline

* remove useless comments

* fix asr_test

* fix format

* fix output format

* change test level of models which would be removed later.
 2023-01-11 23:28:14 +08:00
gongbiao.gb
5debc88edf add vop retrieval 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11302991
 2023-01-11 22:22:12 +08:00
ly103369
0e54e80b23 add Damo Chinese Stable Diffusion and fix bugs in DiffusersPipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11386214

* chinese sd & fix sdwrapper

* impl preprocess and postprocess in DiffusersPipeline

* add accelerate requirements
 2023-01-11 21:49:58 +08:00
guangpan.cd
03cce308c7 Integrate StabeDiffusionPipeline from diffusers into MaaS-lib 
Integrate `StabeDiffusionPipeline` from [`diffusers`](https://github.com/huggingface/diffusers/blob/main/src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion.py) into MaaS-lib.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11344883
 2023-01-10 13:54:52 +08:00
xingjun.wxj
43edddd31f [to #42322933] msdataset module refactor and add 1230 features 
1. 优化本地数据集加载链路  
2. local与remote解耦，无网络环境下也可以使用SDK  
3. 升级hf datasets及其相关依赖到最新版(2.7.0+)
4. 解决元数据感知不到数据文件变更的问题  
5. 系统分层设计
6. 本地缓存管理问题  
7. 优化error log输出信息  
8. 支持streaming load	
* a. 支持数据文件为zip格式的streaming
* b. 支持Image/Text/Audio/Biodata等格式数据集的iter
* c. 兼容训练数据在meta中的历史数据集的streaming load
* d. 支持数据文件为文件夹格式的streaming load

9. finetune任务串接进一步规范
* a. 避免出现to_hf_dataset这种使用，将常用的tf相关的func封装起来  
* b. 去掉了跟hf混用的一些逻辑，统一包装到MsDataset里面

10. 超大数据集场景优化
* a. list oss objects: 直接拉取meta中的csv mapping，不需要做 list_oss_objects的api调用（前述提交已实现）
* b. 优化sts过期加载问题（前述提交已实现）

11. 支持dataset_name格式为：namespace/dataset_name的输入方式

参考Aone链接： https://aone.alibaba-inc.com/v2/project/1162242/task/46262894
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11264406
 2023-01-10 07:01:34 +08:00
jiaqi.sjq
453ff1dae3 [to #42322933] support byte input feature and refine fp implementations 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11338137
 2023-01-09 20:56:52 +08:00
yichang.zyc
d78fe495ee add structure tasks: sudoku & text2sql 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11314581
 2023-01-09 15:53:49 +08:00
lanjinpeng.ljp
b2a78b5ad0 支持视频多目标跟踪模型 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11249098
 2023-01-09 07:11:15 +08:00
ni.chongjia
ac53ce3e36 modify format of itn_pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11257394

    * dev for asr itn inference pipeline

* add task interface

* add pipeline input

* add modemodelscope/pipelines/audio/itn_inference_pipeline.py

* add modelscope/pipelines/audio/itn_inference_pipeline.py

* modelscope/pipelines/audio/itn_inference_pipeline.py

* update modelscope/pipelines/audio/itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* remove itn.py

* modify some names

* add modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn_inference_pipeline.py

* modify itn

* add tests/pipelines/test_inverse_text_processing.py

* modify asr_inference_pipeline.py for the original files

* modify format

* add commits files

* Merge remote-tracking branch 'origin' into remotes/origin/asr/itn_nichongjia

* Merge remote-tracking branch 'origin' into remotes/origin/asr/itn_nichongjia

* modify the pipelines

* Merge branch 'master' into remotes/origin/asr/itn_nichongjia

* [to #47031187]fix: hub test suites can not parallel 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11276872

    * [to #47031187]fix: hub test suites can not parallel

* google style docs and selected file generator 

ref: https://yuque.alibaba-inc.com/pai/rwqgvl/go8sc8tqzeqqfmsz
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11150212

    * google style docs and selected file generator

* merge

* Merge remote-tracking branch 'origin' into remotes/origin/asr/itn_nichongjia

* Merge branch 'master' into remotes/origin/asr/itn_nichongjia

* add requirements for fun_text_processing
 2023-01-05 16:36:17 +08:00
mulin.lyh
ab07dc5b5a google style docs and selected file generator 
ref: https://yuque.alibaba-inc.com/pai/rwqgvl/go8sc8tqzeqqfmsz
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11150212

    * google style docs and selected file generator
 2023-01-03 16:27:29 +08:00
bin.xue
0fdf37312f [to #42322933] feat:add speech separation pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11255740
 2023-01-03 13:18:44 +08:00
james.wjg
a12ef720a6 全景分割easycv接入支持finetune（mask2former-r50）- 12.30 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11179263
 2023-01-02 11:27:11 +08:00
hemu.zp
fd0099c92d [to #42322933] Refactor megatron-util 
Rename import lib 'megatron' to 'megatron_util' and add error message for users when import failed.

Use initialize_megatron as a unified initialization entry in megatron-util, which can accept configuration input of ConfigDict in MaaS-lib.

Wrap the initialization process into the utils/megatron_utils.py file, add default parameters for the existing large model to be compatible with the uploaded configuration file.

The version of megatron_cfg currently supports v3 (default), v1 and moe.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11231840
 2022-12-29 15:01:45 +08:00
dadong.gxd
42557b0867 add cv_pointnet2_sceneflow-estimation_general 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11201880
 2022-12-29 08:09:57 +08:00
jiaqi.sjq
8896087034 [to #42322933] support kantts infer and finetune 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11111331#tab=detail
 2022-12-20 10:45:34 +08:00
wenmeng.zwm
070ec00720 remove opencv-python from framework requirements and remove easynlp from nlp default requirements 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11119626
 2022-12-16 14:27:23 +08:00
wenmeng.zwm
e2bf864f63 update audio requirements to use funasr>=0.1.4 2022-12-07 11:37:38 +08:00
wenmeng.zwm
4dd99b8f6e Revert "move opencv dependency from framwork to cv " 
This reverts commit e970a6eb43.
 2022-11-30 18:29:03 +08:00
jiangyu.xzy
9bfc77c178 support asr new models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10919277

* support new asr paraformer model

* support asr conformer model
 2022-11-30 17:08:35 +08:00
yichang.zyc
ebb9636179 fix 不必要的init和优化vqa的preprocessor 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10868091
 2022-11-28 23:12:23 +08:00
shiyi.zxh
b386a4ee50 adapt to different wav input 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10886461
 2022-11-28 17:48:10 +08:00
jiangyu.xzy
2b62084146 add funasr based asr inference 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10868583
 2022-11-25 17:49:24 +08:00
shiyi.zxh
7661470350 ofa增加asr任务 
ofa增加asr任务infer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10761019
 2022-11-25 12:16:33 +08:00
james.wjg
541e460f8b add support for cv/language_guided_video_summarization 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10636269
 2022-11-16 15:20:26 +08:00
yingda.chen
e970a6eb43 move opencv dependency from framwork to cv 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10708368
 2022-11-12 20:09:48 +08:00