Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 20:49:37 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,143 Commits 263 Branches 106 Tags
d64cfa48bc293453355fc9151f90128fb72fff8e
Commit Graph

228 Commits

Author SHA1 Message Date
mulin.lyh
23f1f474bf Merge branch 'master-github' into master-merge-github925 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14164566
 2023-09-26 21:15:41 +08:00
mulin.lyh
59ec83cd2d remove cv diffusers version 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13843028
* remove cv diffusers version
 2023-08-30 15:04:43 +08:00
Xiaobin
8ce3b4de72 Feature/seq gpt (#507) 2023-08-29 17:47:59 +08:00
tastelikefeet
f2e9ea4199 Replace code with swift wheel (#467) 2023-08-29 17:27:18 +08:00
Wang Qiang
de33f4dc87 Support sdxl finetune by lora method (#468) 
* support sdxl finetune by lora

* remove useless imports

* support sdxl finetune

* upgrade diffusers to 0.19.0

* sdxl finetune

* fix bugs

* pre commit

* diffusers>=0.19.0
 2023-08-23 11:23:34 +08:00
wenmeng zhou
e3abfe0564 Update framework.txt (#453) 
remove version restrict for numpy and pandas
 2023-08-09 18:00:44 +08:00
suluyan.sly
f080603802 remove requirement realesrgan for basicsr 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13488773
* remove requirement realesrgan for basicsr
 2023-08-01 16:55:47 +08:00
suluyan.sly
dc17c7d6ee remove cv requirements: basicsr 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13471366
* rm req basicsr
 2023-07-31 18:20:23 +08:00
suluyan.sly
05e1357c32 Merge branch 'master-github' into master-merge-github-230728 2023-07-28 16:40:34 +08:00
frozoul
2566d028cd cv/cv nerf 3d reconstruction 4k nerf damo (#389) 
* add 4k-nerf core files

* update configure file

* update dataloader and model path

* update unittest

* Delete test_4k.py

* update unittest

* update unittest

* update pre-commit

* update dataloader

* update cuda code path

* check with pre-commit

---------

Co-authored-by: zhongshu.wzs <zhongshu.wzs@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
 2023-07-28 10:37:13 +08:00
suluyan.sly
1c6f5fe775 Merge branch 'master-github' into master-merge-github-230727 
Conflicts:
       examples/pytorch/baichuan/finetune_baichuan.py
       examples/pytorch/chatglm6b/finetune.py
 2023-07-27 17:29:27 +08:00
mengyang.fmy
18f998a85c add text-to-360pano-image pipeline, mod cv requirements 
7月份计划上线的360全景图生成模型，自研

模型权重文件地址https://www.modelscope.cn/models/damo/cv_diffusion_text-to-360panorama-image_generation/summary


#### 依赖项说明

##### 由于要使用xformers，torch版本最好使用1.13.1
```
pip install torch==1.13.1+cu116 torchvision==0.14.1+cu116 torchaudio==0.13.1 --extra-index-url https://download.pytorch.org/whl/cu116
```
##### 对应的diffusers和xformers版本如下
```
pip install -U diffusers==0.18.0
pip install xformers==0.0.16
pip install triton, accelerate, transformers
```

##### ModelScope Library 需要使用cv
```
pip install modelscope
pip install "modelscope[cv]" -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html
```

##### 此外，还需要安装第三方的一个库，Real-ESRGAN， 安装方法如下
```
# Install basicsr - https://github.com/xinntao/BasicSR
# We use BasicSR for both training and inference
pip install basicsr
# facexlib and gfpgan are for face enhancement
pip install facexlib
pip install gfpgan
pip install Pillow
pip install tqdm
pip install realesrgan==0.3.0
```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13346430
* add text-to-360pano-image pipeline

* add text-to-360pano-image pipeline, mod cv requirements

* rm redundant files and cv requirements; add standard input and output definations

* fix diffusers==0.18.0 and run test

* fix diffusers==0.18.0 in multi-modal and run test again

* add model_revision='v1.0.0'

* fix yapf

* add trycatch for enabling xformers

* fix key error

* add install xformers in test/setup

* skip highres.fix in ci

* feat: Fix conflict, auto commit by WebIDE
 2023-07-27 11:33:39 +08:00
Xingjun.Wang
41c2c95083 dataset fix version (#413) 
* modify datasets version
 2023-07-25 22:18:25 +08:00
jiaqi.sjq
1f05acef88 fix pip install error when pysptk>=0.1.19 2023-07-25 21:13:31 +08:00
tongmu.wh
ba1a333ba6 add language recognition pipelines and models 
新增语种识别pipeline和model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13385083
* add language recognition pipelines and models

* add a clustering method for speaker diarization

* define input and output type for language recognition
 2023-07-25 21:07:56 +08:00
shenweichao.swc
05c65ba225 add s2net for panorama_depth_estimation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13310819
* add s2net codes

* fix sphdecoder

* Merge branch 'master' into dev/cv_s2net_panorama_depth_estimation

* revise comments in the pipeline

* revise the code
 2023-07-20 19:28:03 +08:00
Wang Qiang
0b85979f2e Update diffusers version to 0.18.0 (#377) 
* update diffusers to 0.18.0

* fix bugs
 2023-07-14 19:02:52 +08:00
mulin.lyh
3683a4386f [to #50607174]feat: support parallel download large model file 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13113235
* [to #50607174]feat: support parallel download large model file
 2023-06-30 15:30:00 +08:00
xingjun.wxj
0af8752024 Unfreeze datasets version setting 
1. Unfreeze datasets version setting
2. Fix some bugs in class NativeIterableDataset
3. Remove auto-converting (image/audio) object in col:FILE
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13080190
 2023-06-28 15:50:57 +08:00
mulin.lyh
48b62d8947 [to #50521098]fix: fix diffuser version conflict cv and multi-modal 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13079583
* [to #50521098]fix: fix diffuser version conflict cv and multi-modal
 2023-06-28 15:36:12 +08:00
mulin.lyh
eb0f0216c6 fix torch 2.x compatible issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13045011

* fix torch 2.x compatible issue

* fix torch 2.x compatible issue

* fix complex-valued input tensor matching the output from stft with return_complex=True.

* skip plugin test temporarily for modify torch version

* fix test_speech_signal_process.py compatible issue

* fix lint issue

* upgrade funasr to 0.6.5
 2023-06-27 14:40:51 +08:00
xingjun.wxj
0db0ec5586 Merge code from github 
1. Merge(add) daily regression from github PR (daily_regression.yaml)
2. Add lora stable diffusion from github PR
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13010802
* fix: device arg not work, rename device to ngpu (#272)

* Correcting the lora stable diffusion example script (#300)

* add vad model and punc model in README.md 

add vad model and punc model

* Merge pull request #302 from modelscope/langgz-patch-1

add vad model and punc model in README.md

* add 1.6

* modify ignore

* Merge pull request #307 from modelscope/dev_rs_16

Merge release 1.6

* undo datetime to 2099

* Merge pull request #311 from modelscope/fix_master_version

undo datetime to 2099

* add daily regression workflow

* modify workflow name

* fix cron format issue

* lora trainer

* Merge pull request #315 from liuyhwangyh/add_regression_workflow

add daily regression workflow
 2023-06-21 10:22:06 +08:00
zhifu.gzf
8b4e9dcdfb ngpu bug and rm easyasr 
修复ngpu指定无效的问题；移除easyasr，全部涉及模型都下架了；将funasr版本限制为>=0.6.0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12933049
* ngpu bug and rm easyasr
 2023-06-13 16:36:21 +08:00
mulin.lyh
25a7398aea docker file py38 and py37 compatible merge 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12722824
* debug

* add missing deps

* add stanza

* fix numpy issue

* numpy version

* tf case

* numpy <= 1.22.0

* fix tf 1.15.5 case

* add python38 and python37 compatible docker file

* cv add fvcore

* add easycv

* remove debug code

* fix style issue

* fix python3.7 python3.8 compatible issue

* comment

* modify run config

* scipy<=1.7.3

* revert scipy<=1.7.3

* fix compatible bug

* fix compatible bug

* add easycv

* update version: 1.6.1rc0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12754942
fix python3.8 and python3.8 compatible issue

* numpy version change

* numpy version

* numpy version

* fix numpy version

* fix numpy version

* update version: 1.6.1rc0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12754942
fix python3.8 and python3.8 compatible issue

* restore setup.py

* restore setup.py

* add build base image

* fix style

* numpy version fix

* optimize build image, split base and modelscope image

* fix style issue

* modify example path

* modify examples folder

* add SETUPTOOLS_USE_DISTUTILS=stdlib comments
 2023-06-08 10:01:58 +08:00
xingjun.wxj
5b99bb24fe update version: 1.6.1rc0 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12754942
 2023-05-25 20:28:36 +08:00
mulin.lyh
6abdce929d fix py38 issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12660340
 2023-05-17 22:11:23 +08:00
hemu.zp
1d28c5b730 mv mmdet to cv 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12614719
 2023-05-15 11:48:29 +08:00
wangmeng.xwm
f0d519219f add clip_interrogator 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12388571

* init commit of clip_interrogator

* fix format

* fix environment dependencies

* fix backend.mps

* fix test image path

* add model introduction and paper link

* add comment example for pipeline, fix device control
 2023-05-12 16:06:52 +08:00
wucong.lyb
4c0b13d157 fix func update_local_model; change funasr version 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12595406
 2023-05-11 20:13:20 +08:00
hemu.zp
ca85447363 remove pai-easycv requirement 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12564234
 2023-05-11 14:31:18 +08:00
mulin.lyh
d772d96cf5 [to #49147498]feat: support python3.8 2023-05-06 18:01:02 +08:00
bin.xue
dd4299e0c8 [to #42322933] add DFSMN model to far field KWS 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12334627
* feat: set stream mode in constructor

* fix: commit model file

* doc: add more information about DFSMN

* fix: seperation model evaluate returns None in speechbrain whose version < 0.5.12
 2023-04-20 22:45:07 +08:00
shuying.shu
a355eefbd4 fix OOM for bassl 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12354474
 2023-04-18 14:43:09 +08:00
hemu.zp
b3e7eca817 lmit mmdet version 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12339472
 2023-04-15 17:08:55 +08:00
yuze.zyz
2650d37094 Fix the log level and return value of push_to_hub 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12338218
 2023-04-15 16:42:35 +08:00
hemu.zp
a4bafd8b25 Add requirements for jsonplus 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12331254
 2023-04-14 14:05:36 +08:00
hemu.zp
4e78f611e6 Add sortedcontainers to requirements 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12310786
 2023-04-12 22:26:56 +08:00
chaojie.mcj
283517de08 add efficient tunner modules 2023-04-11 22:26:13 +08:00
wucong.lyb
fd83ffc0fa modify timestamp config && add function for update_local_model 
修改时间戳模型自由组合的参数配置；支持model设置为本地路径时通过参数”update_model“更新模型；
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12261036

    * modify timestamp args

* add update_local_model function

* fix src_path is same with dst_path

* change funasr version
 2023-04-10 19:54:11 +08:00
zhangzhicheng.zzc
6cf4867128 bug fixed in plugin 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12261613
 2023-04-09 23:49:23 +08:00
jiangnana.jnn
6f9d59f469 fix jsonplus, support ndarray 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12056076

* fix jsonplus

* add unittest

* fix json dump np float
 2023-03-21 18:10:10 +08:00
yuze.zyz
35744958f8 specify lower version 0.9.2 for librosa to avoid compatibility problem 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12008222
 2023-03-15 21:30:33 +08:00
yuze.zyz
4a0cb67e66 fix numpy dependency 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11978446
 2023-03-14 13:31:22 +08:00
yuze.zyz
e1760bf846 fix onnxsim dependency 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11972894
 2023-03-13 21:24:53 +08:00
yuze.zyz
30be0b8bb0 fix import 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11969536
 2023-03-13 20:41:14 +08:00
wucong.lyb
8e88ff46fc change funasr version to 0.3.0 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11956032
 2023-03-13 11:24:41 +08:00
jinmao.yk
4078abf488 add human reconstruction task 
单图人体重建任务 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11778199

 * add human reconstruction task
 2023-03-09 21:58:48 +08:00
yuanzhi.zyz
2ce41d4974 add ocr_reco_crnntrain 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11824395
 2023-03-09 21:14:09 +08:00
jiaqi.sjq
8099cc9f60 [to #41669377] Refactoring by using kantts as third party wheel and add ptts finetune&infer support 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11913929
 2023-03-09 11:32:44 +08:00
wangjiuniu.wjn
0ca0a8c134 add text-to-video-synthesis 
文本生成视频（text-to-video-synthesis）代码

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11767775
 2023-03-09 00:57:43 +08:00