Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-24 12:10:09 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,751 Commits 267 Branches 107 Tags
release/1.24
Commit Graph

267 Commits

Author SHA1 Message Date
xingjun.wxj
f9b7840924 add fairseq==0.12.3.1 for py311 2025-03-18 10:55:33 +08:00
xingjun.wxj
b656d6f3b7 rebuild ms-funcodec to adapt py311 2025-03-17 15:21:49 +08:00
xingjun.wxj
7e9b2a3561 ignore ttsfrd for audio_tts under py311 envs 2025-03-17 15:03:31 +08:00
xingjun.wxj
a5acaa01d0 adapte for py310 2025-03-17 11:46:07 +08:00
xingjun.wxj
2da07a3ff6 patcher 2025-03-17 11:42:13 +08:00
xingjun.wxj
3860e34073 add ms-funcodec 2025-03-14 14:01:09 +08:00
xingjun.wxj
8fe6ca766a update editdistance 2025-03-14 02:13:18 +08:00
xingjun.wxj
7f0e4e5516 recover funcodec 2025-03-13 16:19:24 +08:00
xingjun.wxj
b1bce1ded3 update 2025-03-12 17:48:57 +08:00
xingjun.wxj
f3068474f9 remove audio_asr requirements 2025-03-12 17:12:19 +08:00
xingjun.wxj
8b51dce6de update funasr 2025-03-12 16:55:25 +08:00
xingjun.wxj
211eaa09a3 update funasr 2025-03-12 16:53:16 +08:00
xingjun.wxj
3dff58b4d1 del pysptk in audio_tts 2025-03-12 10:37:57 +08:00
xingjun.wxj
a6600c02d9 del ttsfrd 2025-03-11 22:47:30 +08:00
tastelikefeet
7246d0b359 Merge 1.23 hotfix to master (#1227) 2025-02-17 10:30:24 +08:00
Xingjun.Wang
71a54c1a51 support latest datasets version (#1163) 2025-01-02 17:06:46 +08:00
Yunlin Mao
31bf308e44 downgrade moviepy to 1.0.3 (#1133) 2024-12-10 10:10:01 +08:00
tastelikefeet
328bbc0494 Fix some bugs (#1056) 
* fix some bugs

* remove install tf-kersa

* fix

* use bin bash as default
 2024-10-30 15:49:38 +08:00
Xingjun.Wang
134fe72f06 hotfix for datasets 3.0.2 (#1046) 2024-10-23 16:25:53 +08:00
Xingjun.Wang
2c4505e13a Adapt new datasets (#1002) 
* update ds==3.0

* update

* add http_get_ms func

* del unused code

* fix pr issue and update requirements
 2024-09-30 16:46:00 +08:00
tastelikefeet
4c518db424 patch hf hub (#987) 2024-09-14 12:24:19 +08:00
liuyhwangyh
92ce1aa41d fix dataset page bug, framework add transformers dependency (#927) 
* fix dataset page bug, framework add transformers dependency
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-07-26 19:03:39 +08:00
Xingjun.Wang
210ab40c54 Upgrade datasets (#921) 
* del _datasets_server import in hf_dataset_util

* fix streaming for youku-mplug and adopt latest datasets

* fix download config copy

* update ut

* add youku in test_general_datasets

* update UT for general dataset

* adapt to datasets version: 2.19.0 or later

* add assert for youku data UT

* fix disable_tqdm in some functions for 2.19.0 or later

* update get_module_with_script

* set trust_remote_code is True in load_dataset_with_ctx

* update print info

* update requirements for datasets version restriction

* fix _dataset_info

* add pillow

* update comments

* update comment

* reuse _download function in DataDownloadManager

* remove unused code

* update test_run_modelhub in Human3DAnimationTest

* set datasets>=2.18.0
 2024-07-23 22:26:12 +08:00
liuyhwangyh
4e2555c5a3 Release/1.16 merge to master (#922) 
* update version

* merge master

* fix fairseq issue

* fix pip compatible issue

* fix bug

* version to 1.16.1

* xformers<0.0.27

* fix matplotlib.cm compatible issue

* remove transformers from frameowrk

* vllm to 0.5.1

* not upgrade pip

* add Pillow to framework

* Update version.py

---------

Co-authored-by: xingjun.wang <xingjun.wxj@alibaba-inc.com>
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-07-22 20:58:32 +08:00
liuyhwangyh
f7a32e48e3 add dataset download (#906) 
* add dataset download

* fix cr issue

* fix cv matplotlib issue

* refactor code

* fix ut issue

* remove debug code

* remove unused import

* fix import issue

* sleep 65s before start docker avoid kill and run failed

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-07-12 19:06:44 +08:00
liuyhwangyh
ff77845772 add command line usage, optimize command line log, optimize packaging… (#888) 
* add command line usage, optimize command line log, optimize packaging version compatible

* Update command.md

* fix logging dup

* Refactor install dependencies (#889)

* refactor install dependencies, default only depencies of hub and datasets

* move pandas import to function

* update hub deps

* test

* remove generate ast file

* remove gast dependency

* replace gast with ast

* add dependency version

* remove lap for compile error

* fix comments issue

* add install ollama

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-06-30 20:15:03 +08:00
xingjun.wang
09779f1735 set datasets <2.19.0 2024-04-19 19:40:00 +08:00
xingjun.wang
7b8e10123b fix dataset hf utils 2024-04-18 23:13:26 +08:00
Xingjun.Wang
1a66f069c4 Dataset refactor (#807) 
* add main entry in ms_dataset

* update func get_data_patterns import

* modify return_config_only

* modify return_config_only to dataset_info_only

* udpate version for test

* del get_logger(__name__)

* fix py script loading

* fix loading py and without py

* add subset support

* add hf_datasets_util; refine list_repo_tree_ms; fix private datasets loading issue

* update version to rc5

* fix and support preview for dataset_info_only mode

* fix urlencode

* update to rc7

* loading of dataset_infos.json is deprecated; 2. add some ut

* update version

* add escapechar for read_csv and to_csv

* add params: Source=SDK

* add create_dataset func

* overwrite _get_paths_info

* update & version

* update list_repo_tree name

* add get_module_with_script, fix download imports

* fix py script loading issue in dataset_module_factory

* fix create dataset

* update log info in api
 2024-03-22 17:30:34 +08:00
liuyhwangyh
59760b123b Merge branch 'master' into master-merge-internal20240110 2024-01-14 10:43:11 +08:00
zhifu gao
49c04ea47e update funasr1.0 (#715) 
* funasr1.0  modelscope

* fix lint issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-01-12 12:02:01 +08:00
ly119399
0e772d35f3 upgrade diffusers version 2024-01-03 17:22:35 +08:00
neo.dzh
e7f86a751e add audio codec and codec-based TTS model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/15128959
 2023-12-26 20:54:59 +08:00
xingjun.wxj
2a991a5c6b update datasets version 
Update datasets version.
compatibility check： 2.14.5, 2.14.6, 2.15.0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14916111
 2023-12-06 16:25:20 +08:00
xingjun.wxj
a8e9e0a48f set datasets==2.14.6 2023-12-01 17:33:07 +08:00
mulin.lyh
51a1b76e91 fix python3.10 compatible issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14678226
* modify librosa version

* fix python3.10 compatible issue

* remove healpy in requirements for windowns compatible
 2023-11-29 17:41:44 +08:00
mulin.lyh
6c7fca8307 支持modelscope直接拉起推理服务 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14702876

* add inference server code

* add server requirement

* fix import issue

* debug

* add command line

* add llmpipeline support

* modify port to int

* add serer usage

* remove unused code

* fix lint issue

* add inference server code

* upgrade env to VLLM_USE_MODELSCOPE
 2023-11-29 17:37:56 +08:00
mulin.lyh
b8e86060f5 numpy version unrestrict 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13398805
* numpy version unrestrict
 2023-11-27 13:56:33 +08:00
xingjun.wxj
6833bdabfc set datasets==2.14.6 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14593950
 2023-11-17 10:46:58 +08:00
mulin.lyh
23f1f474bf Merge branch 'master-github' into master-merge-github925 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14164566
 2023-09-26 21:15:41 +08:00
mulin.lyh
59ec83cd2d remove cv diffusers version 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13843028
* remove cv diffusers version
 2023-08-30 15:04:43 +08:00
Xiaobin
8ce3b4de72 Feature/seq gpt (#507) 2023-08-29 17:47:59 +08:00
tastelikefeet
f2e9ea4199 Replace code with swift wheel (#467) 2023-08-29 17:27:18 +08:00
Wang Qiang
de33f4dc87 Support sdxl finetune by lora method (#468) 
* support sdxl finetune by lora

* remove useless imports

* support sdxl finetune

* upgrade diffusers to 0.19.0

* sdxl finetune

* fix bugs

* pre commit

* diffusers>=0.19.0
 2023-08-23 11:23:34 +08:00
wenmeng zhou
e3abfe0564 Update framework.txt (#453) 
remove version restrict for numpy and pandas
 2023-08-09 18:00:44 +08:00
suluyan.sly
f080603802 remove requirement realesrgan for basicsr 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13488773
* remove requirement realesrgan for basicsr
 2023-08-01 16:55:47 +08:00
suluyan.sly
dc17c7d6ee remove cv requirements: basicsr 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13471366
* rm req basicsr
 2023-07-31 18:20:23 +08:00
suluyan.sly
05e1357c32 Merge branch 'master-github' into master-merge-github-230728 2023-07-28 16:40:34 +08:00
frozoul
2566d028cd cv/cv nerf 3d reconstruction 4k nerf damo (#389) 
* add 4k-nerf core files

* update configure file

* update dataloader and model path

* update unittest

* Delete test_4k.py

* update unittest

* update unittest

* update pre-commit

* update dataloader

* update cuda code path

* check with pre-commit

---------

Co-authored-by: zhongshu.wzs <zhongshu.wzs@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
 2023-07-28 10:37:13 +08:00
suluyan.sly
1c6f5fe775 Merge branch 'master-github' into master-merge-github-230727 
Conflicts:
       examples/pytorch/baichuan/finetune_baichuan.py
       examples/pytorch/chatglm6b/finetune.py
 2023-07-27 17:29:27 +08:00