Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-16 16:27:45 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,818 Commits 262 Branches 106 Tags
fix/daily_regression
Commit Graph

71 Commits

Author SHA1 Message Date
Yunnglin
d6e02eb2ce update test 2025-11-07 16:52:26 +08:00
Xingjun.Wang
7d11b77112 Fix trust_remote_code (#1462) 
1. Set `trust_remote_code` to `True` by default in datasets module
2. Set `trust_remote_code` to `True` by default in PolyLM pipeline
 2025-08-14 10:56:16 +08:00
Xingjun.Wang
055496c597 Fix CI 2025-08-07 19:26:32 +08:00
Jintao
32aefd7428 Merge release1.24 to master (#1298) 2025-04-07 13:32:09 +08:00
suluyana
299ece8b8a support ms-swift 3.0.0 (#1166) 2025-01-02 17:20:32 +08:00
suluyana
60780769b1 Fix/daily (#1155) 
* fix(llm ppl): 1. cache position; 2. stream_gready_search; 3. swift_mapping

* fix punkt

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2024-12-23 09:55:12 +08:00
suluyana
1fe211ffe5 fix pipeline builder when model is not supported (#1125) 
* fix pipeline builder when model is not supported

* fix ci & skip
---------

Co-authored-by: suluyan.sly@alibaba-inc.com <suluyan.sly@alibaba-inc.com>
 2024-12-12 19:24:38 +08:00
tastelikefeet
320095144b Refactor Dockerfile (#1036) 2024-10-21 18:26:23 +08:00
Xingjun.Wang
e320b40a0d Fix/dockerfile (#1034) 
* update version

* update build_image for swift

* add outlines in build_image.sh

* set outlines to 0.0.46 to avoid failure of building docker

* set vllm==0.5.2 in Dockerfile.ubuntu to fix CI issue

* update outlines version: <0.1

* update ms-swift installation in build_image.sh

* merge diff from release/1.19
 2024-10-21 11:25:02 +08:00
yuze.zyz
7271542d7f add more requirements 2024-09-01 19:02:16 +08:00
liuyhwangyh
f7a32e48e3 add dataset download (#906) 
* add dataset download

* fix cr issue

* fix cv matplotlib issue

* refactor code

* fix ut issue

* remove debug code

* remove unused import

* fix import issue

* sleep 65s before start docker avoid kill and run failed

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-07-12 19:06:44 +08:00
mulin.lyh
909e54fa33 modify build script 2024-06-05 19:08:46 +08:00
Zhicheng Zhang
bedec553c1 merge from release 1.13.3 (#837) 2024-04-22 13:55:31 +08:00
liuyhwangyh
f4e01d6228 fix build issue (#786) 
* fix build issue

* fix lint issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-03-04 10:43:48 +08:00
liuyhwangyh
5912cf3132 upgrade image build (#773) 
* upgrade image build

* add timm upgrade

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-02-23 16:24:54 +08:00
liuyhwangyh
672c32e7bd fix ci compatible issues，fix llmpipeline lazy import issue (#725) 
* fix ci issue

* fix case issue

* modify lint to python3.10

* fix case issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-01-17 22:19:05 +08:00
ly119399
26984de221 fix bug of branch release/1.11 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/15342815
* remove DOCKER_BUILDKIT=0 for cpu build issue

* force upgrade vllm

* add install sudo

* update transformers to 4.36.2

* fix mmcv-full issue

* add tiny_cuda_nn build

* install tinycudann

* reset
 2024-01-10 22:24:19 +08:00
mulin.lyh
385486daf2 upgrade cuda to 12.1.0 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/15183132
* upgrade cuda to 12.1.0

* remove tb-nightly, remove dup compile megatron util

* uninstall tb-nightly reinstall tensorboard
 2023-12-28 17:47:58 +08:00
mulin.lyh
fe8bfa9219 when build force install funasr pai-eacv etc 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14812168
* when build force install funasr pai-eacv etc
 2023-11-29 17:40:09 +08:00
mulin.lyh
5ba9fd2307 modify auto gptq and vllm env 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14790283
* upgrade to python3.10

* modify auto gptq and vllm env

* fix lint issue

* Merge remote-tracking branch 'origin/master' into python10_support

* python310 support

* build from repo

* add commit id force install modelscope every build

* add commit id force install modelscope every build

* fix cpu build issue

* fix datahub error message

* Merge branch 'python10_support' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into python10_support

* add --no-cache-dir install auto_gptq
 2023-11-27 20:21:00 +08:00
mulin.lyh
c039b7348d force upgrade funasr build image 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14411115
* force upgrade funasr build image
 2023-10-24 15:19:01 +08:00
mulin.lyh
6e424cdb69 force upgrade transformers when build image 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14293744
* force upgrade transformers when build image
 2023-10-13 19:54:48 +08:00
mulin.lyh
23f1f474bf Merge branch 'master-github' into master-merge-github925 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14164566
 2023-09-26 21:15:41 +08:00
mulin.lyh
de2d7cbc69 fix select case error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13889257
* fix select case error
 2023-09-04 11:16:28 +08:00
mulin.lyh
7c0f6aa5c5 Merge branch 'master-github' into master-merge-github0829 2023-08-29 21:20:54 +08:00
mulin.lyh
cba4e40bc1 fix numpy pandas compatible issue 
明确受影响的模型(damo)：  
ONE-PEACE-4B	ModuleNotFoundError: MyCustomPipeline: MyCustomModel: No module named 'one_peace'，缺少依赖。
cv_resnet50_face-reconstruction	 不兼容tf2  
nlp_automatic_post_editing_for_translation_en2de	tf2.0兼容性问题，tf1.x需要  
cv_resnet18_ocr-detection-word-level_damo	tf2.x兼容性问题  
cv_resnet18_ocr-detection-line-level_damo	tf兼容性问题  
cv_resnet101_detection_fewshot-defrcn	模型限制必须detection0.3+torch1.11.0"  
speech_dfsmn_ans_psm_48k_causal	"librosa， numpy兼容性问题  
cv_mdm_motion-generation	"依赖numpy版本兼容性问题：   File ""/opt/conda/lib/python3.8/site-packages/smplx/body_models.py"",  
cv_resnet50_ocr-detection-vlpt	numpy兼容性问题  
cv_clip-it_video-summarization_language-guided_en	tf兼容性问题

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13744636
* numpy and pandas no version

* modify compatible issue

* fix numpy compatible issue

* modify ci

* fix lint issue

* replace Image.ANTIALIAS to Image.Resampling.LANCZOS pillow compatible

* skip uncompatible cases

* fix numpy compatible issue, skip cases that can not compatbile numpy or tensorflow2.x

* skip compatible cases

* fix clip model issue

* fix body 3d keypoints compatible issue
 2023-08-22 23:04:31 +08:00
liuyhwangyh
75a14a36ba get github diff files (#446) 
* get github diff files

* add github environment

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2023-08-10 16:22:37 +08:00
wenmeng zhou
7b8bb091a5 Merge pull request #437 from modelscope/merge_gitlab_0803 
Merge gitlab 0803
 2023-08-03 12:25:11 +08:00
liuyhwangyh
0fff03d640 modify gpu/cpu binding (#436) 2023-08-03 11:27:37 +08:00
mulin.lyh
da2badaacd [to #51274424]fix: easycv extension and tinycudann conflict 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13471150
* fix easycv extension and tinycudann conflict
 2023-07-31 18:08:53 +08:00
mulin.lyh
a780935317 torch1.11 and torch2.0.1 build script refactor 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13408751

* [to #51122016]feat: build image support torch1.x 2.x cuda11.3.0 11.7.1

* remove base  version

* env cudatookit-version

* build script merge

* torch 1.11.0 fix
 2023-07-25 21:15:00 +08:00
mulin.lyh
247ae5f637 default aliyuncs pip 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13320919
* default aliyuncs pip

* pip to aliyun source
 2023-07-18 19:59:23 +08:00
mulin.lyh
bb9163f71a remove hard code tsinghua 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13314592
* remove hard code tsinghua
 2023-07-18 14:51:18 +08:00
mulin.lyh
fa7562fd96 [to #50384694]fix: ci hang when build torch extension 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12976382
 2023-06-19 17:56:04 +08:00
mulin.lyh
d6bf9e80fb [to #50129142]feat: support pre build torch extension build image, first extension megatron_util 2023-06-12 11:03:28 +08:00
mulin.lyh
25a7398aea docker file py38 and py37 compatible merge 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12722824
* debug

* add missing deps

* add stanza

* fix numpy issue

* numpy version

* tf case

* numpy <= 1.22.0

* fix tf 1.15.5 case

* add python38 and python37 compatible docker file

* cv add fvcore

* add easycv

* remove debug code

* fix style issue

* fix python3.7 python3.8 compatible issue

* comment

* modify run config

* scipy<=1.7.3

* revert scipy<=1.7.3

* fix compatible bug

* fix compatible bug

* add easycv

* update version: 1.6.1rc0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12754942
fix python3.8 and python3.8 compatible issue

* numpy version change

* numpy version

* numpy version

* fix numpy version

* fix numpy version

* update version: 1.6.1rc0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12754942
fix python3.8 and python3.8 compatible issue

* restore setup.py

* restore setup.py

* add build base image

* fix style

* numpy version fix

* optimize build image, split base and modelscope image

* fix style issue

* modify example path

* modify examples folder

* add SETUPTOOLS_USE_DISTUTILS=stdlib comments
 2023-06-08 10:01:58 +08:00
chenxujun
20b3a679e7 Fix some words (#141) 2023-03-02 11:06:56 +08:00
mulin.lyh
7378f94455 [to #47749867] modify audio install command 2023-02-10 12:04:08 +00:00
mulin.lyh
86128cd3a8 [to #47612577]feat: image supoort 3d models, python3.8 test version 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11542009


* mmcv-full<=1.7.0 for mmdet3d

* fix code style issue

* add speechbrain==0.5.7

* add compatible comments
 2023-02-07 02:28:20 +00:00
mulin.lyh
e54694690f [to #46993990]feat: run ci cases base on code diff to reduct ci test time 2023-02-06 08:00:19 +00:00
mulin.lyh
f663f420c4 [to #46480415]feat: ci command custom support regression case run all case in subprocess 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10936241
 2022-12-01 19:33:25 +08:00
pengzhendong
b0cf09d7b0 [ci] chang pypi url to tsinghua 2022-11-24 22:12:58 +08:00
wenmeng.zwm
584fa8f586 merge internal master 2022-11-18 14:21:05 +08:00
mulin.lyh
90a5efa1c2 [to #46106568]feat: parallel run ci case 2022-11-17 08:51:23 +08:00
wenmeng.zwm
9f2de967c5 merge master and fix conflict 2022-11-16 18:10:39 +08:00
mulin.lyh
c6e575458a [to #45878116]feat: run linter test first 
提高ci效率，先跑linter，linter错误先报漏出来，不用合并release
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10596907

    * [to #45878116]feat: run linter test first
 2022-11-11 16:19:14 +08:00
wenmeng.zwm
266851bbbb Merge branch 'master-gitlab' into master-github 2022-11-08 18:06:20 +08:00
mulin.lyh
87fcd28c4c add ci tag to cicases 2022-11-04 09:11:51 +08:00
wenmeng.zwm
c638acbeda fix merge conflict 2022-10-26 17:12:25 +08:00
mulin.lyh
384377b8f5 * [to #45486649]feat: modelscope model version use model repo tag, unsupport branch or commit it, client user-agent header unified 2022-10-26 13:55:51 +08:00