Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 12:39:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,535 Commits 263 Branches 106 Tags
7769531e9ec264d6dad9573fffe44fd3d8e41f08
Commit Graph

67 Commits

Author SHA1 Message Date
tastelikefeet
46c4ce9bdd support tag ci_image (#1112) 2024-12-01 15:17:25 +08:00
Jintao
b1e1f66fad Merge release 1.20 docker (#1109) 2024-11-29 13:44:36 +08:00
Jintao
e961f1671d Update docker from release/1.20 (#1077) 2024-11-11 14:56:36 +08:00
Jintao
61c2fd97e4 Update llm docker (#1076) 2024-11-08 18:09:05 +08:00
Jintao
a393b6ef24 update docker (#1075) 2024-11-08 15:49:50 +08:00
Jintao
d02d887918 update docker (#1073) 2024-11-08 10:56:39 +08:00
Jintao
125f44fb20 update docker evalscope version (#1071) 2024-11-07 18:56:17 +08:00
Jintao
a51f25abdf fix docker numpy version (#1069) 2024-11-07 13:58:08 +08:00
tastelikefeet
33308cedd4 fix numpy build error (#1068) 2024-11-06 20:40:58 +08:00
tastelikefeet
6856b157ed try to reduce the image size of llm (#1067) 2024-11-06 15:52:08 +08:00
Jintao
9cf74e01c0 Fix the missing __init__.py file (#1066) 2024-11-06 13:22:06 +08:00
tastelikefeet
43536064d5 default install tf-keras (#1064) 2024-11-04 20:15:18 +08:00
tastelikefeet
328bbc0494 Fix some bugs (#1056) 
* fix some bugs

* remove install tf-kersa

* fix

* use bin bash as default
 2024-10-30 15:49:38 +08:00
tastelikefeet
3762ba3318 fix tests (#1053) 2024-10-28 19:50:33 +08:00
tastelikefeet
62ffc04215 Fix the slow downloading (#1051) 
* fix slow download

* fix

* fix audio installation

* fix build

* fix

* test

* test

* test

* test

* fix

* fix

* fix

* fix
 2024-10-25 13:37:01 +08:00
tastelikefeet
ae98067485 Fix timestamp in docker build (#1049) 
* update flow name

* fix

* fix

* update docker builder

* lint

* fix build

* fix cpu build

* fix ts
 2024-10-24 14:04:10 +08:00
tastelikefeet
acc60bab1c Fix pypi mirror (#1048) 
* update flow name

* fix

* fix

* update docker builder

* lint

* fix build

* fix cpu build
 2024-10-24 10:35:10 +08:00
tastelikefeet
a6d583b6cf Fix build error (#1047) 2024-10-23 18:44:11 +08:00
tastelikefeet
cda7a6f04a Update docker scripts (#1044) 2024-10-23 15:18:40 +08:00
tastelikefeet
7a57ee418c Refine dockerfile (#1042) 2024-10-23 09:59:51 +08:00
tastelikefeet
eac004d7f2 Refine docker file (#1041) 2024-10-22 11:13:17 +08:00
tastelikefeet
320095144b Refactor Dockerfile (#1036) 2024-10-21 18:26:23 +08:00
Xingjun.Wang
e320b40a0d Fix/dockerfile (#1034) 
* update version

* update build_image for swift

* add outlines in build_image.sh

* set outlines to 0.0.46 to avoid failure of building docker

* set vllm==0.5.2 in Dockerfile.ubuntu to fix CI issue

* update outlines version: <0.1

* update ms-swift installation in build_image.sh

* merge diff from release/1.19
 2024-10-21 11:25:02 +08:00
liuyhwangyh
4e2555c5a3 Release/1.16 merge to master (#922) 
* update version

* merge master

* fix fairseq issue

* fix pip compatible issue

* fix bug

* version to 1.16.1

* xformers<0.0.27

* fix matplotlib.cm compatible issue

* remove transformers from frameowrk

* vllm to 0.5.1

* not upgrade pip

* add Pillow to framework

* Update version.py

---------

Co-authored-by: xingjun.wang <xingjun.wxj@alibaba-inc.com>
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-07-22 20:58:32 +08:00
liuyhwangyh
f7a32e48e3 add dataset download (#906) 
* add dataset download

* fix cr issue

* fix cv matplotlib issue

* refactor code

* fix ut issue

* remove debug code

* remove unused import

* fix import issue

* sleep 65s before start docker avoid kill and run failed

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-07-12 19:06:44 +08:00
liuyhwangyh
ff77845772 add command line usage, optimize command line log, optimize packaging… (#888) 
* add command line usage, optimize command line log, optimize packaging version compatible

* Update command.md

* fix logging dup

* Refactor install dependencies (#889)

* refactor install dependencies, default only depencies of hub and datasets

* move pandas import to function

* update hub deps

* test

* remove generate ast file

* remove gast dependency

* replace gast with ast

* add dependency version

* remove lap for compile error

* fix comments issue

* add install ollama

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-06-30 20:15:03 +08:00
mulin.lyh
909e54fa33 modify build script 2024-06-05 19:08:46 +08:00
liuyhwangyh
5912cf3132 upgrade image build (#773) 
* upgrade image build

* add timm upgrade

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-02-23 16:24:54 +08:00
liuyhwangyh
672c32e7bd fix ci compatible issues，fix llmpipeline lazy import issue (#725) 
* fix ci issue

* fix case issue

* modify lint to python3.10

* fix case issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-01-17 22:19:05 +08:00
ly119399
26984de221 fix bug of branch release/1.11 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/15342815
* remove DOCKER_BUILDKIT=0 for cpu build issue

* force upgrade vllm

* add install sudo

* update transformers to 4.36.2

* fix mmcv-full issue

* add tiny_cuda_nn build

* install tinycudann

* reset
 2024-01-10 22:24:19 +08:00
mulin.lyh
228ef8afa3 add instal fastapi for server support 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/15248194
* add instal fastapi for server support
 2024-01-04 14:36:07 +08:00
mulin.lyh
385486daf2 upgrade cuda to 12.1.0 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/15183132
* upgrade cuda to 12.1.0

* remove tb-nightly, remove dup compile megatron util

* uninstall tb-nightly reinstall tensorboard
 2023-12-28 17:47:58 +08:00
mulin.lyh
fe8bfa9219 when build force install funasr pai-eacv etc 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14812168
* when build force install funasr pai-eacv etc
 2023-11-29 17:40:09 +08:00
mulin.lyh
5ba9fd2307 modify auto gptq and vllm env 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14790283
* upgrade to python3.10

* modify auto gptq and vllm env

* fix lint issue

* Merge remote-tracking branch 'origin/master' into python10_support

* python310 support

* build from repo

* add commit id force install modelscope every build

* add commit id force install modelscope every build

* fix cpu build issue

* fix datahub error message

* Merge branch 'python10_support' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into python10_support

* add --no-cache-dir install auto_gptq
 2023-11-27 20:21:00 +08:00
mulin.lyh
087cb4e463 upgrade flash attention to 2.32.2 2023-10-16 16:13:28 +08:00
mulin.lyh
74532181d0 add jupyterlab install to docker 2023-09-28 17:30:38 +08:00
mulin.lyh
e7ecb55e00 remove onnxruntime version 2023-09-28 14:30:55 +08:00
mulin.lyh
f6d4107b0a fix onnxruntime issue 2023-09-28 10:49:51 +08:00
mulin.lyh
31d04f45b7 force reinstall 1.9.2 2023-09-28 01:06:32 +08:00
mulin.lyh
0075684692 add use gpu arg 2023-09-27 13:51:11 +08:00
mulin.lyh
6944d41734 skip install detection2 in cpu 2023-09-27 11:47:23 +08:00
mulin.lyh
dd9fa8b69c add install swift from oss 2023-09-26 16:40:26 +08:00
mulin.lyh
b02f941a02 modify version number 2023-09-15 15:10:29 +08:00
mulin.lyh
f05707ff33 fix transformers compatible issue of position_ids 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13974608
* fix transformers compatible issue of position_ids
 2023-09-11 13:37:10 +08:00
mulin.lyh
c11bbb03fb fix docker file bug 2023-09-01 18:05:11 +08:00
mulin.lyh
ad1081b08e fix pipeline and image build issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13884178
* fix pipeline and image build issue
 2023-09-01 18:02:50 +08:00
mulin.lyh
cba4e40bc1 fix numpy pandas compatible issue 
明确受影响的模型(damo)：  
ONE-PEACE-4B	ModuleNotFoundError: MyCustomPipeline: MyCustomModel: No module named 'one_peace'，缺少依赖。
cv_resnet50_face-reconstruction	 不兼容tf2  
nlp_automatic_post_editing_for_translation_en2de	tf2.0兼容性问题，tf1.x需要  
cv_resnet18_ocr-detection-word-level_damo	tf2.x兼容性问题  
cv_resnet18_ocr-detection-line-level_damo	tf兼容性问题  
cv_resnet101_detection_fewshot-defrcn	模型限制必须detection0.3+torch1.11.0"  
speech_dfsmn_ans_psm_48k_causal	"librosa， numpy兼容性问题  
cv_mdm_motion-generation	"依赖numpy版本兼容性问题：   File ""/opt/conda/lib/python3.8/site-packages/smplx/body_models.py"",  
cv_resnet50_ocr-detection-vlpt	numpy兼容性问题  
cv_clip-it_video-summarization_language-guided_en	tf兼容性问题

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13744636
* numpy and pandas no version

* modify compatible issue

* fix numpy compatible issue

* modify ci

* fix lint issue

* replace Image.ANTIALIAS to Image.Resampling.LANCZOS pillow compatible

* skip uncompatible cases

* fix numpy compatible issue, skip cases that can not compatbile numpy or tensorflow2.x

* skip compatible cases

* fix clip model issue

* fix body 3d keypoints compatible issue
 2023-08-22 23:04:31 +08:00
mulin.lyh
c1df82acd8 init pip to aliyuncs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13487845

* init pip to aliyuncs
 2023-08-01 16:55:33 +08:00
mulin.lyh
da2badaacd [to #51274424]fix: easycv extension and tinycudann conflict 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13471150
* fix easycv extension and tinycudann conflict
 2023-07-31 18:08:53 +08:00
mulin.lyh
a780935317 torch1.11 and torch2.0.1 build script refactor 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13408751

* [to #51122016]feat: build image support torch1.x 2.x cuda11.3.0 11.7.1

* remove base  version

* env cudatookit-version

* build script merge

* torch 1.11.0 fix
 2023-07-25 21:15:00 +08:00