Commit Graph

28 Commits

Author SHA1 Message Date
xingjun.wang
5fea9e77c1 merge release/1.19 for llm docker 2024-10-10 00:06:15 +08:00
xingjun.wang
09aa93dd37 update outlines version: <0.1 2024-10-09 22:03:47 +08:00
xingjun.wang
c5a33b9b12 set outlines to 0.0.46 to avoid failure of building docker 2024-10-09 19:37:07 +08:00
xingjun.wang
50c35f0927 add outlines in build_image.sh 2024-10-09 17:36:30 +08:00
xingjun.wang
6673b438fa add llm-docker dependencies in build_image.sh 2024-10-08 15:52:49 +08:00
xingjun.wang
13a7b05cbb update build_image for swift 2024-10-08 15:05:27 +08:00
yuze.zyz
12d45846e7 update dockerfile to fit pytorch 2.4.0 and vllm/lmdeploy 0.6.0 2024-09-21 22:00:44 +08:00
yuze.zyz
7271542d7f add more requirements 2024-09-01 19:02:16 +08:00
mulin.lyh
909e54fa33 modify build script 2024-06-05 19:08:46 +08:00
Zhicheng Zhang
bedec553c1 merge from release 1.13.3 (#837) 2024-04-22 13:55:31 +08:00
liuyhwangyh
f4e01d6228 fix build issue (#786)
* fix build issue

* fix lint issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-03-04 10:43:48 +08:00
liuyhwangyh
5912cf3132 upgrade image build (#773)
* upgrade image build

* add timm upgrade

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-02-23 16:24:54 +08:00
liuyhwangyh
672c32e7bd fix ci compatible issues,fix llmpipeline lazy import issue (#725)
* fix ci issue

* fix case issue

* modify lint to python3.10

* fix case issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-01-17 22:19:05 +08:00
ly119399
26984de221 fix bug of branch release/1.11
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/15342815
* remove DOCKER_BUILDKIT=0 for cpu build issue

* force upgrade vllm

* add install sudo

* update transformers to 4.36.2

* fix mmcv-full issue

* add tiny_cuda_nn build

* install tinycudann

* reset
2024-01-10 22:24:19 +08:00
mulin.lyh
385486daf2 upgrade cuda to 12.1.0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/15183132
* upgrade cuda to 12.1.0

* remove tb-nightly, remove dup compile megatron util

* uninstall tb-nightly reinstall tensorboard
2023-12-28 17:47:58 +08:00
mulin.lyh
fe8bfa9219 when build force install funasr pai-eacv etc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14812168
* when build force install funasr pai-eacv etc
2023-11-29 17:40:09 +08:00
mulin.lyh
5ba9fd2307 modify auto gptq and vllm env
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14790283
* upgrade to python3.10

* modify auto gptq and vllm env

* fix lint issue

* Merge remote-tracking branch 'origin/master' into python10_support

* python310 support

* build from repo

* add commit id force install modelscope every build

* add commit id force install modelscope every build

* fix cpu build issue

* fix datahub error message

* Merge branch 'python10_support' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into python10_support

* add --no-cache-dir install auto_gptq
2023-11-27 20:21:00 +08:00
mulin.lyh
c039b7348d force upgrade funasr build image
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14411115
* force upgrade funasr build image
2023-10-24 15:19:01 +08:00
mulin.lyh
6e424cdb69 force upgrade transformers when build image
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14293744
* force upgrade transformers when build image
2023-10-13 19:54:48 +08:00
mulin.lyh
23f1f474bf Merge branch 'master-github' into master-merge-github925
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14164566
2023-09-26 21:15:41 +08:00
mulin.lyh
cba4e40bc1 fix numpy pandas compatible issue
明确受影响的模型(damo):  
ONE-PEACE-4B	ModuleNotFoundError: MyCustomPipeline: MyCustomModel: No module named 'one_peace',缺少依赖。
cv_resnet50_face-reconstruction	 不兼容tf2  
nlp_automatic_post_editing_for_translation_en2de	tf2.0兼容性问题,tf1.x需要  
cv_resnet18_ocr-detection-word-level_damo	tf2.x兼容性问题  
cv_resnet18_ocr-detection-line-level_damo	tf兼容性问题  
cv_resnet101_detection_fewshot-defrcn	模型限制必须detection0.3+torch1.11.0"  
speech_dfsmn_ans_psm_48k_causal	"librosa, numpy兼容性问题  
cv_mdm_motion-generation	"依赖numpy版本兼容性问题:   File ""/opt/conda/lib/python3.8/site-packages/smplx/body_models.py"",  
cv_resnet50_ocr-detection-vlpt	numpy兼容性问题  
cv_clip-it_video-summarization_language-guided_en	tf兼容性问题

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13744636
* numpy and pandas no version

* modify compatible issue

* fix numpy compatible issue

* modify ci

* fix lint issue

* replace Image.ANTIALIAS to Image.Resampling.LANCZOS pillow compatible

* skip uncompatible cases

* fix numpy compatible issue, skip cases that can not compatbile numpy or tensorflow2.x

* skip compatible cases

* fix clip model issue

* fix body 3d keypoints compatible issue
2023-08-22 23:04:31 +08:00
mulin.lyh
da2badaacd [to #51274424]fix: easycv extension and tinycudann conflict
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13471150
* fix easycv extension and tinycudann conflict
2023-07-31 18:08:53 +08:00
mulin.lyh
a780935317 torch1.11 and torch2.0.1 build script refactor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13408751

* [to #51122016]feat: build image support torch1.x 2.x cuda11.3.0 11.7.1

* remove base  version

* env cudatookit-version

* build script merge

* torch 1.11.0 fix
2023-07-25 21:15:00 +08:00
mulin.lyh
d6bf9e80fb [to #50129142]feat: support pre build torch extension build image, first extension megatron_util 2023-06-12 11:03:28 +08:00
mulin.lyh
25a7398aea docker file py38 and py37 compatible merge
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12722824
* debug

* add missing deps

* add stanza

* fix numpy issue

* numpy version

* tf case

* numpy <= 1.22.0

* fix tf 1.15.5 case

* add python38 and python37 compatible docker file

* cv add fvcore

* add easycv

* remove debug code

* fix style issue

* fix python3.7 python3.8 compatible issue

* comment

* modify run config

* scipy<=1.7.3

* revert scipy<=1.7.3

* fix compatible bug

* fix compatible bug

* add easycv

* update version: 1.6.1rc0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12754942
fix python3.8 and python3.8 compatible issue

* numpy version change

* numpy version

* numpy version

* fix numpy version

* fix numpy version

* update version: 1.6.1rc0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12754942
fix python3.8 and python3.8 compatible issue

* restore setup.py

* restore setup.py

* add build base image

* fix style

* numpy version fix

* optimize build image, split base and modelscope image

* fix style issue

* modify example path

* modify examples folder

* add SETUPTOOLS_USE_DISTUTILS=stdlib comments
2023-06-08 10:01:58 +08:00
chenxujun
20b3a679e7 Fix some words (#141) 2023-03-02 11:06:56 +08:00
mulin.lyh
86128cd3a8 [to #47612577]feat: image supoort 3d models, python3.8 test version
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11542009


* mmcv-full<=1.7.0 for mmdet3d

* fix code style issue

* add speechbrain==0.5.7

* add compatible comments
2023-02-07 02:28:20 +00:00
mulin.lyh
01bb751425 [to #43653669]feat: auto build docker images
auto build docker images
aone 任务: https://test.aone.alibaba-inc.com/jobs/1824567?buildId=143470479
修改任务分支
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9566518

    * [to #43653669]feat: auto build docker images
2022-08-22 16:01:42 +08:00