Commit Graph

2210 Commits

Author SHA1 Message Date
tastelikefeet
cb0a44eda5 Support VLLM in LLMPipeline (#604) 2023-10-27 18:20:53 +08:00
Firmament-cyou
a3ae55577f Support swift in llm_pipeline. (#595)
* support swift in llm_pipeline

* adjust function name
2023-10-24 14:31:24 +08:00
wenmeng zhou
0dcc4ed825 Merge pull request #591 from modelscope/master-merge-internal20231019
Master merge internal20231019
2023-10-23 15:55:08 +08:00
mulin.lyh
e93610f636 Merge branch 'master-gitlab' into master-merge-internal20231019 2023-10-19 19:12:00 +08:00
mulin.lyh
265213d48d Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into master-gitlab 2023-10-19 19:10:20 +08:00
mulin.lyh
cbf7fd5c79 Merge branch 'release/1.9' of github.com:modelscope/modelscope into master-gitlab 2023-10-19 19:07:44 +08:00
mulin.lyh
b14f3464e5 force rebuild image v1.9.3 2023-10-19 12:30:10 +08:00
mulin.lyh
8e187bdb96 remove llama2 dup in chat task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14359280
* remove llama2 dup in chat task
2023-10-19 12:29:13 +08:00
mulin.lyh
0390bdea67 remove llama2 dup in chat task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14359280
* remove llama2 dup in chat task
2023-10-19 12:12:35 +08:00
mulin.lyh
f493ed007c force rebuid image 2023-10-18 21:17:51 +08:00
wenmeng.zwm
e10237074e fix chatglm sp_tokenizer error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14352495
2023-10-18 21:16:20 +08:00
wenmeng.zwm
2c3bf9629d fix chatglm sp_tokenizer error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14352495
2023-10-18 20:24:42 +08:00
suluyan.sly
6201d1bfbc [swingdeploy] oss examples
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14342415
* oss_examples
2023-10-18 17:24:26 +08:00
suluyan.sly
f568454bbe [swingdeploy] oss examples
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14342415
* oss_examples
2023-10-18 16:29:13 +08:00
Jintao
0908e20da2 fix merge error (#582) 2023-10-17 22:17:13 +08:00
mulin.lyh
66430171ae fix chatglm2 can't find tokenizer issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14335080
* fix chatglm2 can't find tokenizer issue
2023-10-17 22:17:13 +08:00
mulin.lyh
f5b83ebd83 fix chatglm2 can't find tokenizer issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14335080
* fix chatglm2 can't find tokenizer issue
2023-10-17 22:15:54 +08:00
wenmeng.zwm
84352ec9e8 Merge branch merge_github_fix_merge_error into master
Title: fix merge error (#582) 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14333635
2023-10-17 21:16:53 +08:00
Jintao
c01141f97e fix merge error (#582) 2023-10-17 17:32:25 +08:00
mulin.lyh
19e7c1c807 fix ofa new transformers compatible issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14317517
* fix ofa new transformers compatible issue

* fix timm.layers to timm.models.layers compatible issue
2023-10-16 22:13:38 +08:00
mulin.lyh
c67b2cfc34 fix ofa new transformers compatible issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14317517
* fix ofa new transformers compatible issue

* fix timm.layers to timm.models.layers compatible issue
2023-10-16 22:12:31 +08:00
mulin.lyh
087cb4e463 upgrade flash attention to 2.32.2 2023-10-16 16:13:28 +08:00
mulin.lyh
e75f5b4bc4 version to 1.9.3 2023-10-13 22:42:08 +08:00
mulin.lyh
2d0d0689bf Merge branch 'master' into release/1.9 2023-10-13 22:39:59 +08:00
mulin.lyh
049bde9ddf move venv import from file level to class level to avoid import error… (#575)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14301042
* move venv import from file level to class level to avoid import error… (#575)

* move venv import from file level to class level to avoid import error on windows


---------

authored-by: Zhicheng Zhang <zhangzhicheng.zzc@alibaba-inc.com>
2023-10-13 22:27:51 +08:00
mulin.lyh
6e424cdb69 force upgrade transformers when build image
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14293744
* force upgrade transformers when build image
2023-10-13 19:54:48 +08:00
mulin.lyh
4ac59e29b0 refactor ci to analyze file dependency
import分析不需要实际import文件,通过静态扫描,得到文件中定义的符号,在分析import时找到import的符号所在的文件,从而建立起关联。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14281794
* refactor ci

* fix typo

* fix bug

* test

* add indirect import name resolve

* remove test code
2023-10-13 14:11:30 +08:00
hemu.zp
4cad376298 Add llm_first parameter for pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14264249

* support llm_first parameter

* register_module(Tasks.text_generation)

* fix bug

* update format & fix out_base64 for int4

* pre-commit
2023-10-13 14:04:04 +08:00
Jintao
35f31b011f fix merge error (#582) 2023-10-12 10:27:31 +08:00
liuyhwangyh
b1c9c7d2fe Merge pull request #574 from modelscope/master-merge-internal20231007
Master merge internal20231007
2023-10-11 10:31:10 +08:00
liuyhwangyh
7e12fe96f9 Merge branch 'master' into master-merge-internal20231007 2023-10-11 10:23:52 +08:00
mulin.lyh
4d099aa603 release date to 2099 2023-10-11 10:07:50 +08:00
baiguan.yt
582c3a5415 add pasd_v2 保真度更好
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14202282
2023-10-11 09:59:19 +08:00
tastelikefeet
362872d6bb fix onnx backend (#580) 2023-10-10 10:43:30 +08:00
Jintao
57e2647a4a remove configuration.json dependency (#579) 2023-10-10 10:43:16 +08:00
mulin.lyh
fc388bea97 Merge branch 'master-gitlab' into master-merge-internal20231007 2023-10-10 10:16:47 +08:00
mulin.lyh
507ef4e62b Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into master-gitlab 2023-10-10 10:16:21 +08:00
mulin.lyh
2b9248de08 modify hub use https 2023-10-10 10:16:08 +08:00
mulin.lyh
37cfb58cc6 Merge branch 'master-gitlab' into master-merge-internal20231007 2023-10-09 17:03:13 +08:00
mulin.lyh
02d1033393 Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into master-gitlab 2023-10-09 17:02:13 +08:00
hemu.zp
d64cfa48bc Support int4 model for llm_pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14214673

* use ms qwen update

* support baichuan2 int4

* update qwen vl unittest and fix bug

* init from AutoModelForCausalLM

* add todo for AutoModelForCausalLM
2023-10-09 16:16:33 +08:00
mulin.lyh
610cf981b1 fix test_export_speech_signal_process.py issue 2023-10-08 15:21:26 +08:00
mulin.lyh
e60d56a564 fix test_export_speech_signal_process.py issue 2023-10-08 15:18:31 +08:00
Zhicheng Zhang
43046a719b move venv import from file level to class level to avoid import error… (#575)
* move venv import from file level to class level to avoid import error on windows

* pass lint check

---------

Co-authored-by: Zhicheng Zhang <zhangzhicheng.zzc@alibaba-inc.com>
2023-10-08 13:36:34 +08:00
mulin.lyh
323dc0faa6 Merge branch 'master-gitlab' into master-merge-internal20231007 2023-10-07 21:32:44 +08:00
mulin.lyh
d0384a5849 Merge branch 'release/1.9' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into master-gitlab 2023-10-07 10:16:06 +08:00
tastelikefeet
d88898e477 fix work_dir not set in trainer(#573)
* fix work_dir

* fix running
2023-10-01 23:09:09 +08:00
mulin.lyh
74532181d0 add jupyterlab install to docker v1.9.2 2023-09-28 17:30:38 +08:00
mulin.lyh
c12b22ae3d fix onnxruntime providers parameter compatible issue 2023-09-28 17:20:21 +08:00
mulin.lyh
7f4fef0c3a fix provider bug 2023-09-28 17:20:21 +08:00