Commit Graph

1961 Commits

Author SHA1 Message Date
Xingjun.Wang
b53440f66a Merge pull request #373 from modelscope/dev/msdataset_cache_fix
fix load meta-csv cathe paths
2023-07-11 18:32:28 +08:00
xingjun.wang
de32a8f3e6 pre commit 2023-07-11 17:48:22 +08:00
Jintao
d20d033e07 add example/llm (#372)
* add example/llm

* fix lint test
2023-07-11 17:35:11 +08:00
fq
32db34631f make it more proper
ignore user-define dataset.
2023-07-11 17:33:00 +08:00
fq
d47684de5b Optimize comments 2023-07-11 17:12:59 +08:00
fq
ae3e794692 set download_mode default value 2023-07-11 17:11:11 +08:00
fq
d062b4e898 space align 2023-07-11 17:09:09 +08:00
fq
4d77e57769 add download_mode param to params
maybe set from funasr is better.
2023-07-11 16:43:37 +08:00
fq
e6db4239d2 add download_mode param for load function
when you want to re-download data
2023-07-11 16:38:54 +08:00
Wang Qiang
d8dd3989de Xformers accelerate memory efficient attention (#362)
* xformers accelerate memory efficient attention

* xformers

* precommit

---------

Co-authored-by: XDUWQ <yijing.wq@alibaba-inc.com>
2023-07-11 16:28:35 +08:00
xingjun.wang
0c43a0e8ea fix load meta-csv cathe paths 2023-07-11 16:25:11 +08:00
Wang Qiang
fd6e352922 Add pipeline num_inference_steps and guidance_scale parameter for stable diffusion pipeline (#367)
* add pipeline num_inference_steps and guidance_scale parameter

* precommit

---------

Co-authored-by: XDUWQ <yijing.wq@alibaba-inc.com>
2023-07-11 15:36:35 +08:00
fq
61faedfb15 Update finetune_speech_recognition.py add params.download_mode
set from params, config
2023-07-11 15:18:59 +08:00
fq
2073f4fd55 Update finetune_speech_recognition.py
MsDataset replace by ASRDataset.
2023-07-11 11:54:05 +08:00
fq
20c15d3aaa Update finetune_speech_recognition.py
using the newest ASRDataset, and add download_mode for re-download the dataset(dataset is broken and so on)
2023-07-11 11:33:18 +08:00
fq
56eb0ab0c2 Update asr_dataset.py
for download_mode when you need to re-download data
2023-07-11 11:28:35 +08:00
yeqinghao.yqh
41cbb8e393 mPLUG-Owl 生成长度Bug修复
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13209284
2023-07-10 18:56:12 +08:00
tongmu.wh
a7f7a67855 fix details of speaker models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13203011
* fix details of speaker models
2023-07-10 18:54:26 +08:00
LingFeng.Chen.Cn
db0f70bc1c text_in is required (#365) 2023-07-07 22:14:13 +08:00
chenyafeng.cyf
543d03e32b 3dspeaker
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13199180
2023-07-07 15:00:35 +08:00
tastelikefeet
2a79a6cee7 fix history problem (#358) 2023-07-05 00:02:20 +08:00
Wang Qiang
d49953b943 fix bugs of loading local sd dataset (#357) 2023-07-04 22:01:21 +08:00
tastelikefeet
645925cadd Fix/chatglm pipeline (#356) 2023-07-04 20:52:15 +08:00
mushenL
95907aed31 Modify the parameter passing of the text_generation_pipeline class (#355) 2023-07-04 18:42:09 +08:00
Firmament-cyou
423e2ce940 Add lora_inference for baichuan. (#352)
* add lora_inference.py for baichuan

* fix linttest

* fix linttest

---------

Co-authored-by: hemu <hemu.zp@alibaba-inc.com>
2023-07-04 18:39:36 +08:00
tastelikefeet
08c71f1f3d Fix/chatglm6b 2 (#354) 2023-07-04 01:58:57 +08:00
tastelikefeet
45cf0035f4 fix chatglm2 evaluation error: hypothesis emtpy (#348)
* fix evaluation error: hypothesis emtpy

* fix pipeline

* fix bug
2023-07-03 23:16:38 +08:00
Jintao
432f0ee20f add baichuan/chatglm2 +lora+agent examples (#350) 2023-07-03 16:19:00 +08:00
Wang Qiang
a50342ed5d Add stable diffusion tutorial ipynb (#346) 2023-07-03 13:52:35 +08:00
Xingjun.Wang
799a0bd792 Merge pull request #347 from modelscope/merge_from_internal_0701
Merge master from internal 0701
2023-07-02 10:46:34 +08:00
xingjun.wang
4f548ae866 del =0.0.4 file 2023-07-01 23:16:54 +08:00
xingjun.wang
4e8374e850 merge internal master 0701 2023-07-01 23:05:03 +08:00
xingjun.wang
4b0eb96083 ok Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into merge_from_internal_0701 2023-07-01 23:03:53 +08:00
hemu.zp
bb194f1d96 fix llama bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13133641
* fix bug
2023-06-30 20:49:30 +08:00
zsl01670416
2a2cc594eb Merge branch 'maas_flex_train_dev' modify finetune_text_classification for arguments collision between eval_strategy and by_e... 2023-06-30 19:04:14 +08:00
hemu.zp
30599dc34f fix llama lora bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13129620
2023-06-30 19:03:56 +08:00
mulin.lyh
3683a4386f [to #50607174]feat: support parallel download large model file
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13113235
* [to #50607174]feat: support parallel download large model file
2023-06-30 15:30:00 +08:00
wenmeng zhou
0e1971e94a Merge pull request #345 from modelscope/merge_master_internal0629
Merge master internal0629
2023-06-30 11:47:06 +08:00
wenmeng.zwm
21b31b2bdd revert data/test to newest 2023-06-29 22:13:19 +08:00
hemu.zp
f4c90f2adf Support lora for llama
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13080086

* support lora for llama

* update baichuan

* remove work_dir

* fixbug: 1. change ConfigDict to list when hooks key not in config 2. ignore all bin files when preparing output folder

* 1. support device_map 2. remove the operation of to float when using lora

* add inference file

* add comment

* support device_map
2023-06-29 22:05:34 +08:00
wenmeng.zwm
cc0e7527d7 [to #50527737] fix cpu inference for stable diffusion pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13120858
2023-06-29 20:35:57 +08:00
hemu.zp
1944416d3d Fix device_map for DiffusionForTextToImageSynthesis
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13115051
* add kwargs for device map
2023-06-29 16:49:20 +08:00
yuze.zyz
d4b9396084 Revert "support device_map"
This reverts commit 4d0367718d.
2023-06-29 16:08:42 +08:00
yuze.zyz
4d0367718d support device_map 2023-06-29 08:07:43 +00:00
hemu.zp
612f0ebbc4 fix eval RecursionError
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13099203
2023-06-29 10:47:54 +08:00
suluyan.sly
88de9f78aa [to #50538422]fix: support load from model id
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13092954
2023-06-29 10:26:52 +08:00
yuze.zyz
e951598a82 Merge branch merge_master_github_0628 into master
Title: Merge branch 'master-github' into merge_master_github_0628 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13104791
2023-06-29 09:47:52 +08:00
wenmeng.zwm
0271b9c256 Merge branch 'master-github' into merge_master_github_0628 2023-06-28 20:27:34 +08:00
Wang Qiang
d8381bf9fd Stable diffusion examples of lora and dreambooth. (#341)
* stable diffusion examples of lora and dreambooth

* pre-commit
2023-06-28 20:13:28 +08:00
Wang Qiang
a018cd6107 Dreambooth method for finetuning stable diffusions (#339)
* Copyright

* dreambooth

* dreambooth test trainer

* fix bugs

* pre-commit

---------

Co-authored-by: 翊靖 <yijing.wq@alibaba-inc.com>
2023-06-28 20:10:28 +08:00