Commit Graph

1825 Commits

Author SHA1 Message Date
xingjun.wang
5a49093422 fix yapf 2023-07-21 23:37:17 +08:00
xingjun.wang
96a5282021 check format 2023-07-21 23:09:24 +08:00
LingFeng.Chen.Cn
9c4d9cdb68 fix file not found cause TypeError (#385)
* fix file not found cause TypeError

* fix linter test

* fix linter test

* format code

---------

Co-authored-by: Krasus <chen@krasus.red>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2023-07-21 15:34:19 +08:00
LingFeng.Chen.Cn
19ea082fec Update speaker_verification_pipeline.py (#364)
* Update speaker_verification_pipeline.py

* fix log too long when input tuple(bytes,bytes)

* Update speaker_verification_pipeline.py

* fix when bytes print too much

* Update speaker_verification_pipeline forward log

* pre-commit linter format


---------

Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2023-07-20 09:28:55 +08:00
tastelikefeet
78b3e74fd8 pre-commit passed (#395) 2023-07-19 20:59:58 +08:00
Jintao
2f7c669f33 support llama2 (#393)
* Unify sft and infer code into a single file

* update llama2 sft infer
2023-07-19 17:34:27 +08:00
tastelikefeet
3283a46c52 Add Llama2 from hf (#394)
* update llama code

* add llama2

* revert llama code

* add llama2 registry

* fix bug
2023-07-19 17:22:03 +08:00
tastelikefeet
12bc1603a9 Fix amp + device_map (#386)
1. Fix the amp + device_map bug in chatglm2 finetune code 
2. Optional to save optimizer state 
3. Fix the logger double print problem
2023-07-16 08:45:20 +08:00
Wang Qiang
21d64f4518 Merge pull request #387 from XDUWQ/chinese_bug
Fix bugs of chinese stable diffusion pipeline getting an unexpected keyword argument 'lora_scale'
2023-07-16 00:05:47 +08:00
XDUWQ
fc85b57a3e fix bugs of chinese stable diffusion pipeline lora_scale 2023-07-15 23:16:16 +08:00
Jintao
c6189d68a0 Fix/chatglm2 (#384) 2023-07-15 09:59:53 +08:00
Wang Qiang
442bdc74a4 Use more compatible DiffusionPipeline (#383) 2023-07-14 19:04:29 +08:00
Wang Qiang
0b85979f2e Update diffusers version to 0.18.0 (#377)
* update diffusers to 0.18.0

* fix bugs
2023-07-14 19:02:52 +08:00
Xingjun.Wang
0f36b081ef Merge pull request #371 from foocker/master
ASRDataset for download_mode parameters
2023-07-12 14:47:32 +08:00
tastelikefeet
544f6c0410 Fea/chatglm6b v2 new version (#368)
* upgrade code

* add chatglm2 ptuning

* pre-commit passed
2023-07-12 14:44:09 +08:00
gg
49c6d8bcf6 pre-commit 2023-07-12 09:43:24 +08:00
gg
574b4568ff flake8 2023-07-11 18:36:54 +08:00
Xingjun.Wang
b53440f66a Merge pull request #373 from modelscope/dev/msdataset_cache_fix
fix load meta-csv cathe paths
2023-07-11 18:32:28 +08:00
xingjun.wang
de32a8f3e6 pre commit 2023-07-11 17:48:22 +08:00
Jintao
d20d033e07 add example/llm (#372)
* add example/llm

* fix lint test
2023-07-11 17:35:11 +08:00
fq
32db34631f make it more proper
ignore user-define dataset.
2023-07-11 17:33:00 +08:00
fq
d47684de5b Optimize comments 2023-07-11 17:12:59 +08:00
fq
ae3e794692 set download_mode default value 2023-07-11 17:11:11 +08:00
fq
d062b4e898 space align 2023-07-11 17:09:09 +08:00
fq
4d77e57769 add download_mode param to params
maybe set from funasr is better.
2023-07-11 16:43:37 +08:00
fq
e6db4239d2 add download_mode param for load function
when you want to re-download data
2023-07-11 16:38:54 +08:00
Wang Qiang
d8dd3989de Xformers accelerate memory efficient attention (#362)
* xformers accelerate memory efficient attention

* xformers

* precommit

---------

Co-authored-by: XDUWQ <yijing.wq@alibaba-inc.com>
2023-07-11 16:28:35 +08:00
xingjun.wang
0c43a0e8ea fix load meta-csv cathe paths 2023-07-11 16:25:11 +08:00
Wang Qiang
fd6e352922 Add pipeline num_inference_steps and guidance_scale parameter for stable diffusion pipeline (#367)
* add pipeline num_inference_steps and guidance_scale parameter

* precommit

---------

Co-authored-by: XDUWQ <yijing.wq@alibaba-inc.com>
2023-07-11 15:36:35 +08:00
fq
61faedfb15 Update finetune_speech_recognition.py add params.download_mode
set from params, config
2023-07-11 15:18:59 +08:00
fq
2073f4fd55 Update finetune_speech_recognition.py
MsDataset replace by ASRDataset.
2023-07-11 11:54:05 +08:00
fq
20c15d3aaa Update finetune_speech_recognition.py
using the newest ASRDataset, and add download_mode for re-download the dataset(dataset is broken and so on)
2023-07-11 11:33:18 +08:00
fq
56eb0ab0c2 Update asr_dataset.py
for download_mode when you need to re-download data
2023-07-11 11:28:35 +08:00
LingFeng.Chen.Cn
db0f70bc1c text_in is required (#365) 2023-07-07 22:14:13 +08:00
tastelikefeet
2a79a6cee7 fix history problem (#358) 2023-07-05 00:02:20 +08:00
Wang Qiang
d49953b943 fix bugs of loading local sd dataset (#357) 2023-07-04 22:01:21 +08:00
tastelikefeet
645925cadd Fix/chatglm pipeline (#356) 2023-07-04 20:52:15 +08:00
mushenL
95907aed31 Modify the parameter passing of the text_generation_pipeline class (#355) 2023-07-04 18:42:09 +08:00
Firmament-cyou
423e2ce940 Add lora_inference for baichuan. (#352)
* add lora_inference.py for baichuan

* fix linttest

* fix linttest

---------

Co-authored-by: hemu <hemu.zp@alibaba-inc.com>
2023-07-04 18:39:36 +08:00
tastelikefeet
08c71f1f3d Fix/chatglm6b 2 (#354) 2023-07-04 01:58:57 +08:00
tastelikefeet
45cf0035f4 fix chatglm2 evaluation error: hypothesis emtpy (#348)
* fix evaluation error: hypothesis emtpy

* fix pipeline

* fix bug
2023-07-03 23:16:38 +08:00
Jintao
432f0ee20f add baichuan/chatglm2 +lora+agent examples (#350) 2023-07-03 16:19:00 +08:00
Wang Qiang
a50342ed5d Add stable diffusion tutorial ipynb (#346) 2023-07-03 13:52:35 +08:00
Xingjun.Wang
799a0bd792 Merge pull request #347 from modelscope/merge_from_internal_0701
Merge master from internal 0701
2023-07-02 10:46:34 +08:00
xingjun.wang
4f548ae866 del =0.0.4 file 2023-07-01 23:16:54 +08:00
xingjun.wang
4e8374e850 merge internal master 0701 2023-07-01 23:05:03 +08:00
xingjun.wang
4b0eb96083 ok Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into merge_from_internal_0701 2023-07-01 23:03:53 +08:00
hemu.zp
bb194f1d96 fix llama bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13133641
* fix bug
2023-06-30 20:49:30 +08:00
zsl01670416
2a2cc594eb Merge branch 'maas_flex_train_dev' modify finetune_text_classification for arguments collision between eval_strategy and by_e... 2023-06-30 19:04:14 +08:00
hemu.zp
30599dc34f fix llama lora bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13129620
2023-06-30 19:03:56 +08:00