Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 12:39:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,802 Commits 263 Branches 106 Tags
04b940f600aa454a254ca1de2e2cf882cb0d1442
Commit Graph

1802 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wang Qiang
04b940f600 Merge branch 'modelscope:master' into custom_diffusion 2023-07-12 10:08:11 +08:00
XDUWQ
0ab981a021 custom diffusion 2023-07-12 10:04:20 +08:00
XDUWQ
ba2b5e0a57 custom diffusion 2023-07-12 09:51:46 +08:00
XDUWQ
1caa45422c custom diffusion 2023-07-11 20:46:32 +08:00
Xingjun.Wang
b53440f66a Merge pull request #373 from modelscope/dev/msdataset_cache_fix 
fix load meta-csv cathe paths
 2023-07-11 18:32:28 +08:00
xingjun.wang
de32a8f3e6 pre commit 2023-07-11 17:48:22 +08:00
Jintao
d20d033e07 add example/llm (#372) 
* add example/llm

* fix lint test
 2023-07-11 17:35:11 +08:00
Wang Qiang
d8dd3989de Xformers accelerate memory efficient attention (#362) 
* xformers accelerate memory efficient attention

* xformers

* precommit

---------

Co-authored-by: XDUWQ <yijing.wq@alibaba-inc.com>
 2023-07-11 16:28:35 +08:00
xingjun.wang
0c43a0e8ea fix load meta-csv cathe paths 2023-07-11 16:25:11 +08:00
Wang Qiang
fd6e352922 Add pipeline num_inference_steps and guidance_scale parameter for stable diffusion pipeline (#367) 
* add pipeline num_inference_steps and guidance_scale parameter

* precommit

---------

Co-authored-by: XDUWQ <yijing.wq@alibaba-inc.com>
 2023-07-11 15:36:35 +08:00
LingFeng.Chen.Cn
db0f70bc1c text_in is required (#365) 2023-07-07 22:14:13 +08:00
tastelikefeet
2a79a6cee7 fix history problem (#358) 2023-07-05 00:02:20 +08:00
Wang Qiang
d49953b943 fix bugs of loading local sd dataset (#357) 2023-07-04 22:01:21 +08:00
tastelikefeet
645925cadd Fix/chatglm pipeline (#356) 2023-07-04 20:52:15 +08:00
mushenL
95907aed31 Modify the parameter passing of the text_generation_pipeline class (#355) 2023-07-04 18:42:09 +08:00
Firmament-cyou
423e2ce940 Add lora_inference for baichuan. (#352) 
* add lora_inference.py for baichuan

* fix linttest

* fix linttest

---------

Co-authored-by: hemu <hemu.zp@alibaba-inc.com>
 2023-07-04 18:39:36 +08:00
tastelikefeet
08c71f1f3d Fix/chatglm6b 2 (#354) 2023-07-04 01:58:57 +08:00
tastelikefeet
45cf0035f4 fix chatglm2 evaluation error: hypothesis emtpy (#348) 
* fix evaluation error: hypothesis emtpy

* fix pipeline

* fix bug
 2023-07-03 23:16:38 +08:00
Jintao
432f0ee20f add baichuan/chatglm2 +lora+agent examples (#350) 2023-07-03 16:19:00 +08:00
Wang Qiang
a50342ed5d Add stable diffusion tutorial ipynb (#346) 2023-07-03 13:52:35 +08:00
Xingjun.Wang
799a0bd792 Merge pull request #347 from modelscope/merge_from_internal_0701 
Merge master from internal 0701
 2023-07-02 10:46:34 +08:00
xingjun.wang
4f548ae866 del =0.0.4 file 2023-07-01 23:16:54 +08:00
xingjun.wang
4e8374e850 merge internal master 0701 2023-07-01 23:05:03 +08:00
xingjun.wang
4b0eb96083 ok Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into merge_from_internal_0701 2023-07-01 23:03:53 +08:00
hemu.zp
bb194f1d96 fix llama bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13133641
* fix bug
 2023-06-30 20:49:30 +08:00
zsl01670416
2a2cc594eb Merge branch 'maas_flex_train_dev' modify finetune_text_classification for arguments collision between eval_strategy and by_e... 2023-06-30 19:04:14 +08:00
hemu.zp
30599dc34f fix llama lora bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13129620
 2023-06-30 19:03:56 +08:00
mulin.lyh
3683a4386f [to #50607174]feat: support parallel download large model file 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13113235
* [to #50607174]feat: support parallel download large model file
 2023-06-30 15:30:00 +08:00
wenmeng zhou
0e1971e94a Merge pull request #345 from modelscope/merge_master_internal0629 
Merge master internal0629
 2023-06-30 11:47:06 +08:00
wenmeng.zwm
21b31b2bdd revert data/test to newest 2023-06-29 22:13:19 +08:00
hemu.zp
f4c90f2adf Support lora for llama 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13080086

* support lora for llama

* update baichuan

* remove work_dir

* fixbug: 1. change ConfigDict to list when hooks key not in config 2. ignore all bin files when preparing output folder

* 1. support device_map 2. remove the operation of to float when using lora

* add inference file

* add comment

* support device_map
 2023-06-29 22:05:34 +08:00
wenmeng.zwm
cc0e7527d7 [to #50527737] fix cpu inference for stable diffusion pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13120858
 2023-06-29 20:35:57 +08:00
hemu.zp
1944416d3d Fix device_map for DiffusionForTextToImageSynthesis 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13115051
* add kwargs for device map
 2023-06-29 16:49:20 +08:00
yuze.zyz
d4b9396084 Revert "support device_map" 
This reverts commit 4d0367718d.
 2023-06-29 16:08:42 +08:00
yuze.zyz
4d0367718d support device_map 2023-06-29 08:07:43 +00:00
hemu.zp
612f0ebbc4 fix eval RecursionError 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13099203
 2023-06-29 10:47:54 +08:00
suluyan.sly
88de9f78aa [to #50538422]fix: support load from model id 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13092954
 2023-06-29 10:26:52 +08:00
yuze.zyz
e951598a82 Merge branch merge_master_github_0628 into master 
Title: Merge branch 'master-github' into merge_master_github_0628 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13104791
 2023-06-29 09:47:52 +08:00
wenmeng.zwm
0271b9c256 Merge branch 'master-github' into merge_master_github_0628 2023-06-28 20:27:34 +08:00
Wang Qiang
d8381bf9fd Stable diffusion examples of lora and dreambooth. (#341) 
* stable diffusion examples of lora and dreambooth

* pre-commit
 2023-06-28 20:13:28 +08:00
Wang Qiang
a018cd6107 Dreambooth method for finetuning stable diffusions (#339) 
* Copyright

* dreambooth

* dreambooth test trainer

* fix bugs

* pre-commit

---------

Co-authored-by: 翊靖 <yijing.wq@alibaba-inc.com>
 2023-06-28 20:10:28 +08:00
xingjun.wxj
0af8752024 Unfreeze datasets version setting 
1. Unfreeze datasets version setting
2. Fix some bugs in class NativeIterableDataset
3. Remove auto-converting (image/audio) object in col:FILE
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13080190
 2023-06-28 15:50:57 +08:00
mulin.lyh
48b62d8947 [to #50521098]fix: fix diffuser version conflict cv and multi-modal 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13079583
* [to #50521098]fix: fix diffuser version conflict cv and multi-modal
 2023-06-28 15:36:12 +08:00
mulin.lyh
1ea9b58447 fix torch2.0 compatible issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13086361

* fix face-aligment compatible

* fix torch2.0 compatible issue
 2023-06-28 14:15:48 +08:00
Wang Qiang
6942144ad7 Stable Diffusion model checkpoint export to onnx. (#340) 
* stable diffusion export onnx

* fix pre commit bugs

* fix bugs

* safety checker support

* test export stable diffusion
 2023-06-28 13:26:19 +08:00
yuze.zyz
8f18274f75 Add teardown for tests 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12643554

* add teardown for tests

* add teardown for dialog_modeling_trainer,document_grounded_dialog_generate_trainer,document_grounded_dialog_rerank_trainer,document_grounded_dialog_retrieval_trainer,training_args,translation_evaluation_trainer,translation_trainer
 2023-06-28 09:44:44 +08:00
mulin.lyh
eb0f0216c6 fix torch 2.x compatible issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13045011

* fix torch 2.x compatible issue

* fix torch 2.x compatible issue

* fix complex-valued input tensor matching the output from stft with return_complex=True.

* skip plugin test temporarily for modify torch version

* fix test_speech_signal_process.py compatible issue

* fix lint issue

* upgrade funasr to 0.6.5
 2023-06-27 14:40:51 +08:00
yuze.zyz
a58be34384 Add Lora/Adapter/Prompt and support for chatglm6B and chatglm2-6B 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12770413

* add prompt and lora

* add adapter

* add prefix

* add tests

* adapter smoke test passed

* prompt test passed

* support model id in petl

* migrate chatglm6b

* add train script for chatglm6b

* move gen_kwargs to finetune.py

* add chatglm2

* add model definination
 2023-06-27 14:38:18 +08:00
xingjun.wxj
1dbff6cb48 Support jsonl format in meta data 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13071970

* support jsonl in meta


* add UT and refine fetch_meta_files_from_url
 2023-06-27 11:58:19 +08:00
wenmeng.zwm
e9fba3c042 Merge branch merge_master_github_0626 into master 
Title: merge_master_github_0626 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13071322
 2023-06-26 23:31:22 +08:00