Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 04:29:22 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,795 Commits 263 Branches 106 Tags
568bd9dac72eed8bde67268ca69ee76f4901dfb3
Commit Graph

1795 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
XDUWQ
568bd9dac7 custom diffusion 2023-07-12 10:09:37 +08:00
XDUWQ
0ab981a021 custom diffusion 2023-07-12 10:04:20 +08:00
XDUWQ
ba2b5e0a57 custom diffusion 2023-07-12 09:51:46 +08:00
XDUWQ
1caa45422c custom diffusion 2023-07-11 20:46:32 +08:00
tastelikefeet
2a79a6cee7 fix history problem (#358) 2023-07-05 00:02:20 +08:00
Wang Qiang
d49953b943 fix bugs of loading local sd dataset (#357) 2023-07-04 22:01:21 +08:00
tastelikefeet
645925cadd Fix/chatglm pipeline (#356) 2023-07-04 20:52:15 +08:00
mushenL
95907aed31 Modify the parameter passing of the text_generation_pipeline class (#355) 2023-07-04 18:42:09 +08:00
Firmament-cyou
423e2ce940 Add lora_inference for baichuan. (#352) 
* add lora_inference.py for baichuan

* fix linttest

* fix linttest

---------

Co-authored-by: hemu <hemu.zp@alibaba-inc.com>
 2023-07-04 18:39:36 +08:00
tastelikefeet
08c71f1f3d Fix/chatglm6b 2 (#354) 2023-07-04 01:58:57 +08:00
tastelikefeet
45cf0035f4 fix chatglm2 evaluation error: hypothesis emtpy (#348) 
* fix evaluation error: hypothesis emtpy

* fix pipeline

* fix bug
 2023-07-03 23:16:38 +08:00
Jintao
432f0ee20f add baichuan/chatglm2 +lora+agent examples (#350) 2023-07-03 16:19:00 +08:00
Wang Qiang
a50342ed5d Add stable diffusion tutorial ipynb (#346) 2023-07-03 13:52:35 +08:00
Xingjun.Wang
799a0bd792 Merge pull request #347 from modelscope/merge_from_internal_0701 
Merge master from internal 0701
 2023-07-02 10:46:34 +08:00
xingjun.wang
4f548ae866 del =0.0.4 file 2023-07-01 23:16:54 +08:00
xingjun.wang
4e8374e850 merge internal master 0701 2023-07-01 23:05:03 +08:00
xingjun.wang
4b0eb96083 ok Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into merge_from_internal_0701 2023-07-01 23:03:53 +08:00
hemu.zp
bb194f1d96 fix llama bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13133641
* fix bug
 2023-06-30 20:49:30 +08:00
zsl01670416
2a2cc594eb Merge branch 'maas_flex_train_dev' modify finetune_text_classification for arguments collision between eval_strategy and by_e... 2023-06-30 19:04:14 +08:00
hemu.zp
30599dc34f fix llama lora bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13129620
 2023-06-30 19:03:56 +08:00
mulin.lyh
3683a4386f [to #50607174]feat: support parallel download large model file 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13113235
* [to #50607174]feat: support parallel download large model file
 2023-06-30 15:30:00 +08:00
wenmeng zhou
0e1971e94a Merge pull request #345 from modelscope/merge_master_internal0629 
Merge master internal0629
 2023-06-30 11:47:06 +08:00
wenmeng.zwm
21b31b2bdd revert data/test to newest 2023-06-29 22:13:19 +08:00
hemu.zp
f4c90f2adf Support lora for llama 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13080086

* support lora for llama

* update baichuan

* remove work_dir

* fixbug: 1. change ConfigDict to list when hooks key not in config 2. ignore all bin files when preparing output folder

* 1. support device_map 2. remove the operation of to float when using lora

* add inference file

* add comment

* support device_map
 2023-06-29 22:05:34 +08:00
wenmeng.zwm
cc0e7527d7 [to #50527737] fix cpu inference for stable diffusion pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13120858
 2023-06-29 20:35:57 +08:00
hemu.zp
1944416d3d Fix device_map for DiffusionForTextToImageSynthesis 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13115051
* add kwargs for device map
 2023-06-29 16:49:20 +08:00
yuze.zyz
d4b9396084 Revert "support device_map" 
This reverts commit 4d0367718d.
 2023-06-29 16:08:42 +08:00
yuze.zyz
4d0367718d support device_map 2023-06-29 08:07:43 +00:00
hemu.zp
612f0ebbc4 fix eval RecursionError 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13099203
 2023-06-29 10:47:54 +08:00
suluyan.sly
88de9f78aa [to #50538422]fix: support load from model id 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13092954
 2023-06-29 10:26:52 +08:00
yuze.zyz
e951598a82 Merge branch merge_master_github_0628 into master 
Title: Merge branch 'master-github' into merge_master_github_0628 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13104791
 2023-06-29 09:47:52 +08:00
wenmeng.zwm
0271b9c256 Merge branch 'master-github' into merge_master_github_0628 2023-06-28 20:27:34 +08:00
Wang Qiang
d8381bf9fd Stable diffusion examples of lora and dreambooth. (#341) 
* stable diffusion examples of lora and dreambooth

* pre-commit
 2023-06-28 20:13:28 +08:00
Wang Qiang
a018cd6107 Dreambooth method for finetuning stable diffusions (#339) 
* Copyright

* dreambooth

* dreambooth test trainer

* fix bugs

* pre-commit

---------

Co-authored-by: 翊靖 <yijing.wq@alibaba-inc.com>
 2023-06-28 20:10:28 +08:00
xingjun.wxj
0af8752024 Unfreeze datasets version setting 
1. Unfreeze datasets version setting
2. Fix some bugs in class NativeIterableDataset
3. Remove auto-converting (image/audio) object in col:FILE
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13080190
 2023-06-28 15:50:57 +08:00
mulin.lyh
48b62d8947 [to #50521098]fix: fix diffuser version conflict cv and multi-modal 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13079583
* [to #50521098]fix: fix diffuser version conflict cv and multi-modal
 2023-06-28 15:36:12 +08:00
mulin.lyh
1ea9b58447 fix torch2.0 compatible issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13086361

* fix face-aligment compatible

* fix torch2.0 compatible issue
 2023-06-28 14:15:48 +08:00
Wang Qiang
6942144ad7 Stable Diffusion model checkpoint export to onnx. (#340) 
* stable diffusion export onnx

* fix pre commit bugs

* fix bugs

* safety checker support

* test export stable diffusion
 2023-06-28 13:26:19 +08:00
yuze.zyz
8f18274f75 Add teardown for tests 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12643554

* add teardown for tests

* add teardown for dialog_modeling_trainer,document_grounded_dialog_generate_trainer,document_grounded_dialog_rerank_trainer,document_grounded_dialog_retrieval_trainer,training_args,translation_evaluation_trainer,translation_trainer
 2023-06-28 09:44:44 +08:00
mulin.lyh
eb0f0216c6 fix torch 2.x compatible issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13045011

* fix torch 2.x compatible issue

* fix torch 2.x compatible issue

* fix complex-valued input tensor matching the output from stft with return_complex=True.

* skip plugin test temporarily for modify torch version

* fix test_speech_signal_process.py compatible issue

* fix lint issue

* upgrade funasr to 0.6.5
 2023-06-27 14:40:51 +08:00
yuze.zyz
a58be34384 Add Lora/Adapter/Prompt and support for chatglm6B and chatglm2-6B 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12770413

* add prompt and lora

* add adapter

* add prefix

* add tests

* adapter smoke test passed

* prompt test passed

* support model id in petl

* migrate chatglm6b

* add train script for chatglm6b

* move gen_kwargs to finetune.py

* add chatglm2

* add model definination
 2023-06-27 14:38:18 +08:00
xingjun.wxj
1dbff6cb48 Support jsonl format in meta data 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13071970

* support jsonl in meta


* add UT and refine fetch_meta_files_from_url
 2023-06-27 11:58:19 +08:00
wenmeng.zwm
e9fba3c042 Merge branch merge_master_github_0626 into master 
Title: merge_master_github_0626 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13071322
 2023-06-26 23:31:22 +08:00
suluyan.sly
7e28ca226b [to #50334474] llama tuned model -> pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13071602
* prepare for inference
 2023-06-26 22:49:44 +08:00
wenmeng.zwm
6ab85256af to [#50529030] fix easycv lr hook error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13069804
 2023-06-26 21:54:01 +08:00
wenmeng.zwm
341cdd20a8 add missing deepspeed_hook 2023-06-26 21:11:08 +08:00
wenmeng.zwm
9e51920fdb Merge branch 'master-github' into merge_master_github_0626 2023-06-26 21:04:05 +08:00
suluyan.sly
b6c40aaa87 [to #50538422] feat: make diff & recover for llama based weights 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13055390
 2023-06-26 19:41:19 +08:00
co63oc
21f59f317e Fix some words (#318) 2023-06-26 16:57:47 +08:00
wenmeng zhou
6dea1d5646 Fix/citest timeout (#308) 
* timeout for citest set to 240min

* update docker image

* fix ci template not packed in whl

* update docker image version to 1.6.1 and add python3.8 support

* randome choose a model for controlnet to avoid oom
 2023-06-26 11:23:10 +08:00