Commit Graph

1886 Commits

Author SHA1 Message Date
wenmeng.zwm
f047eed4c1 fix 2023-08-01 10:15:01 +08:00
wenmeng.zwm
34b75afac3 add support for chatglm2 32k 2023-08-01 09:54:22 +08:00
Xingjun.Wang
ef1b429bef Merge pull request #430 from XDUWQ/delete_nerf_log
delete unuseful logs
2023-07-31 14:48:39 +08:00
XDUWQ
4233916867 delete unuseful logs 2023-07-31 14:36:12 +08:00
Jintao
312b63fe06 fix checkpoint, same device bug (#427) 2023-07-29 00:06:27 +08:00
tastelikefeet
972298813b 1. add check model for training 2. add model_dir for automodel (#422) 2023-07-28 16:34:02 +08:00
frozoul
2566d028cd cv/cv nerf 3d reconstruction 4k nerf damo (#389)
* add 4k-nerf core files

* update configure file

* update dataloader and model path

* update unittest

* Delete test_4k.py

* update unittest

* update unittest

* update pre-commit

* update dataloader

* update cuda code path

* check with pre-commit

---------

Co-authored-by: zhongshu.wzs <zhongshu.wzs@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
2023-07-28 10:37:13 +08:00
Xingjun.Wang
3bd395a0c9 Merge pull request #423 from modelscope/dev/del_redundancy_code
del redundant code
2023-07-27 20:53:01 +08:00
xingjun.wang
6748cd7370 del redundancy code in func: get_dataset_meta_file_list 2023-07-27 20:49:41 +08:00
Wang Qiang
34ea2b474a Upgrade stable diffusion version to a more powerful version 2.1 (#415) 2023-07-27 20:40:38 +08:00
Wang Qiang
dca6143b8b support safetensors weight pipeline (#421) 2023-07-27 16:49:01 +08:00
tastelikefeet
9802dfe93b fix device error (#419) 2023-07-27 16:23:21 +08:00
Wang Qiang
66cf72a75c Merge pull request #376 from XDUWQ/custom_diffusion
Custom method for finetuning stable diffusion
2023-07-27 10:41:38 +08:00
suluyana
534a020e93 Merge pull request #418 from tastelikefeet/feat/fix_device_split
fix CI
2023-07-27 10:03:41 +08:00
yuze.zyz
00c79428d5 fix 2023-07-26 21:30:38 +08:00
Jintao
4ca937d2ba support openbuddy-llama2-13b (#416) 2023-07-26 18:12:55 +08:00
Zackary Shen
ba4db97507 upload cv_nerf_3d-reconstruction_vector-quantize-compression (#407)
* add vq_compression model

* add vq_compression model

* check pre-commit for lint test

* fix by flake8

* update

* update

* update

* the last update

* the laast update

* update test_level>=0

---------

Co-authored-by: 剑匣 <zackary.sz@alibaba-inc.com>
2023-07-26 17:20:13 +08:00
XDUWQ
3a629bb2b4 pre 2023-07-26 16:58:58 +08:00
XDUWQ
99aa707995 fix bugs 2023-07-26 16:35:40 +08:00
XDUWQ
25d67a0b83 pre 2023-07-26 16:08:24 +08:00
XDUWQ
70da8b7809 fix bugs 2023-07-26 15:54:37 +08:00
XDUWQ
a7678bbb77 precommit 2023-07-26 15:06:42 +08:00
XDUWQ
c0b62cb0fb fix bugs 2023-07-26 15:03:46 +08:00
Xingjun.Wang
41c2c95083 dataset fix version (#413)
* modify datasets version
2023-07-25 22:18:25 +08:00
tastelikefeet
0db3d1d53b Fix bug of amp and device_map (#397)
* fix amp

* remove useless code

* Fix bug
2023-07-25 19:28:00 +08:00
Jintao
f03898626e ckpt output directory ignore *.safetensors (#410)
* ckpt output file ignore *.safetensors

* update
2023-07-25 19:27:11 +08:00
XDUWQ
3412a074c5 precommit 2023-07-25 15:00:28 +08:00
XDUWQ
ffbf77fcf2 update 2023-07-25 14:47:45 +08:00
wenmeng zhou
7b249400d9 refine class wrapper (#409) 2023-07-25 10:13:02 +08:00
Wang Qiang
0f551d3983 Merge pull request #408 from XDUWQ/lora_rank
Add lora_rank parameter for lora stable diffusion
2023-07-24 22:57:06 +08:00
XDUWQ
8e157cfa15 precommit 2023-07-24 22:10:52 +08:00
wenmeng zhou
64203e89ee Compatibility for huggingface transformers (#391) 2023-07-24 20:53:27 +08:00
XDUWQ
8e00d85317 fix bugs 2023-07-24 19:46:22 +08:00
XDUWQ
426f55d57b add lora_rank for lora stable diffusion 2023-07-24 19:43:20 +08:00
XDUWQ
bc93e2dc96 add lora_rank for lora stable diffusion 2023-07-24 19:32:04 +08:00
XDUWQ
eb24e23d19 add lora_rank for lora stable diffusion 2023-07-24 19:24:52 +08:00
XDUWQ
6fb340e7f8 add lora_rank for lora stable diffusion 2023-07-24 19:17:49 +08:00
Jintao
ba4b9fc43f Added full parameter sft to llm (#402)
* Optimized code

* update parse_args

* fix get_logger bug

* update parse_args

* Added full parameter fine-tuning

* Add support_bf16 warning

* Modify the code format and fix bugs
2023-07-24 15:52:09 +08:00
lylalala
f805d86aed llama2 support chat (#404)
* support chat

* update llama2 chat testcase

* add gen kwargs and devices

* update unittest and support max_length in multi-turn dialogue
2023-07-24 15:38:01 +08:00
Ikko Eltociear Ashimine
9dedac31fd Add Japanese README (#405) 2023-07-24 11:14:16 +08:00
mushenL
f77237b049 add llama2 pipeline (#399)
* Modify the parameter passing of the text_generation_pipeline class

* add llama2 pipeline

* add llama pipeline v1.1

* add llama pipeline v1.2

* add llama pipeline v1.3

* add llama pipeline v1.0.4
2023-07-22 21:53:04 +08:00
Xingjun.Wang
7608868290 Merge pull request #403 from modelscope/dev/check_lint
fix yapf error
v1.7.2
2023-07-22 00:01:01 +08:00
xingjun.wang
5a49093422 fix yapf 2023-07-21 23:37:17 +08:00
xingjun.wang
96a5282021 check format 2023-07-21 23:09:24 +08:00
LingFeng.Chen.Cn
9c4d9cdb68 fix file not found cause TypeError (#385)
* fix file not found cause TypeError

* fix linter test

* fix linter test

* format code

---------

Co-authored-by: Krasus <chen@krasus.red>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2023-07-21 15:34:19 +08:00
LingFeng.Chen.Cn
19ea082fec Update speaker_verification_pipeline.py (#364)
* Update speaker_verification_pipeline.py

* fix log too long when input tuple(bytes,bytes)

* Update speaker_verification_pipeline.py

* fix when bytes print too much

* Update speaker_verification_pipeline forward log

* pre-commit linter format


---------

Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2023-07-20 09:28:55 +08:00
tastelikefeet
78b3e74fd8 pre-commit passed (#395) 2023-07-19 20:59:58 +08:00
Jintao
2f7c669f33 support llama2 (#393)
* Unify sft and infer code into a single file

* update llama2 sft infer
2023-07-19 17:34:27 +08:00
tastelikefeet
3283a46c52 Add Llama2 from hf (#394)
* update llama code

* add llama2

* revert llama code

* add llama2 registry

* fix bug
2023-07-19 17:22:03 +08:00
XDUWQ
66795aa3ff change tests level 2023-07-19 09:41:21 +08:00