5 Commits

Author	SHA1	Message	Date
hemu.zp	bb194f1d96	fix llama bug ... Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13133641 * fix bug	2023-06-30 20:49:30 +08:00
hemu.zp	30599dc34f	fix llama lora bug ... Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13129620	2023-06-30 19:03:56 +08:00
hemu.zp	f4c90f2adf	Support lora for llama ... Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13080086 * support lora for llama * update baichuan * remove work_dir * fixbug: 1. change ConfigDict to list when hooks key not in config 2. ignore all bin files when preparing output folder * 1. support device_map 2. remove the operation of to float when using lora * add inference file * add comment * support device_map	2023-06-29 22:05:34 +08:00
suluyan.sly	7e28ca226b	[to #50334474] llama tuned model -> pipeline ... Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13071602 * prepare for inference	2023-06-26 22:49:44 +08:00
suluyan.sly	de491cfe6b	[to #48855014] llama finetune + deepspeed ... 1. llama base finetune：使用trainer从llama finetune至alpaca，效果确认并提供example 2. deepspeed通用性完善：mpu解耦；deepspeed的训练信息支持从ms log透出（目前ms打印的log有误）；支持从modelscope configuration.json 进行 deepspeed config 配置；deepspeed optimizer和lr_scheduler 初始化支持；解决deepspeed和ddp同时使用报错；解决保存ckpt时报错 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12651323	2023-06-14 10:00:23 +08:00