2 Commits

Author	SHA1	Message	Date
Firmament-cyou	423e2ce940	Add lora_inference for baichuan. (#352) ... * add lora_inference.py for baichuan * fix linttest * fix linttest --------- Co-authored-by: hemu <hemu.zp@alibaba-inc.com>	2023-07-04 18:39:36 +08:00
hemu.zp	f4c90f2adf	Support lora for llama ... Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13080086 * support lora for llama * update baichuan * remove work_dir * fixbug: 1. change ConfigDict to list when hooks key not in config 2. ignore all bin files when preparing output folder * 1. support device_map 2. remove the operation of to float when using lora * add inference file * add comment * support device_map	2023-06-29 22:05:34 +08:00