tastelikefeet
12bc1603a9
Fix amp + device_map ( #386 )
...
1. Fix the amp + device_map bug in chatglm2 finetune code
2. Optional to save optimizer state
3. Fix the logger double print problem
2023-07-16 08:45:20 +08:00
tastelikefeet
544f6c0410
Fea/chatglm6b v2 new version ( #368 )
...
* upgrade code
* add chatglm2 ptuning
* pre-commit passed
2023-07-12 14:44:09 +08:00
tastelikefeet
08c71f1f3d
Fix/chatglm6b 2 ( #354 )
2023-07-04 01:58:57 +08:00
tastelikefeet
45cf0035f4
fix chatglm2 evaluation error: hypothesis emtpy ( #348 )
...
* fix evaluation error: hypothesis emtpy
* fix pipeline
* fix bug
2023-07-03 23:16:38 +08:00
hemu.zp
f4c90f2adf
Support lora for llama
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13080086
* support lora for llama
* update baichuan
* remove work_dir
* fixbug: 1. change ConfigDict to list when hooks key not in config 2. ignore all bin files when preparing output folder
* 1. support device_map 2. remove the operation of to float when using lora
* add inference file
* add comment
* support device_map
2023-06-29 22:05:34 +08:00
yuze.zyz
d4b9396084
Revert "support device_map"
...
This reverts commit 4d0367718d
2023-06-29 16:08:42 +08:00
yuze.zyz
4d0367718d
support device_map
2023-06-29 08:07:43 +00:00
yuze.zyz
a58be34384
Add Lora/Adapter/Prompt and support for chatglm6B and chatglm2-6B
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12770413
* add prompt and lora
* add adapter
* add prefix
* add tests
* adapter smoke test passed
* prompt test passed
* support model id in petl
* migrate chatglm6b
* add train script for chatglm6b
* move gen_kwargs to finetune.py
* add chatglm2
* add model definination
2023-06-27 14:38:18 +08:00
